CLARIN-NL - grammatical relation assignment

TTNWW

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

TTNWW - TST Tools for the Dutch Language as Web services in a Workflow

Description

TTNWW integrates and makes available existing Language Technology (LT) software components for the Dutch language that have been developed in the STEVIN and CGN projects. The LT components (for text and speech) are made available as web-services in a simplified workflow system that enables researchers without much technical background to use standard LT workflow recipes. The web services are available in two separate domains: "Text" and "Speech" processing. For "Text", workflows for the following functionality is offered by TTNWW: - Orthographic Normalisation using TICCLops (version CLARIN-NL 1.0); - Part of Speech Tagging, Lemmatisation, Chunking, limited Multiword Unit Recognition, and Grammatical Relation Assignment by Frog (Version 012.012); - Syntactic Parsing (including grammatical relation assignment, limited named entity recognition, and limited multiword unit recognition) by the Alpino Parser (version 1.3); - Semantic Annotation; - Named Entity Recognition; - Co-reference Assignment. For "Speech", the following workflows are offered: - Automatic Transcription of speech files using a Netherlands Dutch acoustic model; - Automatic Transcription of speech files using a Flemish Dutch acoustic model; - Conversion of the input speech file to the required sampling rate, followed by automatic transcription. The TTNWW services have been created in a Dutch and Flemish collaboration project building on the results of past Dutch and Flemish projects. The web services are partly deployed in the SURF-SARA BiG-Grid cloud or at CLARIN centres in the Netherlands and at CLARIN VL University partners. The architecture of the TTNWW portal consists out of several components and follows the principles of Service Oriented Architecture (SOA). The TTNWW GUI front-end is a Flex module that communicates with the TTNWW web-application which keeps track of the different sessions and knows which LT recipes are available. TTNWW communicates assigments (workflow specifications) to the WorkflowService that evaluates the requested workflow and requests the DeploymentSevice to start the required LT web-services. After initialization of the LT web-services, the workflow specification is sent to the Taverna Server, that takes further care of the workflow. To facilitate the process of wrapping applications that were originally designed as standalone applications into web services, the CLAM (Computational Linguistics Application Mediator) wrapper software allows for easy and transparent transformation of applications into RESTful web services. The CLAM software has extensively been used in the TTNWW project for both text and speech processing tools. With the exception of Alpino and MBSRL all web services work operate on CLAM wrappers. Given the number of web services involved in the TTNWW project and possibilities offered by the cloud environment the preferred method of delivering the web service installations was delivery of complete virtual machine images by the LT providers. These could be directly uploaded into the cloud environment and thus relieving the CLARIN centres nd LT providers from the original foreseen task of running the webservices themselves. A potential advantage of this method, that has not been exploited in the project yet, is that these images may be also be delivered directly to the end user so these can be run in a local configuration using virtualization software such as VMWare of VirtualBox. The workflow engine used in the project was Taverna. But build on top of this was a a number of selectable task recipes, following a task oriented approach in line with the premises that users with no or little technical expertise should be able to use the system. In this context, tasks are understood in terms of end results of processes such as semantic role labelling, pos tagging or syntactic analysis and ready-made workflows are constructed that can be readily used by the end user.

Project

TTNWW

CLARIN National Project

CLARIN-NL

CLARIN centre

Meertens/HuC

Research domain

Linguistics

Communication and Media Studies

History

Oral History

Linguistic Subject

discourse analysis

Orthography

Semantics

Syntax

Tool task

grammatical relation assignment

coreference resolution

corpus processing

dependency parsing

lemmatisation

multiword unit identification

named entity recognition

orthographic normalisation

part of speech tagging

semantic role labeling

chunking

parsing

speech recognition

speech transcription

tokenisation

up/down sampling

Country

Netherlands

Input Language

Dutch

Access Contact

Daan Broeder

Project Contact

/mailto:Daan.Broeder@meertens.knaw.nl/

Creator Contact

/mailto:Daan.Broeder@meertens.knaw.nl/

Documentation

TTNWW handleiding

Source code

not specified

Original source

http://portal.clarin.nl/node/1964

Publications

Kemps-Snijders, M, Schuurman, I, Daelemans, W, Demuynck, K, Desplanques, B, Hoste, V, Huijbregts, M, Martens, J-P, Paulussen, H, Pelemans, J, Reynaert, M, Vandeghinste, V, van den Bosch, A, van denHeuvel, H, van Gompel, M, van Noord, G and Wambacq, P. 2017. TTNWW to the Rescue: No Need to Know How to Handle Tools and Resources. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 83–93. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.7. License: CC-BY 4.0

Resource

CMDI File Link

License

unknown

Inventory Scope

local

PaQu

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

PaQu - Parse and Query

Description

PaQu uses the Alpino parser to make treebanks of your own text corpus, and to search in these treebanks using an interface based on the LASSY Word Relations Search interface (http://dev.clarin.nl/node/1966). Several treebanks are already available in the application, such as: Lassy Klein (1M words, manually checked syntactic analysis) and Lassy Groot (700M words, syntactic analysis automatically assigned by Alpino). PaQu offers two ways to search through the syntactically annotated texts. The first option is to use the search bar to look for word pairs, optionally complemented by their syntactic relationship. The second search option is to use the query language XPath.

Project

PaQu

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Computational Linguistics

general linguistics

Syntax

Tool task

corpus browsing

corpus searching

corpus processing

parsing

dependency parsing

grammatical relation assignment

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Enriching Data

Tool status

published

Input format

text/plain

Output format

text/plain

Input Language

Dutch

Version

no explicit version mentioned

Access Contact

Gertjan van Noord

Project Contact

/mailto:g.j.m.van.noord@rug.nl/

Creator Contact

/mailto:p.c.j.kleiweg@rug.nl/

Documentation

PaQu Info

paqu/README.md

Source code

https://github.com/rug-compling/paqu

Original source

http://portal.clarin.nl/node/4182

Publications

Odijk, J, van Noord, G, Kleiweg, P and Tjong Kim Sang, E. 2017. The Parse and Query (PaQu) Application. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 281–297. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.23. License: CC-BY 4.0

Resource

CMDI File Link

License

other

Inventory Scope

local

GrETEL 4.0

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

GrETEL Search Engine for Querying Syntactic Constructions in Treebanks

Description

GrETEL Version 4 extends the functionality of GrETEL in a number of ways: (1) it allows uploading one's own corpus, either a parsed corpus in LASSY DTD format, or a text corpus in a variety of formats (currently supported: plain text, CHAT; FoLiA and TEI to follow). An uploaded unparsed corpus will be automatically parsed by Alpino and made available in the search interface. (2) It also enables upload of metadata that are contained in the data, e.g. in accordance with the PaQu metadata format (3) Checking of XPath expressions and suggestions for selecting valid attributes and values have been added, as have the use of macros (a la PaQu) (4) filtering on the basis of metadata has been made possible (5) full analysis of the metadta in combination with nodes and their properties from the syntactic structures is available, allowing a user to select, group, sort, and filter data and metadata in combination, through a pivot table with draggable attributes and node properties. Sums , counts, heatmaps and other graphical visualisation enable rapid analysis of the data. GrETEL 4 is being developed by Utrecht University (UiL-OTS and Digital Humanities Lab) in the context of the AnnCor and CLARIAH-CORE projects. It based on GrETEL 3 developed by KU Leuven. GrETEL is a query engine in which linguists can use a natural language example as a starting point for searching a treebank with limited knowledge about tree representations and formal query languages. Instead of a formal search instruction, it takes a natural language example as input. This provides a convenient way for novice and non-technical users to use treebanks with a limited knowledge of the underlying syntax and formal query languages. By allowing linguists to search for constructions similar to the example they provide, it aims to bridge the gap between descriptive-theoretical and computational linguistics. The example-based query procedure consists of six steps. In the first step the user enters an example of the construction he/she is interested in. In the second step the example sentence is automatically parsed with the Alpino parser, resulting in a parse tree. In the third step the example is returned in the form of a matrix, in which the user specifies which aspects of this example are essential for the construction under investigation. Based on the information indicated in the matrix, a query tree is cut out of the initial parse tree and automatically converted to an XPath query. By clicking the advanced options button, the XPath query is made visible, and can be edited if desired. This query will be used for the actual treebank search. In the fourth step the user can select which treebank needs to be queried. The fifth step provides an overview of the search instruction, i.e. the input sentence, the selected treebank(s), the query tree and the (adapted) XPath query. In the sixth step the query is executed on the selected corpus. The matching constructions are presented to the user as a list of sentences, which can be downloaded. The user can also click on the sentences in order to visualize the results as syntax trees. In addition to the example-based search functionality, users can also query the treebanks using an XPath expression. This query is then processed in the same way as the automatically generated query in the example-based approach.

Project

AnnCor

CLARIAH-CORE

CLARIN National Project

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Computational Linguistics

Tool task

corpus searching

corpus exploration

querying

corpus processing

parsing

dependency parsing

grammatical relation assignment

analysis

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Enriching Data

Tool status

alpha

Input format

text/xml

text/plain

Output format

text/xml

Input Language

Dutch

Version

4.0

Access Contact

Jan Odijk

Project Contact

Jan Odijk

Creator Contact

Jan Odijk

Martijn van der Klis

Sheean Spoel

Gerson Foks

Documentation

GrETEL manual and documentation

Source code

https://github.com/UUDigitalHumanitieslab/gretel

https://github.com/UUDigitalHumanitieslab/GrETEL-upload

Original source

http://portal.clarin.nl/node/1967

Publications

Augustinus, L, Vandeghinste, V, Schuurman, I and Van Eynde, F. 2017. GrETEL: A Tool for Example-Based Treebank Mining. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 269–280. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.22. License: CC-BY 4.0

Jan Odijk, Martijn van der Klis and Sheean Spoel. 2018. Extensions to the GrETEL Treebank Query Application, in Proceedings of TLT16, 23-24 Jan 2018, Prague, Czech Republic

Resource

CMDI File Link

License

CC-BY-NC-SA

Inventory Scope

local

PaQu

Erica Renckens — Thu, 15 Jan 2015 13:00:04 +0000

PaQu - Parse and Query

Summary

The PaQu web service makes it possible to search in syntactically annotated corpora in Dutch. You can parse your own Dutch text corpus or use one of two corpora provided by the developers.

Background

Please note: This is a preliminary version of this application. Use Lassy (http://dev.clarin.nl/node/1966) for searching the Lassy Treebanks.

PaQu uses the Alpino parser to make treebanks of your own text corpus, and to search in these treebanks using an interface based on the LASSY Word Relations Search interface (http://dev.clarin.nl/node/1966). Two treebanks are already available in the application: Lassy Klein (1M words, manually checked syntactic analysis) and Lassy Groot (700M words, syntactic analysis automatically assigned by Alpino).
PaQu offers two ways to search through the syntactically annotated texts. The first option is to use the search bar to look for word pairs, optionally complemented by their syntactic relationship. The second search option is to use the query language XPath.

Contacts

Project leader: prof.dr. Gertjan van Noord  
Developer: Drs. P. Kleiweg (Groningen University)
CLARIN center: none
Help contact : p.c.j.kleiweg@rug.nl

Links

Web-sites: n.a.
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.let.rug.nl/alfa/paqu/info.html (http://zardoz.service.rug.nl:8067/info.html )
Tool/Service link: http://www.let.rug.nl/alfa/paqu (http://zardoz.service.rug.nl:8067/)
Publications: n.a.

Research domain

Computational Linguistics

Linguistics

Syntax

Language

Dutch

Resource tags

data

corpus

text corpus

service

text processing

mono-lingual

Tool task

annotation

corpus exploration

browse

text processing

grammatical relation assignment

parsing

Country

Netherlands

TTNWW

root — Sun, 15 Jun 2014 13:01:54 +0000

TTNWW - TST Tools voor het Nederlands als Webservices in een Workflow

Summary

Background

The web services are available in two separate domains: "Text" and "Speech" processing. For "Text", workflows for the following functionality is offered by TTNWW:

Orthographic Normalisation using TICCLops (version CLARIN-NL 1.0)
Part of Speech Tagging, Lemmatisation, Chunking, limited Multiword Unit Recognition, and Grammatical Relation Assignment by Frog (Version 012.012)
Syntactic Parsing (including grammatical relation assignment, limited named entity recognition, and limited multiword unit recognition) by the Alpino Parser (version 1.3)
Semantic Annotation
Named Entity Recognition
Co-reference Assignment

For "Speech", the following workflows are offered:

Automatic Transcription of speech files using a Netherlands Dutch acoustic model
Automatic Transcription of speech files using a Flemish Dutch acoustic model
Conversion of the input speech file to the required sampling rate, followed by automatic transcription

The TTNWW services have been created in a Dutch and Flemish collaboration project building on the results of past Dutch and Flemish projects. The web services are partly deployed in the SURF-SARA BiG-Grid cloud or at CLARIN centres in the Netherlands and at CLARIN VL University partners.

The architecture of the TTNWW portal consists out of several components and follows the principles of Service Oriented Architecture (SOA). The TTNWW GUI front-end is a Flex module that communicates with the TTNWW web-application which keeps track of the different sessions and knows which LT recipes are available. TTNWW communicates assigments (workflow specifications) to the WorkflowService that evaluates the requested workflow and requests the DeploymentSevice to start the required LT web-services. After initialization of the LT web-services, the workflow specification is sent to the Taverna Server, that takes further care of the workflow.

To facilitate the process of wrapping applications that were originally designed as standalone applications into web services, the CLAM (Computational Linguistics Application Mediator) wrapper software allows for easy and transparent transformation of applications into RESTful web services. The CLAM software has extensively been used in the TTNWW project for both text and speech processing tools. With the exception of Alpino and MBSRL all web services work operate on CLAM wrappers.

Given the number of web services involved in the TTNWW project and possibilities offered by the cloud environment the preferred method of delivering the web service installations was delivery of complete virtual machine images by the LT providers. These could be directly uploaded into the cloud environment and thus relieving the CLARIN centres nd LT providers from the original foreseen task of running the webservices themselves. A potential advantage of this method, that has not been exploited in the project yet, is that these images may be also be delivered directly to the end user so these can be run in a local configuration using virtualization software such as VMWare of VirtualBox.

The workflow engine used in the project was Taverna. But build on top of this was a a number of selectable task recipes, following a task oriented approach in line with the premises that users with no or little technical expertise should be able to use the system. In this context, tasks are understood in terms of end results of processes such as semantic role labelling, pos tagging or syntactic analysis and ready-made workflows are constructed that can be readily used by the end user. Contacts

Project leader: Marc Kemps-Snijders (NL), Ineke Schuurman (VL)  
CLARIN center: Meertens Institute (portal) and others (web-services).
Help contact : n.a.

Links