CLARIN-NL - corpus exploration

corpus searching

browsing

analysis

visualisation

Country

Netherlands

Input Language

Hebrew

Aramaic

Access Contact

Dirk Roorda

Project Contact

/mailto:dirk.roorda@dans.knaw.nl/

Creator Contact

Prof. Dr. W.T. (Wido) van Peursen

Documentation

SHEBANQ - help

Source code

not specified

Original source

http://portal.clarin.nl/node/4180

Publications

Roorda, D. 2017. The Hebrew Bible as Data: Laboratory - Sharing - Experiences. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 217–229. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.18. License: CC-BY 4.0

Roorda, D. (2015). The Hebrew Bible as Data: Laboratory - Sharing - Experiences http://arxiv.org/abs/1501.01866

Roorda, D. (2014). LAF-Fabric: a data analysis tool for Linguistic Annotation Framework with an application to the Hebrew Bible, Computational Linguistics in the Netherlands Journal, Volume 4, December 2014, pp. 105-109 http://www.clinjournal.org/sites/clinjournal.org/files/08-Roorda-etal-CLIN2014.pdf and http://arxiv.org/abs/1410.0286

Resource

SearchPage

Resource

CMDI File Link

License

Creative Commons (non-commercial)

Inventory Scope

local

OpenSONAR

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

OpenSONAR: a 500 MW reference corpus of Contemporary Written Dutch

Description

Project

OpenSONAR

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Linguistic Subject

general linguistics

Lexicology

Morphology

Syntax

text and corpus linguistics

Tool task

corpus browsing

corpus searching

Country

Netherlands

Tool Type

web application

Research Phase

Data analysis

Tool status

published

Input Language

Dutch

Access Contact

/mailto:servicedesk@ivdnt.org/

Institute for the Dutch Language

Project Contact

/mailto:-/

Creator Contact

Dr. Nelleke Oostdijk

Radboud University

Katholieke Universiteit Leuven (CCL)

Hogeschool Gent (Dept. Vertaalkunde, LT3)

Tilburg University (TiCC/ILK)

Twente University (HMI)

Utrecht University (UiL-OTS)

Documentation

OpenSONAR Manual - First Use

SoNaR User Manual 1.0.4

Source code

not specified

Original source

http://portal.clarin.nl/node/4195

Publications

van de Camp, M, Reynaert,MandOostdijk, N. 2017.WhiteLab 2.0: AWeb Interface for Corpus Exploitation. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 231–243. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.19. License: CC-BY 4.0

de Does, J, Niestadt, J and Depuydt, K. 2017. Creating Research Environments with BlackLab. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 245–257. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.20. License: CC-BY 4.0

Oostdijk, N., Reynaert, M., Hoste, V., Schuurman, I. (2013) The Construction of a 500 Million Word Reference Corpus of Contemporary Written Dutch in: Essential Speech and Language Technology for Dutch: Results by the STEVIN-programme (eds. P. Spyns, J. Odijk), Springer Verlag.

Resource

SearchPage

CMDI File Link

License

other

Inventory Scope

local

GrETEL 4.0

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

GrETEL Search Engine for Querying Syntactic Constructions in Treebanks

Description

GrETEL Version 4 extends the functionality of GrETEL in a number of ways: (1) it allows uploading one's own corpus, either a parsed corpus in LASSY DTD format, or a text corpus in a variety of formats (currently supported: plain text, CHAT; FoLiA and TEI to follow). An uploaded unparsed corpus will be automatically parsed by Alpino and made available in the search interface. (2) It also enables upload of metadata that are contained in the data, e.g. in accordance with the PaQu metadata format (3) Checking of XPath expressions and suggestions for selecting valid attributes and values have been added, as have the use of macros (a la PaQu) (4) filtering on the basis of metadata has been made possible (5) full analysis of the metadta in combination with nodes and their properties from the syntactic structures is available, allowing a user to select, group, sort, and filter data and metadata in combination, through a pivot table with draggable attributes and node properties. Sums , counts, heatmaps and other graphical visualisation enable rapid analysis of the data. GrETEL 4 is being developed by Utrecht University (UiL-OTS and Digital Humanities Lab) in the context of the AnnCor and CLARIAH-CORE projects. It based on GrETEL 3 developed by KU Leuven. GrETEL is a query engine in which linguists can use a natural language example as a starting point for searching a treebank with limited knowledge about tree representations and formal query languages. Instead of a formal search instruction, it takes a natural language example as input. This provides a convenient way for novice and non-technical users to use treebanks with a limited knowledge of the underlying syntax and formal query languages. By allowing linguists to search for constructions similar to the example they provide, it aims to bridge the gap between descriptive-theoretical and computational linguistics. The example-based query procedure consists of six steps. In the first step the user enters an example of the construction he/she is interested in. In the second step the example sentence is automatically parsed with the Alpino parser, resulting in a parse tree. In the third step the example is returned in the form of a matrix, in which the user specifies which aspects of this example are essential for the construction under investigation. Based on the information indicated in the matrix, a query tree is cut out of the initial parse tree and automatically converted to an XPath query. By clicking the advanced options button, the XPath query is made visible, and can be edited if desired. This query will be used for the actual treebank search. In the fourth step the user can select which treebank needs to be queried. The fifth step provides an overview of the search instruction, i.e. the input sentence, the selected treebank(s), the query tree and the (adapted) XPath query. In the sixth step the query is executed on the selected corpus. The matching constructions are presented to the user as a list of sentences, which can be downloaded. The user can also click on the sentences in order to visualize the results as syntax trees. In addition to the example-based search functionality, users can also query the treebanks using an XPath expression. This query is then processed in the same way as the automatically generated query in the example-based approach.

Project

AnnCor

CLARIAH-CORE

CLARIN National Project

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Tool task

corpus searching

querying

corpus processing

parsing

dependency parsing

grammatical relation assignment

analysis

Country

Netherlands

Tool Type

web application

Research Phase

Data analysis

Enriching Data

Tool status

alpha

Input format

text/xml

text/plain

Output format

text/xml

Input Language

Dutch

Version

4.0

Access Contact

Jan Odijk

Project Contact

Jan Odijk

Creator Contact

Jan Odijk

Martijn van der Klis

Sheean Spoel

Gerson Foks

Documentation

Source code

https://github.com/UUDigitalHumanitieslab/gretel

https://github.com/UUDigitalHumanitieslab/GrETEL-upload

Original source

Publications

Augustinus, L, Vandeghinste, V, Schuurman, I and Van Eynde, F. 2017. GrETEL: A Tool for Example-Based Treebank Mining. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 269–280. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.22. License: CC-BY 4.0

Jan Odijk, Martijn van der Klis and Sheean Spoel. 2018. Extensions to the GrETEL Treebank Query Application, in Proceedings of TLT16, 23-24 Jan 2018, Prague, Czech Republic

Resource

CMDI File Link

License

CC-BY-NC-SA

Inventory Scope

local

GrETEL 3.0

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

GrETEL Search Engine for Querying Syntactic Constructions in Treebanks

Description

GrETEL is a query engine in which linguists can use a natural language example as a starting point for searching a treebank with limited knowledge about tree representations and formal query languages. Instead of a formal search instruction, it takes a natural language example as input. This provides a convenient way for novice and non-technical users to use treebanks with a limited knowledge of the underlying syntax and formal query languages. By allowing linguists to search for constructions similar to the example they provide, it aims to bridge the gap between descriptive-theoretical and computational linguistics. The example-based query procedure consists of six steps. In the first step the user enters an example of the construction he/she is interested in. In the second step the example sentence is automatically parsed with the Alpino parser, resulting in a parse tree. In the third step the example is returned in the form of a matrix, in which the user specifies which aspects of this example are essential for the construction under investigation. Based on the information indicated in the matrix, a query tree is cut out of the initial parse tree and automatically converted to an XPath query. By clicking the advanced options button, the XPath query is made visible, and can be edited if desired. This query will be used for the actual treebank search. In the fourth step the user can select which treebank needs to be queried. The fifth step provides an overview of the search instruction, i.e. the input sentence, the selected treebank(s), the query tree and the (adapted) XPath query. In the sixth step the query is executed on the selected corpus. The matching constructions are presented to the user as a list of sentences, which can be downloaded. The user can also click on the sentences in order to visualize the results as syntax trees. In addition to the example-based search functionality, users can also query the treebanks using an XPath expression. This query is then processed in the same way as the automatically generated query in the example-based approach. GrETEL enables search in several Dutch treebanks: the 1-million word LASSY-Small (written Dutch) and CGN treebanks (spoken Dutch), and the 500-million word SoNaR-500 treebank (written Dutch).

Project

SCATE

CLARIN National Project

CLARIN-DLU

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Tool task

corpus searching

querying

Country

Belgium

Tool Type

web application

Research Phase

Tool status

published

Output format

text/html

Input Language

Dutch

Version

3.0

Access Contact

Project Contact

Vincent Vandeghinste

Creator Contact

Documentation

Source code

not specified

Original source

Publications

http://gretel.ccl.kuleuven.be/project/publications.php

Resource

CMDI File Link

License

CC-BY-NC-SA

Inventory Scope

local

GrETEL 2.0

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

GrETEL Search Engine for Querying Syntactic Constructions in Treebanks

Description

GrETEL is a query engine in which linguists can use a natural language example as a starting point for searching a treebank with limited knowledge about tree representations and formal query languages. Instead of a formal search instruction, it takes a natural language example as input. This provides a convenient way for novice and non-technical users to use treebanks with a limited knowledge of the underlying syntax and formal query languages. By allowing linguists to search for constructions similar to the example they provide, it aims to bridge the gap between descriptive-theoretical and computational linguistics. The example-based query procedure consists of six steps. In the first step the user enters an example of the construction he/she is interested in. In the second step the example sentence is automatically parsed with the Alpino parser, resulting in a parse tree. In the third step the example is returned in the form of a matrix, in which the user specifies which aspects of this example are essential for the construction under investigation. In the fourth step the user can select which treebank needs to be queried. The fifth step provides an overview of the search instruction, i.e. the subpart of the parse tree that contains the elements relevant for the construction under investigation. This query tree is automatically converted in an XPath query which can be used for the actual treebank search. In the advanced search mode, the XPath query is made visible, and can be edited if desired. In the sixth step the query is executed on the selected corpus. The matching constructions are presented to the user as a list of sentences, which can be downloaded. The user can also click on the sentences in order to visualize the results as syntax trees. In addition to the example-based search functionality, users can also query the treebanks using an XPath expression. This query is then processed in the same way as the automatically generated query in the example-based approach. GrETEL 2.0 enables search in two Dutch treebanks: the 1-million word LASSY-Small (written Dutch) and CGN treebanks (spoken Dutch).

Project

GrETEL 2.0

CLARIN National Project

CLARIN-DLU

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Tool task

corpus searching

querying

Country

Belgium

Tool Type

web application

Research Phase

Tool status

superseded

Output format

text/html

Input Language

Dutch

Version

2.0

Access Contact

Project Contact

/mailto:liesbeth.augustinus@kuleuven.be/

Creator Contact

Documentation

Source code

not specified

Original source

Publications

http://gretel.ccl.kuleuven.be/project/publications.php

Resource

CMDI File Link

License

CC-BY-NC-SA

Inventory Scope

local

GrETEL 1.0

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

GrETEL Search Engine for Querying Syntactic Constructions in Treebanks

Description

GrETEL is a query engine in which linguists can use a natural language example as a starting point for searching a treebank with limited knowledge about tree representations and formal query languages. Instead of a formal search instruction, it takes a natural language example as input. This provides a convenient way for novice and non-technical users to use treebanks with a limited knowledge of the underlying syntax and formal query languages. By allowing linguists to search for constructions similar to the example they provide, it aims to bridge the gap between descriptive-theoretical and computational linguistics. The example-based query procedure consists of several steps. In the first step the user enters an example of the construction he/she is interested in. In the second step the example is returned in the form of a matrix, in which the user specifies which aspects of this example are essential for the construction under investigation. The third step provides an overview of the search instruction, i.e. the subpart of the parse tree that contains the elements relevant for the construction under investigation. This query tree is automatically converted in an XPath query which can be used for the actual treebank search. This query can be edited if desired. In the fourth step the query is executed on the selected corpus. The matching constructions are presented to the user as a list of sentences, which can be downloaded. The user can also click on the sentences in order to visualize the results as syntax trees. GrETEL enables search in the LASSY-SMALL and the CGN (Spoken Dutch Corpus) Treebanks (1 million tokens each). GrETEL was created by CLARIN Dutch Language Union in Flanders in the context of the CLARIN-NL / CLARIN Flanders cooperation project.

Project

Nederbooms

CLARIN National Project

CLARIN-DLU

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Tool task

corpus searching

querying

Country

Belgium

Tool Type

web application

Research Phase

Tool status

superseded

Output format

text/html

Input Language

Dutch

Version

1.0

Access Contact

Project Contact

/mailto:liesbeth.augustinus@kuleuven.be/

Creator Contact

Documentation

Source code

not specified

Original source

Publications

Liesbeth Augustinus, Vincent Vandeghinste, and Frank Van Eynde (2012). "Example-Based Treebank Querying" In: Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC-2012). Istanbul, Turkey. pp. 3161-3167

http://gretel.ccl.kuleuven.be/project/publications.php

Resource

CMDI File Link

License

CC-BY-NC-SA

Inventory Scope

local

Nederlab

Erica Renckens — Mon, 10 Aug 2015 08:07:39 +0000

Nederlab, online laboratory for humanities research on Dutch text collections

Summary

A user-friendly and tool-enriched open access web interface that that aims at containing all digitized texts relevant for the Dutch national heritage and the history of Dutch language and culture (c. 800 - present).

Background

The Nederlab project aims to bring together all digitized texts relevant to Dutch national heritage, the history of Dutch language and culture (c. 800 - present) in one user-friendly and tool-enriched open access web interface, allowing scholars to simultaneously search and analyze data from texts spanning the full recorded history of the Netherlands, its language and culture. The project builds on various initiatives: for corpora Nederlab collaborates with the scientific libraries and institutions, for infrastructure with CLARIN (and CLARIAH), for tools with eHumanities programmes such as Catch, IMPACT and CLARIN (TICCL, frog).
Nederlab will offer a large number of search options with which researchers can find the occurrence of a particular term in a particular corpus or subcorpus. It'll also offer visualization of search results through line graphs, bar graphs, circle graphs, or scatter graphs. Furthermore, this online lab will offer a large set of tools, like tokenization tools, tools for spelling normalization, PoS-tagging tools, lemmatization tools, a computational historical lexicon and indices. Also, the use of (semi-) automatic syntactic parsing, tools for text mining, data mining and sentiment mining, Named Entity Recognition tools, coreference resolution tools, plagiarism detection tools, paraphrase detection tools and cartographical tools is offered
The first version of Nederlab was launched in early 2015, it’ll be expanded until the end of 2017. Nederlab is financed by NWO, KNAW, CLARIAH and CLARIN-NL.

Contacts

Project leader:  prof. dr. Hans Bennis, Meertens Institute
CLARIN center: Meertens Institute
Help contact: hennie.brugman@meertens.knaw.nl

Links

Web-sites: http://www.nederlab.nl/
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.nederlab.nl/onderzoeksportaal/?action=help
Tool/Service link: http://www.nederlab.nl/onderzoeksportaal/
Publications: http://www.nederlab.nl/wp/?page_id=12

Research domain

Cultural Sciences

History

Linguistics

Language

Dutch

Resource tags

data

corpus

text corpus

service

web-application

mono-lingual

Tool task

semantic registry & mapping

analysis

evaluation

annotation

browse

visualisation

text processing

POS tagging

multiword unit identification

lemmatisation

parsing

co-reference assignment

tokenization

CLARIN centre

Meertens/HuC

Country

Netherlands

AutoSearch

Jan Odijk — Fri, 06 Mar 2015 11:29:35 +0000

AutoSearch

Summary

AutoSearch allows users to upload corpora annotated at the token level for (extended) part of speech, lemma and word form in FoLiA or TEI format, after which the corpus can be searched for these properties with a Corpus of Contemporary Dutch-like interface

Background

AutoSearch allows users to define one or more corpora and upload data for the corpora, after which the corpora will be made automatically searchable in a private workspace. Users can upload text data annotated with lemma + part of speech tags in TEI or FoLiA format, either as a single XML file or as an archive (zip or tar.gz) containing several XML files. Corpus size is limited to begin with (25 MB limit per uploaded file; 500,000 token limit for an entire corpus), but these limits may be increased at a later point in time. The search application is powered by the INL BlackLab corpus search engine. The search interface is the same as the one used in for example the Corpus of Contemporary Dutch / Corpus Hedendaags Nederlands. For Dutch corpora without such annotations, one can first use TTNWW to enrich plain text with annotations for lemma and part of speech in FoLiA format.

Contacts

Project leader: Jan Theo Bakker  
CLARIN center: Institute for Dutch Lexicology (INL)
Help contact : helpdesk@clarin.nl

Links

Web-sites: https://portal.clarin.inl.nl/
User scenario's (screencasts, screenshots): n.a.
Manual: Manual
Tool/Service link: http://portal.clarin.inl.nl/autocorp/
Publications:

Research domain

Linguistics

Morpho-syntax

Lexicology

Syntax

Language

Language independent

Resource tags

service

web-application

multi-lingual

Tool task

browse

CLARIN centre

Dutch Language Institute

Country

Netherlands

OpenSONAR

Erica Renckens — Thu, 22 Jan 2015 11:15:48 +0000

OpenSONAR: a 500 MW reference corpus

Summary

OpenSoNaR is an online system that allows for analyzing and searching the large scale Dutch reference corpus SoNaR. Due to the size of the corpus (500 million words), accessing the information contained in the dataset has proven to be difficult for less technically inclined researchers. OpenSoNaR facilitates the use of the SoNaR corpus by providing a user-friendly online interface.

Background

SoNaR is a 500-million-word reference corpus of contemporary written Dutch for use in different types of linguistic (incl. lexicographic) and HLT research and the development of applications. The STEVIN funded SoNaR project (2008-2011) built on the results obtained in the D-Coi and Corea projects which were awarded funding in the first call of proposals within the STEVIN programme.
SONAR contains over 500 million words (i.e. word tokens) of full texts from a wide variety of text types including both texts from conventional media and texts from the new media. All texts except for texts from the social media (Twitter, Chat, SMS) have been tokenized, tagged for part of speech and lemmatized, while in the same set the Named Entities have been labelled. All annotations were produced automatically, no manual verification took place.
The SoNaR project was carried out by Katholieke Universiteit Leuven (CCL), Hogeschool Gent (Dept. Vertaalkunde, LT3), Radboud University Nijmegen (CLST), Tilburg University (TiCC/ILK), Twente University (HMI), and Utrecht University (UiL-OTS). It was coordinated by Radboud University.
Due to the size of the SoNaR corpus the number of hits shown in OpenSONAR is limited to 8 million hits. If the results of your query exceeds this limit only the first 8,000,000 hits will be shown.

OpenSONAR is an online application for exploration of and searching in the SoNaR corpus. In the Exploration (Dutch: verken) interface you can look into the corpus distributions, request statistics from sub-corpora, retrieve n-grams from sub-corpora and search for specific documents using the SoNaR document ID. In the Search (Dutch: zoek) interface you can use four different search strategies: simple (simpel), extended (uitgebreid), advanced (geavanceerd) or expert (expert).

In OpenSONAR click the green question mark in the left upper corner for a guided tour (in Dutch).

Contacts

Project leader:  Dr. Martin Reynaert (Tilburg University)
CLARIN center: INL
Help contact : reynaert@uvt.nl

Links

Web-sites: http://opensonar.inl.nl
User scenario's (screencasts, screenshots): n.a.
Manual: http://ticclops.uvt.nl/SoNaR_end-user_documentation_v.1.0.4.pdf http://zilla.taalmonsters.nl/opensonar/OpenSoNaR%20Handleiding.pdf [Dutch]
Tool/Service link: http://opensonar.inl.nl
Publications: Oostdijk, N., Reynaert, M., Hoste, V., Schuurman, I. (2013) The Construction of a 500 Million Word Reference Corpus of Contemporary Written Dutch in: Essential Speech and Language Technology for Dutch: Results by the STEVIN-programme (eds. P. Spyns, J. Odijk), Springer Verlag.

Research domain

Linguistics

Morpho-syntax

Lexicology

Morphology

Syntax

Language

Dutch

Resource tags

service

web-application

web-service

mono-lingual

Tool task