CLARIN-NL - browse

Corpus Studio Web

Jan Odijk — Thu, 11 Aug 2016 14:52:48 +0000

Corpus Studio Web

Summary

CorpusStudio is a web application that facilitates in-depth quantitative syntactic research for linguists.

Background

CorpusStudio is a web application that facilitates in-depth quantitative syntactic research for linguists. It does so by supporting researchers in writing queries that operate on syntactically parsed text corpora in a number of major xml formats. Queries that belong together are kept in xml documents that are called ‘Corpus Research Projects’ (CRPs). These documents contain the queries, the order in which they are to be executed, meta-information about the queries and the project as a whole, as well as a specification of the input used for the project. The use of CRPs helps improve the replicability of corpus research.

Access

Any CLARIN-NL user can access the CorpusStudio web application and make use of the 'standard' corpora. New users must provide a login name and password, after which they can make use of the application.

Adaptable

The CorpusStudio code is open-source. Users can take the code, adapt it and use it for their own purposes. Users can also take the code from GitHub as it is, but build their own server in order to run the application on their own text-corpora. User documentation and an API are available (see below). The current version of CorpusStudio supports xml text corpora in the FoLiA and Psdx formats. Extensions to other xml formats are possible.

Main features

Keep all important aspects of a research project in one file
Define one or more search queries in a hierarchy
Uses w3c developed Xquery and Xpath
Integrated CorpusStudio-specific Xquery functions
User-definable functions and variables
Create corpus result databases with user-definable features accompanying each hit
Divide the output into calculatable categories
Divide the results into meta-data-dependent groups
Parallel processing yields a speed-up of a factor 20-100 compared to the Windows version
Compatibility with the Windows programs "Cesax" and "CorpusStudio"

Limitations and future developments

Current limitations to the program include: working with result database, restricted login system, no document view, grouping is restricted to system-defined groups, no query or project wizard. Although the CLARIN-NL project has stopped in December 2015, every effort will be undertaken to make sure that a number of essential features are going to be added.

Contacts

Project leader: Erwin Komen  
CLARIN center:
Help contact: E.Komen@Let.ru.nl

Links

Web-sites:
User scenario's (screencasts, screenshots): n.a.
Manual:
- Komen, Erwin R. 2015. "Corpus Studio: the web application". User documentation. version 1.7. Meertens Instituut, Amsterdam. http://hdl.handle.net/21.11114/COLL-0000-000B-C289-F
- Komen, Erwin R. 2016. "An API for the CorpusStudio web application". version 1.3. Meertens Instituut, Amsterdam. http://hdl.handle.net/21.11114/COLL-0000-000B-C288-0
Tool/Service link: http://hdl.handle.net/21.11114/COLL-0000-000B-C287-1
Publications:
- Komen, Erwin R. 2011. Coreferenced corpora for information structure research. In Outposts of Historical Corpus Linguistics: From the Helsinki Corpus to a Proliferation of Resources. (Studies in Variation, Contacts and Change in English 10) Jukka Tyrkkö, Terttu Nevalainen, Matti Rissanen & Matti Kilpiö (eds). Helsinki, Finland: Research Unit for Variation, Contacts, and Change in English.
- Komen, Erwin R. 2013. Finding focus: a study of the historical development of focus in English. Utrecht: LOT.
- Komen, Erwin R. 2013. Corpus databases with feature pre-calculation. In Proceedings of the twelfth workshop on treebanks and linguistic theories (TLT12). Sandra Kübler, Petya Osenova & Martin Volk (eds), 85-96. Sofia, Bulgaria: The institute of information and communication technologies, Bulgarian academy of sciences.

Research domain

Linguistics

Syntax

browse

CLARIN centre

Meertens/HuC

Country

Netherlands

Nederlab

Erica Renckens — Mon, 10 Aug 2015 08:07:39 +0000

Nederlab, online laboratory for humanities research on Dutch text collections

Summary

A user-friendly and tool-enriched open access web interface that that aims at containing all digitized texts relevant for the Dutch national heritage and the history of Dutch language and culture (c. 800 - present).

Background

The Nederlab project aims to bring together all digitized texts relevant to Dutch national heritage, the history of Dutch language and culture (c. 800 - present) in one user-friendly and tool-enriched open access web interface, allowing scholars to simultaneously search and analyze data from texts spanning the full recorded history of the Netherlands, its language and culture. The project builds on various initiatives: for corpora Nederlab collaborates with the scientific libraries and institutions, for infrastructure with CLARIN (and CLARIAH), for tools with eHumanities programmes such as Catch, IMPACT and CLARIN (TICCL, frog).
Nederlab will offer a large number of search options with which researchers can find the occurrence of a particular term in a particular corpus or subcorpus. It'll also offer visualization of search results through line graphs, bar graphs, circle graphs, or scatter graphs. Furthermore, this online lab will offer a large set of tools, like tokenization tools, tools for spelling normalization, PoS-tagging tools, lemmatization tools, a computational historical lexicon and indices. Also, the use of (semi-) automatic syntactic parsing, tools for text mining, data mining and sentiment mining, Named Entity Recognition tools, coreference resolution tools, plagiarism detection tools, paraphrase detection tools and cartographical tools is offered
The first version of Nederlab was launched in early 2015, it’ll be expanded until the end of 2017. Nederlab is financed by NWO, KNAW, CLARIAH and CLARIN-NL.

Contacts

Project leader:  prof. dr. Hans Bennis, Meertens Institute
CLARIN center: Meertens Institute
Help contact: hennie.brugman@meertens.knaw.nl

Links

Web-sites: http://www.nederlab.nl/
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.nederlab.nl/onderzoeksportaal/?action=help
Tool/Service link: http://www.nederlab.nl/onderzoeksportaal/
Publications: http://www.nederlab.nl/wp/?page_id=12

Research domain

Cultural Sciences

History

Linguistics

Language

Dutch

Resource tags

data

corpus

text corpus

service

web-application

mono-lingual

Tool task

semantic registry & mapping

analysis

evaluation

annotation

corpus exploration

browse

visualisation

text processing

POS tagging

multiword unit identification

lemmatisation

parsing

co-reference assignment

tokenization

CLARIN centre

Meertens/HuC

Country

Netherlands

AutoSearch

Jan Odijk — Fri, 06 Mar 2015 11:29:35 +0000

AutoSearch

Summary

AutoSearch allows users to upload corpora annotated at the token level for (extended) part of speech, lemma and word form in FoLiA or TEI format, after which the corpus can be searched for these properties with a Corpus of Contemporary Dutch-like interface

Background

AutoSearch allows users to define one or more corpora and upload data for the corpora, after which the corpora will be made automatically searchable in a private workspace. Users can upload text data annotated with lemma + part of speech tags in TEI or FoLiA format, either as a single XML file or as an archive (zip or tar.gz) containing several XML files. Corpus size is limited to begin with (25 MB limit per uploaded file; 500,000 token limit for an entire corpus), but these limits may be increased at a later point in time. The search application is powered by the INL BlackLab corpus search engine. The search interface is the same as the one used in for example the Corpus of Contemporary Dutch / Corpus Hedendaags Nederlands. For Dutch corpora without such annotations, one can first use TTNWW to enrich plain text with annotations for lemma and part of speech in FoLiA format.

Contacts

Project leader: Jan Theo Bakker  
CLARIN center: Institute for Dutch Lexicology (INL)
Help contact : helpdesk@clarin.nl

Links

Web-sites: https://portal.clarin.inl.nl/
User scenario's (screencasts, screenshots): n.a.
Manual: Manual
Tool/Service link: http://portal.clarin.inl.nl/autocorp/
Publications:

Research domain

Linguistics

Morpho-syntax

Lexicology

Syntax

Language

Language independent

Resource tags

service

web-application

multi-lingual

Tool task

corpus exploration

browse

CLARIN centre

Dutch Language Institute

Country

Netherlands

OpenSONAR

Erica Renckens — Thu, 22 Jan 2015 11:15:48 +0000

OpenSONAR: a 500 MW reference corpus

Summary

OpenSoNaR is an online system that allows for analyzing and searching the large scale Dutch reference corpus SoNaR. Due to the size of the corpus (500 million words), accessing the information contained in the dataset has proven to be difficult for less technically inclined researchers. OpenSoNaR facilitates the use of the SoNaR corpus by providing a user-friendly online interface.

Background

SoNaR is a 500-million-word reference corpus of contemporary written Dutch for use in different types of linguistic (incl. lexicographic) and HLT research and the development of applications. The STEVIN funded SoNaR project (2008-2011) built on the results obtained in the D-Coi and Corea projects which were awarded funding in the first call of proposals within the STEVIN programme.
SONAR contains over 500 million words (i.e. word tokens) of full texts from a wide variety of text types including both texts from conventional media and texts from the new media. All texts except for texts from the social media (Twitter, Chat, SMS) have been tokenized, tagged for part of speech and lemmatized, while in the same set the Named Entities have been labelled. All annotations were produced automatically, no manual verification took place.
The SoNaR project was carried out by Katholieke Universiteit Leuven (CCL), Hogeschool Gent (Dept. Vertaalkunde, LT3), Radboud University Nijmegen (CLST), Tilburg University (TiCC/ILK), Twente University (HMI), and Utrecht University (UiL-OTS). It was coordinated by Radboud University.
Due to the size of the SoNaR corpus the number of hits shown in OpenSONAR is limited to 8 million hits. If the results of your query exceeds this limit only the first 8,000,000 hits will be shown.

OpenSONAR is an online application for exploration of and searching in the SoNaR corpus. In the Exploration (Dutch: verken) interface you can look into the corpus distributions, request statistics from sub-corpora, retrieve n-grams from sub-corpora and search for specific documents using the SoNaR document ID. In the Search (Dutch: zoek) interface you can use four different search strategies: simple (simpel), extended (uitgebreid), advanced (geavanceerd) or expert (expert).

In OpenSONAR click the green question mark in the left upper corner for a guided tour (in Dutch).

Contacts

Project leader:  Dr. Martin Reynaert (Tilburg University)
CLARIN center: INL
Help contact : reynaert@uvt.nl

Links

Web-sites: http://opensonar.inl.nl
User scenario's (screencasts, screenshots): n.a.
Manual: http://ticclops.uvt.nl/SoNaR_end-user_documentation_v.1.0.4.pdf http://zilla.taalmonsters.nl/opensonar/OpenSoNaR%20Handleiding.pdf [Dutch]
Tool/Service link: http://opensonar.inl.nl
Publications: Oostdijk, N., Reynaert, M., Hoste, V., Schuurman, I. (2013) The Construction of a 500 Million Word Reference Corpus of Contemporary Written Dutch in: Essential Speech and Language Technology for Dutch: Results by the STEVIN-programme (eds. P. Spyns, J. Odijk), Springer Verlag.

Research domain

Linguistics

Morpho-syntax

Lexicology

Morphology

Syntax

Language

Dutch

Resource tags

service

web-application

web-service

mono-lingual

Tool task

corpus exploration

browse

CLARIN centre

Dutch Language Institute

Country

Netherlands

COBWWWEB

Erica Renckens — Mon, 19 Jan 2015 20:51:23 +0000

COBWWWEB: Connections Between Women and Writings Within European Borders

Summary

A scholar application for research on the WomenWriters Database and connected databases in women’s literature. The WomenWriters Database contains information on the production of women authors from the middle ages up to c. 1900, and on the reception of their works by contemporaries as well as early literary historians (both men and women). Are concerned: women active as authors in European countries and their (former) colonies. Thus the database allows the study of these women's writing in their international context, and the place to be attributed to them in transnational historiography.

Background

The WomenWriters database includes biographical data on more than 4.000 authors and over 22.000 references to reception data found in sources like the periodical press, early literary history and private correspondences. A significant part of the dataset was collected in the NWO digitizing project The International Reception of Women’s Writing (2004-2007), focusing on authors received in the Netherlands. A second NWO internationalising project called New approaches to European Women’s Writing (2007-2010) and the subsequent COST Action Women Writers in History (2009‐2013) brought together a large international community of scholars and used the Dutch data collection as an example for other colleagues.
COBWWWEB enables a connection between the various national projects on this subject into a growing international data network. A virtual research environment on top of this network makes all material from participating data providers accessible for European and interdisciplinary research.

Contacts

Project leader:  Dr. Suzan van Dijk (Huygens ING)
CLARIN center: Huygens ING
Help contact : suzan.van.dijk@huygens.knaw.nl (coordinator)

Links

Web-sites: http://www.womenwriters.nl/index.php/COBWWWEB
User scenario's (screencasts, screenshots): n.a.
Manual: n.a.
Tool/Service link: http://resources.huygens.knaw.nl/womenwriters
Publications:
- Suzan van Dijk, ”Vele schrijfsters in een klein land. Het belang van internationale samenwerking”, in Historica 2014 37/2, p. 17-23;
- Suzan van Dijk and Walter Ravenek, “Over vrouwen en het literaire veld”, in E-data & Research 2014 8/3, p. 6.

Research domain

Cultural Sciences

History

Art History

Literary Studies

Language

French

Dutch

English

German

Multiple languages

Resource tags

data

corpus

text corpus

service

web-application

Tool task

browse

CLARIN centre

Huygens ING

Country

Netherlands

PaQu

Erica Renckens — Thu, 15 Jan 2015 13:00:04 +0000

PaQu - Parse and Query

Summary

The PaQu web service makes it possible to search in syntactically annotated corpora in Dutch. You can parse your own Dutch text corpus or use one of two corpora provided by the developers.

Background

Please note: This is a preliminary version of this application. Use Lassy (http://dev.clarin.nl/node/1966) for searching the Lassy Treebanks.

PaQu uses the Alpino parser to make treebanks of your own text corpus, and to search in these treebanks using an interface based on the LASSY Word Relations Search interface (http://dev.clarin.nl/node/1966). Two treebanks are already available in the application: Lassy Klein (1M words, manually checked syntactic analysis) and Lassy Groot (700M words, syntactic analysis automatically assigned by Alpino).
PaQu offers two ways to search through the syntactically annotated texts. The first option is to use the search bar to look for word pairs, optionally complemented by their syntactic relationship. The second search option is to use the query language XPath.

Contacts

Project leader: prof.dr. Gertjan van Noord  
Developer: Drs. P. Kleiweg (Groningen University)
CLARIN center: none
Help contact : p.c.j.kleiweg@rug.nl

Links

Web-sites: n.a.
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.let.rug.nl/alfa/paqu/info.html (http://zardoz.service.rug.nl:8067/info.html )
Tool/Service link: http://www.let.rug.nl/alfa/paqu (http://zardoz.service.rug.nl:8067/)
Publications: n.a.

Research domain

Computational Linguistics

Linguistics

Syntax

Language

Dutch

Resource tags

data

corpus

text corpus

service

text processing

mono-lingual

Tool task

annotation

corpus exploration

browse

text processing

grammatical relation assignment

parsing

Country

Netherlands

SHEBANQ

Erica Renckens — Mon, 12 Jan 2015 15:16:13 +0000

SHEBANQ: System for HEBrew Text: ANnotations for Queries and Markup

Summary

A web application that enables researchers to perform linguistic queries on the WIVU Hebrew Text Database and preserve significant results as annotations to this resource. This database contains the Hebrew text of the Old Testament enriched with many linguistic features at the morpheme level up to the discourse level.

Background

The WIVU (Werkgroep Informatica Vrije Universiteit) Hebrew Text Database contains the Biblia Hebraica Stuttgartensia (BHS) version of the text of the Hebrew Bible. Portions of other Semitic languages are included as well: the Aramaic sections of the Old Testament, two Syriac versions, and annotated portions of the Syriac and Aramaic translations. All these texts have been enriched with features that primarily result from linguistic analysis. The database can be queried by means of a language that is optimized to deal with data that is modeled as objects + features. SHEBANQ builds a bridge between the linguistically annotated Hebrew Text corpus and biblical scholars by (1) making this text, including its annotations, available to scholars; (2) demonstrating how queries can function to address research questions; the query saver and the metadata added to them will be a growing repository of valuable best practices of what queries are used in addressing research questions and how they contribute to answering these questions; (3) giving textual scholarship a more empirical basis, by creating the opportunity that claims made in scholarly articles (e.g.: “this syntactic pattern is not attested elsewhere in the Hebrew Bible”) can be accompanied by the unique identifiers that refer to the saved queries that have led to the claim. The WIVU database is a resource under long-term development. New features are being added, new corrections are being made over time.

Contacts

Project leader:  Prof. Dr. W.T. (Wido) van Peursen (VU University)
CLARIN center: Data Archiving and Networked Services (DANS)
Help contact : dirk.roorda@dans.knaw.nl

Links

Web-sites: http://shebanq.ancient-data.org/
User scenario's (screencasts, screenshots): n.a.
Manual: http://shebanq.ancient-data.org/help
Tool/Service link: http://shebanq.ancient-data.org/
Data link: https://easy.dans.knaw.nl/ui/datasets/id/easy-dataset:58245 (Persistent Identifier: urn:nbn:nl:ui:13-048i-71)
Publications:
- Roorda, D. (2015). The Hebrew Bible as Data: Laboratory - Sharing - Experiences http://arxiv.org/abs/1501.01866
- Roorda, D. (2014). LAF-Fabric: a data analysis tool for Linguistic Annotation Framework with an application to the Hebrew Bible, Computational Linguistics in the Netherlands Journal, Volume 4, December 2014, pp. 105-109 http://www.clinjournal.org/sites/default/files/08-Roorda-etal-CLIN2014.pdf and http://arxiv.org/abs/1410.0286

Research domain

Religion Studies

Computational Linguistics

Linguistics

Syntax

historical linguistics

Language

Aramaic

Hebrew

English

Resource tags

data

corpus

text corpus

service

web-application

mono-lingual

Tool task

analysis

annotation

corpus exploration

browse

visualisation

CLARIN centre

DANS

Country

Netherlands

AVResearcherXL

Erica Renckens — Tue, 18 Nov 2014 10:50:03 +0000

AVReseracherXL: Exploring audiovisual metadata in historical context

Summary

AVResearcherXL is a tool for exploring radio and television programme descriptions, television subtitles and general newspaper articles. The interface searches across the catalogue "iMMix" of the Netherlands Institute for Sound and Vision and a selection of newspapers of KB Royal Archive of the Netherlands.

Background

By the end of 2014, the data used by AVResearcherXL are: iMMix

932,035 broadcasts indexed
18,124 broadcasts with subtitles
1 January 1900 is the date of the first broadcast in the index
26 October 2013 is the date of the last broadcast in the index

KB newspapers

25,811,413 articles indexed
16,294,029 articles are of type "artikel"
8,483,542 articles are of type "advertentie"
630,929 articles are of type "illustratie met onderschrift"
402,913 articles are of type "familiebericht"
1 January 1900 is the date of the first article in the index
30 November 1994 is the date of the last article in the index

AVResearcherXL is financially supported by CLARIN-NL within the QuaMeRDES-project and by CLARIAH-SEED within the Research Instruments for Media Studies-project. AVResearcherXL is an extended version of MeRDES, the tool developed in 2012 by the NWO-CATCH project BRIDGE. MeRDES was further developed into AVResearcher by the Netherlands Institute for Sound and Vision in 2013. AVResearcherXL is a collaborative project of Centre for Television in Transition (Utrecht University), Intelligent Systems Lab Amsterdam (University of Amsterdam) and the Netherlands Institute for Sound and Vision. The partners worked together with Dispectu for the development of the interface and back-end, and with Frontwise for the styling of the interface.

Contacts

Project leader: Dr. Jasmijn van Gorp (Utrecht University)  
CLARIN center: The Netherlands Institute for Sound and Vision
Help contact : j.vangorp@uu.nl or ebaaren@beeldengeluid.nl

Links

Web-sites: http://avresearcher.clariah.beeldengeluid.nl/
User scenario's (screencasts, screenshots): http://dev.clarin.nl/sites/default/files/QuaMeRDES_M2_demonstrationscena...
Manual: http://avresearcher.clariah.beeldengeluid.nl/#help
Tool/Service link: http://avresearcher.clariah.beeldengeluid.nl/ or github
Publications:
- Bron, M., Gorp, J. van, Nack, F., Rijke, M. de, Vishneuski, Andrei & Leeuw, J.S. de (2012). A Subjunctive Exploratory Search Interface to Support Media Studies Researchers. SIGIR '12: 35th international ACM SIGIR conference on Research and development in information retrieval Portland, Oregon: ACM.
- Huurnink, B., Bronner, A., Bron, M., Gorp, J. van, Goede, B. de & Wees, J. van (2013). AVResearcher: Exploring Audiovisual Metadata. DIR 2013: Dutch-Belgian Information Retrieval Conference Delft: DIR.

Research domain

Communication & Media Studies

Cultural Sciences

History

Political Studies

Language

Dutch

Resource tags

service

web-application

mono-lingual

Tool task

analysis

corpus exploration

browse

visualisation

CLARIN centre

NIBG

Country

Netherlands

RemBench

Jan Odijk — Mon, 06 Oct 2014 11:45:07 +0000

RemBench - a Digital Workbench for Rembrandt Research

Summary

RemBench enables one to search and browse for works of art, artists, primary sources and library sources related to Rembrandt, using faceted search by location, author/artist name, author/artist type, and date range, and/or by both exact and fuzzy keyword search. It offers both a web application and a RESTful web service.

Background

RemBench combines the content of four different databases behind one search interface:

RKDartists and RKDimages, two databases maintained by the Netherlands Institute for Art History (RKD)
RemDoc, a collection of original documents related to Rembrandt van Rijn from the period between 1475 to circa 1750
RUQuest, a library system that provides access to full text articles, as well as the complete collection of (e-)books and journals from the Radboud University Library Catalogue

RemBench does not influence the content of these databases. For questions or comments about the information in the RKD databases, RemDoc or RUQuest, we refer to their own websites.

Contacts

Project leader:  Suzan Verberne
CLARIN center: Huygens ING
Help contact : s.verberne@let.ru.nl

Links

Web-sites: n.a.
User scenario's (screencasts, screenshots): screencast on http://rembench.huygens.knaw.nl/about
Manual: https://dev.clarin.nl/sites/default/files/2014-09-12_D12_RemBench_docume...
Tool/Service link: http://rembench.huygens.knaw.nl/
Publications: n.a.

Research domain

History

Art History

Language

Dutch

English

Resource tags

service

web-application

web-service

Tool task

browse

CLARIN centre

Huygens ING

Country

Netherlands

VLO

root — Sun, 11 May 2014 12:08:16 +0000

VLO: The Virtual Language Observatory

Summary

The VLO is a faceted browser that shows the metadata records harvested from within the CLARIN joint metadata domain. Next to that it also shows part of the Language Resource metadata that can be harvested from the OLAC domain.

Background

The Virtual Language Observatory (VLO) is meant to be the open market place where users can find metadata descriptions of all language resources and tools/services which we can harvest from any useful and trusted source. Currently VLO contains more than 230.000 resources and more than 400 tools already. Different user interfaces are maintained to allow users to find and select resources such as a GoogleEarth overlay for geographic browsing, a facetted browser for easy search and browsing along major criteria and a normal cata- logue. The VLO machinery is ready to harvest various types of metadata that is offered via the OAI-PMH pro- tocol. It currently is harvesting data from OLAC, DFKI Tool registry, DOBES, DELAMAN partners, MPI registry, ELRA catalogue and the CLARIN Language Resource and Technology inventory which was meant as a simple registry for resources and tools from CLARIN members. VLO is based on the principle that metadata needs to be open.

Contacts

Project leader/developer: Dieter van Uytvanck, Twan Goosen
CLARIN center: MPI for Psycholinguistics
Help contact : vlw@clarin.eu

Links

Web-sites: http://www.clarin.eu
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.clarin.eu/faq-page/275
Tool/Service link: http://catalog.clarin.eu/vlo
Publications: Van Uytvanck, D., Stehouwer, H., & Lampen, L. (2012). Semantic metadata mapping in practice: The Virtual Language Observatory. In N. Calzolari (Ed.), Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC 2012), Istanbul, May 23rd-25th, 2012 (pp. 1029-1034). European Language Resources Association (ELRA).

Language

Language independent

Resource tags

service

web-application

Tool task

browse

CLARIN centre

Hosted by CLARIN ERIC

Country

Netherlands