CLARIN-NL - service

Stylene

Jan Odijk — Fri, 26 Aug 2016 13:30:52 +0000

Stylene

Summary

Stylene is a robust, modular system for stylometry and readability research on the basis of existing techniques for automatic text analysis and machine learning, and the development of a web service that allows researchers in the humanities and social sciences to analyze texts with this system. In this way, the project will make available to researchers recent advances in research on the computational modeling of style and readability.

Background

Stylene consists of an educational demonstration interface and tools for stylometry (authorship attribution and profiling) and readability research for Dutch. The Stylene system consists of a popularization interface for learning to understand stylometric analysis, and web-based interfaces to software for readability and stylometry research aimed at researchers from the humanities and social sciences who don’t want to develop or install such software themselves. Stylene has been created in the context of CLARIN Flanders.

Contacts

Project leader: Prof. dr. Walter Daelemans, CLIPS, Antwerp University  
CLARIN center: n.a.
Help contact : walter.daelemans@uantwerpen.be

Links

Web-sites: http://www.stylene.be/
User scenario's (screencasts, screenshots): n.a.
Manual: [ref to end-report]
Tool/Service link: writing style analysis demo: http://www.clips.ua.ac.be/cgi-bin/stylenedemo.html
Publications:

Research domain

Linguistics

Readability Studies

Discourse

Stylistics

Language

Dutch

Resource tags

service

web-application

web-service

mono-lingual

Tool task

analysis

Authorship Attribution

stylistic analysis

Profiling

Readability Analysis

text processing

Country

Netherlands

Corpus Studio Web

Jan Odijk — Thu, 11 Aug 2016 14:52:48 +0000

Corpus Studio Web

Summary

CorpusStudio is a web application that facilitates in-depth quantitative syntactic research for linguists.

Background

CorpusStudio is a web application that facilitates in-depth quantitative syntactic research for linguists. It does so by supporting researchers in writing queries that operate on syntactically parsed text corpora in a number of major xml formats. Queries that belong together are kept in xml documents that are called ‘Corpus Research Projects’ (CRPs). These documents contain the queries, the order in which they are to be executed, meta-information about the queries and the project as a whole, as well as a specification of the input used for the project. The use of CRPs helps improve the replicability of corpus research.

Access

Any CLARIN-NL user can access the CorpusStudio web application and make use of the 'standard' corpora. New users must provide a login name and password, after which they can make use of the application.

Adaptable

The CorpusStudio code is open-source. Users can take the code, adapt it and use it for their own purposes. Users can also take the code from GitHub as it is, but build their own server in order to run the application on their own text-corpora. User documentation and an API are available (see below). The current version of CorpusStudio supports xml text corpora in the FoLiA and Psdx formats. Extensions to other xml formats are possible.

Main features

Keep all important aspects of a research project in one file
Define one or more search queries in a hierarchy
Uses w3c developed Xquery and Xpath
Integrated CorpusStudio-specific Xquery functions
User-definable functions and variables
Create corpus result databases with user-definable features accompanying each hit
Divide the output into calculatable categories
Divide the results into meta-data-dependent groups
Parallel processing yields a speed-up of a factor 20-100 compared to the Windows version
Compatibility with the Windows programs "Cesax" and "CorpusStudio"

Limitations and future developments

Current limitations to the program include: working with result database, restricted login system, no document view, grouping is restricted to system-defined groups, no query or project wizard. Although the CLARIN-NL project has stopped in December 2015, every effort will be undertaken to make sure that a number of essential features are going to be added.

Contacts

Project leader: Erwin Komen  
CLARIN center:
Help contact: E.Komen@Let.ru.nl

Links

Web-sites:
User scenario's (screencasts, screenshots): n.a.
Manual:
- Komen, Erwin R. 2015. "Corpus Studio: the web application". User documentation. version 1.7. Meertens Instituut, Amsterdam. http://hdl.handle.net/21.11114/COLL-0000-000B-C289-F
- Komen, Erwin R. 2016. "An API for the CorpusStudio web application". version 1.3. Meertens Instituut, Amsterdam. http://hdl.handle.net/21.11114/COLL-0000-000B-C288-0
Tool/Service link: http://hdl.handle.net/21.11114/COLL-0000-000B-C287-1
Publications:
- Komen, Erwin R. 2011. Coreferenced corpora for information structure research. In Outposts of Historical Corpus Linguistics: From the Helsinki Corpus to a Proliferation of Resources. (Studies in Variation, Contacts and Change in English 10) Jukka Tyrkkö, Terttu Nevalainen, Matti Rissanen & Matti Kilpiö (eds). Helsinki, Finland: Research Unit for Variation, Contacts, and Change in English.
- Komen, Erwin R. 2013. Finding focus: a study of the historical development of focus in English. Utrecht: LOT.
- Komen, Erwin R. 2013. Corpus databases with feature pre-calculation. In Proceedings of the twelfth workshop on treebanks and linguistic theories (TLT12). Sandra Kübler, Petya Osenova & Martin Volk (eds), 85-96. Sofia, Bulgaria: The institute of information and communication technologies, Bulgarian academy of sciences.

Research domain

Linguistics

Syntax

browse

CLARIN centre

Meertens/HuC

Country

Netherlands

Nederlab

Erica Renckens — Mon, 10 Aug 2015 08:40:19 +0000

Nederlab, online laboratory for humanities research on Dutch text collections

Summary

A user-friendly and tool-enriched open access web interface that aims at containing all digitized texts relevant for the Dutch national heritage and the history of Dutch language and culture (c. 800 - present).

Background

The Nederlab project aims to bring together all digitized texts relevant to Dutch national heritage, the history of Dutch language and culture (c. 800 -present) in one user-friendly and tool-enriched open access web interface, allowing scholars to simultaneously search and analyze data from texts spanning the full recorded history of the Netherlands, its language and culture. The project builds on various initiatives: for corpora Nederlab collaborates with the scientific libraries and institutions, for infrastructure with CLARIN (and CLARIAH), for tools with eHumanities programmes such as Catch, IMPACT and CLARIN (TICCL, frog).

Nederlab offers a large number of search options with which researchers can find the occurrence of a particular term in a particular corpus or subcorpus. It also offers visualization of search results through line graphs, bar graphs, circle graphs, or scatter graphs. Furthermore, this online lab will offer a large set of tools, like tokenization tools, tools for spelling normalization, PoS-tagging tools , lemmatization tools, a computational historical lexicon and indices. Also, the use of (semi-) automatic syntactic parsing, tools for text mining, data mining and sentiment mining, Named Entity Recognition tools, coreference resolution tools, plagiarism detection tools, paraphrase detection tools and cartographical tools is offered

The first version of Nederlab was launched in early 2015, it’ll be expanded until the end of 2017. Nederlab is financed by NWO, KNAW, CLARIAH and CLARIN-NL.

Contacts

Project leader: prof. dr. Hans Bennis, Meertens Institute  
CLARIN center: Max Planck Institute
Help contact: hennie.brugman@meertens.knaw.nl

Links

Web-sites: http://www.nederlab.nl/
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.nederlab.nl/onderzoeksportaal/?action=help
Tool/Service link: http://www.nederlab.nl/onderzoeksportaal/
Publications: http://www.nederlab.nl/wp/?page_id=12

Country

Netherlands

CLARIN centre

Meertens/HuC

Language

Dutch

Research domain

Cultural Sciences

History

Linguistics

Resource tags

data

corpus

text corpus

service

mono-lingual

Annotations

Linguistic Annotation

Lexical

Discourse

Orthographic

Morphological

Morphosyntactic

Part-of-speech

Syntactic

Semantic

Format

Textual data

XML

Folia

TEI

Nederlab

Erica Renckens — Mon, 10 Aug 2015 08:07:39 +0000

Nederlab, online laboratory for humanities research on Dutch text collections

Summary

A user-friendly and tool-enriched open access web interface that that aims at containing all digitized texts relevant for the Dutch national heritage and the history of Dutch language and culture (c. 800 - present).

Background

The Nederlab project aims to bring together all digitized texts relevant to Dutch national heritage, the history of Dutch language and culture (c. 800 - present) in one user-friendly and tool-enriched open access web interface, allowing scholars to simultaneously search and analyze data from texts spanning the full recorded history of the Netherlands, its language and culture. The project builds on various initiatives: for corpora Nederlab collaborates with the scientific libraries and institutions, for infrastructure with CLARIN (and CLARIAH), for tools with eHumanities programmes such as Catch, IMPACT and CLARIN (TICCL, frog).
Nederlab will offer a large number of search options with which researchers can find the occurrence of a particular term in a particular corpus or subcorpus. It'll also offer visualization of search results through line graphs, bar graphs, circle graphs, or scatter graphs. Furthermore, this online lab will offer a large set of tools, like tokenization tools, tools for spelling normalization, PoS-tagging tools, lemmatization tools, a computational historical lexicon and indices. Also, the use of (semi-) automatic syntactic parsing, tools for text mining, data mining and sentiment mining, Named Entity Recognition tools, coreference resolution tools, plagiarism detection tools, paraphrase detection tools and cartographical tools is offered
The first version of Nederlab was launched in early 2015, it’ll be expanded until the end of 2017. Nederlab is financed by NWO, KNAW, CLARIAH and CLARIN-NL.

Contacts

Project leader:  prof. dr. Hans Bennis, Meertens Institute
CLARIN center: Meertens Institute
Help contact: hennie.brugman@meertens.knaw.nl

Links

Web-sites: http://www.nederlab.nl/
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.nederlab.nl/onderzoeksportaal/?action=help
Tool/Service link: http://www.nederlab.nl/onderzoeksportaal/
Publications: http://www.nederlab.nl/wp/?page_id=12

Research domain

Cultural Sciences

History

Linguistics

Language

Dutch

Resource tags

data

corpus

text corpus

service

web-application

mono-lingual

Tool task

semantic registry & mapping

analysis

evaluation

annotation

corpus exploration

browse

visualisation

text processing

POS tagging

multiword unit identification

lemmatisation

parsing

co-reference assignment

tokenization

CLARIN centre

Meertens/HuC

Country

Netherlands

CMD2RDF data

root — Thu, 11 Jun 2015 10:13:08 +0000

CMDI2RDF - CMDI to RDF conversion

Summary

CMD2RDF offers all the CMDI data from the CLARIN domain as a SPARQL endpoint
There is growing amount of on-line information available in RDF format as Linked Open Data (LOD) and a strong community very actively promotes its use. The publication of information as LOD is also considered an important signal that the publisher is actively searching for information sharing with a world full of new potential users. Added advantages of LOD, when well used, are the explicit semantics and high interoperability.

Background

The CMD2RDFservice was created to allow connection with the growing LOD world, and facilitate experiments within CLARIN merging CMDI with other, RDF based, information sources.
One of the promises of LOD is the ease to link data sets together and answer queries based on this ‘cloud’ of LOD datasets. Thus in the enrichment and use cases part of the project we looked at other datasets to link to the CLARIN joint metadata domain. We used the WALS N3 RDF dump for one of the use cases. Although it is in the end relatively easy to go from a specific typological feature to the CMD records via a shared URI, it still showcased a weakness of the Linked Data approach. One has to carefully inspect the property paths involved. And in this case the path was broken as there was no clear way to go from the WALS feature data to the WALS language info except for extracting the WALS language code from the feature URI pattern and insert it the language URI pattern. This showcases that although the big LOD cloud shows potential for knowledge discovery by crossing dataset boundaries, design decisions in the individual datasets can still hamper algorithms and manual inspection is needed.
The CMD2RDF service was developed at the TLA/MPI for Psycholinguistics and DANS and later moved to Meertens Institute where the expertise is available. The CMDI2RDF service will professionalised and extended in the Dutch CLARIAH project.

Contacts

Project leader: Menzo Windhouwer  
CLARIN center: Meertens Institute
Help contact : Menzo Winhouwer menzo.windhouwer@meertens.knaw.nl

Links

Web-sites: https://catalog.clarin.eu/ds/cmd2rdf/ https://trac.clarin.eu/wiki/CMD2RDF/sysarch
User scenario's (screencasts, screenshots): n.a.
Manual: https://catalog.clarin.eu/ds/cmd2rdf/api
Tool/Service link: https://catalog.clarin.eu/ds/cmd2rdf/ Note: service in transition
Publications: M. Durco, M. Windhouwer. From CLARIN Component Metadata to Linked Open Data. In Proceedings of the third Workshop on Linked Data in Linguistics: Multilingual Knowledge Resources and Natural Language Processing (LDL 2014). At LREC 2014, Reykjavik, Iceland, May 27, 2014.

Country

Netherlands

CLARIN centre

Meertens/HuC

Language

Language independent

Resource tags

service

web-application

Format

Textual data

XML

RDF

CMD2RDF

root — Wed, 10 Jun 2015 09:00:56 +0000

CMDI2RDF - CMDI to RDF conversion

Summary

There is growing amount of on-line information available in RDF format as Linked Open Data (LOD) and a strong community very actively promotes its use. The publication of information as LOD is also considered an important signal that the publisher is actively searching for information sharing with a world full of new potential users. Added advantages of LOD, when well used, are the explicit semantics and high interoperability. But the problematic modelling by non-expert users offsets these advantages, which is a reason why modelling systems as CMDI are used. The CMDI2RDF project aims to bring the LOD advantages to the CMDI world and make the huge store of CMDI information available to new groups of users and at the same time offer CLARIN a powerful tool to experiment with new metadata discovery possibilities.

Background

The CMD2RDFservice was created to allow connection with the growing LOD world, and facilitate experiments within CLARIN merging CMDI with other, RDF based, information sources.
One of the promises of LOD is the ease to link data sets together and answer queries based on this ‘cloud’ of LOD datasets. Thus in the enrichment and use cases part of the project we looked at other datasets to link to the CLARIN joint metadata domain. We used the WALS N3 RDF dump for one of the use cases. Although it is in the end relatively easy to go from a specific typological feature to the CMD records via a shared URI, it still showcased a weakness of the Linked Data approach. One has to carefully inspect the property paths involved. And in this case the path was broken as there was no clear way to go from the WALS feature data to the WALS language info except for extracting the WALS language code from the feature URI pattern and insert it the language URI pattern. This showcases that although the big LOD cloud shows potential for knowledge discovery by crossing dataset boundaries, design decisions in the individual datasets can still hamper algorithms and manual inspection is needed.
The CMD2RDF service was developed at the TLA/MPI for Psycholinguistics and DANS and later moved to Meertens Institute where the expertise is available. The CMDI2RDF service has been further professionalised and extended by the Dutch CLARIAH project.

Contacts

Project leader: Menzo Windhouwer
CLARIN center: Meertens Institute
Help contact : Menzo Winhouwer menzo.windhouwer@meertens.knaw.nl

Links

Web-sites: http://cmdi2rdf.meertens.knaw.nl/cmd2rdf/ https://trac.clarin.eu/wiki/CMD2RDF/sysarch
User scenario's (screencasts, screenshots): n.a.
Manual: https://catalog.clarin.eu/ds/cmd2rdf/api
Tool/Service link: http://cmdi2rdf.meertens.knaw.nl/cmd2rdf/
Publications: M. Durco, M. Windhouwer. From CLARIN Component Metadata to Linked Open Data. In Proceedings of the third Workshop on Linked Data in Linguistics: Multilingual Knowledge Resources and Natural Language Processing (LDL 2014). At LREC 2014, Reykjavik, Iceland, May 27, 2014.

Resource tags

service

web-application

Tool task

semantic registry & mapping

CLARIN centre

Meertens/HuC

Country

Netherlands

OpenConvert

Jan Odijk — Tue, 21 Apr 2015 12:29:10 +0000

Title

Summary

The OpenConvert tools convert to TEI or FOLiA from a number of input formats (alto, text, word, HTML, ePub). The tools are available as a Java command line tool, a web service and a web application.

Background

The OpenConvert Tools were created by INL in the OpenConvert project. The OpenConvert tools convert to TEI or FOLiA from a number of input formats (alto, text, word, HTML, ePub). The tools are available as a Java command line tool, a web service and a web application. Furthermore, as a proof of concept, the website currently provides two annotation tools: a simple Tokenizer for TEI files and a modern Dutch part of speech tagger.

Contacts

Project leader: Jan Theo Bakker 
CLARIN center:
Help contact : helpdesk@clarin.nl

Links

Web-sites: n.a.
User scenario's (screencasts, screenshots): n.a.
Manual: http://openconvert.clarin.inl.nl/openconvert/web/help.html
Tool/Service link:
- web application: http://openconvert.clarin.inl.nl/
- web services: see http://openconvert.clarin.inl.nl/openconvert/web/help.html
- command line tools: https://github.com/INL/OpenConvert
Publications: n.a.

Research domain

Religion Studies

Communication & Media Studies

Computational Linguistics

Cultural Sciences

History

Literary Studies

Philosophy

Political Studies

Linguistics

Language

Dutch

Language independent

Resource tags

service

text processing

web-application

web-service

local tool

Tool task

text processing

POS tagging

text conversion

tokenization

CLARIN centre

Dutch Language Institute

Country

Netherlands

CLAVAS

Jan Odijk — Fri, 06 Mar 2015 16:45:22 +0000

CLARIN Vocabulary Service

Summary

The CLARIN Vocabulary Service is a running instance of the OpenSKOS exchange and publication platform for SKOS vocabularies. This OpenSKOS instance currently publishes SKOS versions of three vocabularies:

ISO-639-3 language codes, as published by SIL.
Closed and simple Data Categories from the ISOcat metadata profile.
A manually constructed and curated list of Organizations, based on the CLARIN VLO.

Background

The CLARIN Vocabulary Service is a running instance of the OpenSKOS exchange and publication platform for SKOS vocabularies. OpenSKOS offers several ways to publish SKOS vocabularies (upload SKOS file, harvest from another OpenSKOS instance with OAI-PMH, construct using the RESTful API) and to use vocabularies (search and autocomplete using the API, harvest using OAI-PMH, inspect in the interactive Editor or consult as Linked Data). This CLARIN OpenSKOS instance is hosted by the Meertens Institute. Contents This OpenSKOS instance currently publishes SKOS versions of three vocabularies:

ISO-639-3 language codes, as published by SIL.
Closed and simple Data Categories from the ISOcat metadata profile.
A manually constructed and curated list of Organizations, based on the CLARIN VLO.

Contacts

Project leader: Hennie Brugman
CLARIN center: Meertens Institute
Help contact : helpdesk@clarin.nl

Links

Web-sites: https://openskos.meertens.knaw.nl/clavas/
User scenario's (screencasts, screenshots): n.a.
Manual: http://openskos.meertens.knaw.nl/web-report/documentation/clavas-overvie...
Tool/Service link: https://openskos.meertens.knaw.nl/clavas/
Publications:

Language

Language independent

Resource tags

service

web-application

web-service

Tool task

semantic registry & mapping

CLARIN centre

Meertens/HuC

Country

Netherlands

AutoSearch

Jan Odijk — Fri, 06 Mar 2015 11:29:35 +0000

AutoSearch

Summary

AutoSearch allows users to upload corpora annotated at the token level for (extended) part of speech, lemma and word form in FoLiA or TEI format, after which the corpus can be searched for these properties with a Corpus of Contemporary Dutch-like interface

Background

AutoSearch allows users to define one or more corpora and upload data for the corpora, after which the corpora will be made automatically searchable in a private workspace. Users can upload text data annotated with lemma + part of speech tags in TEI or FoLiA format, either as a single XML file or as an archive (zip or tar.gz) containing several XML files. Corpus size is limited to begin with (25 MB limit per uploaded file; 500,000 token limit for an entire corpus), but these limits may be increased at a later point in time. The search application is powered by the INL BlackLab corpus search engine. The search interface is the same as the one used in for example the Corpus of Contemporary Dutch / Corpus Hedendaags Nederlands. For Dutch corpora without such annotations, one can first use TTNWW to enrich plain text with annotations for lemma and part of speech in FoLiA format.

Contacts

Project leader: Jan Theo Bakker  
CLARIN center: Institute for Dutch Lexicology (INL)
Help contact : helpdesk@clarin.nl

Links

Web-sites: https://portal.clarin.inl.nl/
User scenario's (screencasts, screenshots): n.a.
Manual: Manual
Tool/Service link: http://portal.clarin.inl.nl/autocorp/
Publications:

Research domain

Linguistics

Morpho-syntax

Lexicology

Syntax

Language

Language independent

Resource tags

service

web-application

multi-lingual

Tool task

corpus exploration

browse

CLARIN centre

Dutch Language Institute

Country

Netherlands

CCR

Erica Renckens — Fri, 30 Jan 2015 15:25:21 +0000

CCR – CLARIN Concept Registry

Summary

The CCR is a concept registry according to the W3C SKOS recommendation. It was chosen by CLARIN to serve as a semantic registry to overcome semantic interoperability issues with CMDI metadata and different annotation tag sets used for linguistic annotation. The CCR is part of the CMDI metadata infrastructure.

Background

The W3C SKOS recommendation, and the OpenSKOS implementation thereof, provides the means for ‘data-sharing, bridging several different fields of knowledge, technology and practice’. According to this model, each concept is assigned a unique administrative identifier, together with information on the status or decision-making process associated with the concept. In addition, concept specifications in the CCR contain linguistic descriptions, such as definitions and examples, and can be associated with a variety of labels.

Contacts

Project leader:  Menzo Windhouwer
CLARIN center: Meertens Institute
Help contact : ccr@clarin.eu

Links

Web-sites: http://www.clarin.eu/ccr/, http://openskos.meertens.knaw.nl/ccr/browser/
User scenario's (screencasts, screenshots): n.a.
Manual: n.a.
Tool/Service link: http://openskos.meertens.knaw.nl/ccr/api/
Publications: n.a.

Language

Language independent

Resource tags

service

web-application

web-service

Tool task

semantic registry & mapping

CLARIN centre

Meertens/HuC

Country

Netherlands