CLARIN-NL - text/xml

Institute for the Dutch Language

Project Contact

dr. Martin Reynaert

Creator Contact

Dr. Arianna Betti

Documentation

Usage

Source code

not specified

Original source

http://portal.clarin.nl/node/4190

Publications

Betti, A, Reynaert, M and van den Berg, H. 2017. @PhilosTEI: Building Corpora for Philosophers. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 379–392. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.32. License: CC-BY 4.0

Resource

CMDI File Link

License

unknown

Inventory Scope

local

Alpino

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

Alpino: a dependency parser for Dutch

Description

Alpino is a dependency parser for Dutch, developed in the context of the PIONIER Project Algorithms for Linguistic Processing.

Project

ALP

CLARIAH-CORE

CLARIN National Project

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

general linguistics

Syntax

Tool task

parsing

dependency parsing

lemmatisation

morphological analysis

sentence splitting

tokenisation

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

text/plain

Output format

text/xml

Input Language

Dutch

Version

unknown

Access Contact

Gertjan van Noord

Project Contact

Gertjan van Noord

/mailto:/

Creator Contact

Gertjan van Noord

Gosse Bouma

Robert Malouf

Geert Kloosterman

Documentation

Alpino User Guide (HTML)

Alpino User Guide (PDF)

Alpino Annotation Guide

Alpino Treebank Tools User Guide (HTML)

Alpino Treebank Tools User Guide (PDF)

Syntactic Annotation Reference Manual

Documentation for ADT (Abstract Dependency Trees)

Source code

git://urd.let.rug.nl/Alpino.git

https://github.com/rug-compling/alpino-docker

Publications

Bouma, G., van Noord, G. J. M. and Malouf, R. 2001.Alpino: Wide-coverage computational analysis of Dutch. in Daelemans, W., Simaan, K., Veenstra, J. and Zavrel, J. (eds.). Computational Linguistics in the Netherlands 2000. Amsterdam: Rodopi, p. 45-59 15 p. (LANGUAGE AND COMPUTERS : STUDIES IN PRACTICAL LINGUISTICS)

Robert Malouf and Gertjan van Noord. Wide Coverage Parsing with Stochastic Attribute Value Grammars. In: IJCNLP-04 Workshop Beyond Shallow Analyses - Formalisms and statistical modeling for deep analyses.

Leonoor van der Beek, Gosse Bouma, and Gertjan van Noord. Een brede computationele grammatica voor het Nederlands. 2002. Nederlandse Taalkunde. https://www.let.rug.nl/~vannoord/papers/taalkunde.pdf .

Resource

LandingPage

Resource

CMDI File Link

License

GNU LGPL

Inventory Scope

local

Alpino (CLST web service and application)

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

Alpino: a dependency parser for Dutch (CLST web service and application)

Description

This is a web service and web application to the Alpino dependency parser for Dutch, developed in the context of the PIONIER Project Algorithms for Linguistic Processing.

Project

CLARIAH-CORE

CLARIN National Project

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

general linguistics

Syntax

Tool task

parsing

dependency parsing

lemmatisation

morphological analysis

sentence splitting

tokenisation

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

text/plain

Output format

text/xml

Input Language

Dutch

Version

unknown

Access Contact

Maarten van Gompel

Project Contact

/mailto:/

Creator Contact

Maarten van Gompel

Documentation

Info Page of the RUN Web application and service for Alpino

Source code

view-source:https://webservices-lst.science.ru.nl/alpino/info/

Resource

CMDI File Link

License

GNU LGPL

Inventory Scope

local

TTNWW

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

TTNWW - TST Tools for the Dutch Language as Web services in a Workflow

Description

TTNWW integrates and makes available existing Language Technology (LT) software components for the Dutch language that have been developed in the STEVIN and CGN projects. The LT components (for text and speech) are made available as web-services in a simplified workflow system that enables researchers without much technical background to use standard LT workflow recipes. The web services are available in two separate domains: "Text" and "Speech" processing. For "Text", workflows for the following functionality is offered by TTNWW: - Orthographic Normalisation using TICCLops (version CLARIN-NL 1.0); - Part of Speech Tagging, Lemmatisation, Chunking, limited Multiword Unit Recognition, and Grammatical Relation Assignment by Frog (Version 012.012); - Syntactic Parsing (including grammatical relation assignment, limited named entity recognition, and limited multiword unit recognition) by the Alpino Parser (version 1.3); - Semantic Annotation; - Named Entity Recognition; - Co-reference Assignment. For "Speech", the following workflows are offered: - Automatic Transcription of speech files using a Netherlands Dutch acoustic model; - Automatic Transcription of speech files using a Flemish Dutch acoustic model; - Conversion of the input speech file to the required sampling rate, followed by automatic transcription. The TTNWW services have been created in a Dutch and Flemish collaboration project building on the results of past Dutch and Flemish projects. The web services are partly deployed in the SURF-SARA BiG-Grid cloud or at CLARIN centres in the Netherlands and at CLARIN VL University partners. The architecture of the TTNWW portal consists out of several components and follows the principles of Service Oriented Architecture (SOA). The TTNWW GUI front-end is a Flex module that communicates with the TTNWW web-application which keeps track of the different sessions and knows which LT recipes are available. TTNWW communicates assigments (workflow specifications) to the WorkflowService that evaluates the requested workflow and requests the DeploymentSevice to start the required LT web-services. After initialization of the LT web-services, the workflow specification is sent to the Taverna Server, that takes further care of the workflow. To facilitate the process of wrapping applications that were originally designed as standalone applications into web services, the CLAM (Computational Linguistics Application Mediator) wrapper software allows for easy and transparent transformation of applications into RESTful web services. The CLAM software has extensively been used in the TTNWW project for both text and speech processing tools. With the exception of Alpino and MBSRL all web services work operate on CLAM wrappers. Given the number of web services involved in the TTNWW project and possibilities offered by the cloud environment the preferred method of delivering the web service installations was delivery of complete virtual machine images by the LT providers. These could be directly uploaded into the cloud environment and thus relieving the CLARIN centres nd LT providers from the original foreseen task of running the webservices themselves. A potential advantage of this method, that has not been exploited in the project yet, is that these images may be also be delivered directly to the end user so these can be run in a local configuration using virtualization software such as VMWare of VirtualBox. The workflow engine used in the project was Taverna. But build on top of this was a a number of selectable task recipes, following a task oriented approach in line with the premises that users with no or little technical expertise should be able to use the system. In this context, tasks are understood in terms of end results of processes such as semantic role labelling, pos tagging or syntactic analysis and ready-made workflows are constructed that can be readily used by the end user.

Project

TTNWW

CLARIN National Project

CLARIN-NL

CLARIN centre

Meertens/HuC

Research domain

Linguistics

Communication and Media Studies

History

Oral History

Linguistic Subject

discourse analysis

Orthography

Semantics

Syntax

Tool task

grammatical relation assignment

coreference resolution

corpus processing

dependency parsing

lemmatisation

multiword unit identification

orthographic normalisation

semantic role labeling

chunking

parsing

speech recognition

speech transcription

tokenisation

up/down sampling

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

withdrawn

Input format

text/plain

audio/wav

Output format

text/xml

Input Language

Dutch

Access Contact

Daan Broeder

Project Contact

/mailto:Daan.Broeder@meertens.knaw.nl/

Creator Contact

/mailto:Daan.Broeder@meertens.knaw.nl/

Documentation

TTNWW handleiding

Source code

not specified

Original source

http://portal.clarin.nl/node/1964

Publications

Kemps-Snijders, M, Schuurman, I, Daelemans, W, Demuynck, K, Desplanques, B, Hoste, V, Huijbregts, M, Martens, J-P, Paulussen, H, Pelemans, J, Reynaert, M, Vandeghinste, V, van den Bosch, A, van denHeuvel, H, van Gompel, M, van Noord, G and Wambacq, P. 2017. TTNWW to the Rescue: No Need to Know How to Handle Tools and Resources. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 83–93. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.7. License: CC-BY 4.0

Resource

CMDI File Link

License

unknown

Inventory Scope

local

TiCClops

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

TiCClops: Text-Induced Corpus Clean-up online processing system

Description

TICCL (Text Induced Corpus Clean-up) is a system that is designed to search a corpus for all existing variants of (potentially) all words occurring in the corpus. This corpus can be one text, or several, in one or more directories, located on one or more machines. TICCL creates word frequency lists, listing for each word type how often the word occurs in the corpus. These frequencies of the normalized word forms are the sum of the frequencies of the actual word forms found in the corpus. TICCL is a system that is intended to detect and correct typographical errors (misprints) and OCR errors (optical character recognition) in texts. When books or other texts are scanned from paper by a machine, that then turns these scans, i.e. images, into digital text files, errors occur. For instance, the letter combination `in' can be read as `m', and so the word `regeering' is incorrectly reproduced as `regeermg'. TICCL can be used to detect these errors and to suggest a correct form. Text-Induced Corpus Clean-up (TICCL) was developed first as a prototype at the request of the Koninklijke Bibliotheek - The Hague (KB) and reworked into a production tool according to KB specifications (currently at production version 2.0) mainly during the second half of 2008. It is a fully functional environment for processing possibly very large corpora in order to largely remove the undesirable lexical variation in them. It has provisions for various input and output formats, is flexible and robust and has very high recall and acceptable precision. As a spelling variation detection system it is to the developer’s knowledge unique in making principled use of the input text as possible source for target output canonical forms. As such it is far less domain-sensitive than other approaches: the domain is largely covered by the input text collection. TICCL comes in two variants: one with a classic CLAM web application interface, and one with the PhilosTEI interface.

Project

TiCClops: Text-Induced Corpus Clean-up online processing system

CLARIN National Project

CLARIN-NL

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Linguistic Subject

general linguistics

Orthography

Tool task

corpus processing

orthographic normalisation

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

image/tiff

image/vnd.djvu

application/pdf

text/plain

text/xml

text/csv

Output format

text/xml

Input Language

Dutch

English

Finnish

French

German

German (Fraktur)

Classical Greek

Modern Greek

Icelandic

Italian

Latin

Polish

Portuguese

Russian

Spanish

Swedish

Access Contact

Institute for the Dutch Language

Project Contact

dr. Martin Reynaert

Creator Contact

dr. Martin Reynaert

Documentation

TICCLops User and Demonstrator Documentation

Source code

not specified

Original source

http://portal.clarin.nl/node/1914

Publications

Reynaert, M. (2008). All, and only, the errors: More complete and consistent spelling and OCR-error correction evaluation. In: Proceedings of the Sixth International Language Resources and Evaluation (LREC’08), Marrakech, Morocco.

Reynaert, M. (2010). Character confusion versus focus word-based correction of spelling and ocr variants in corpora. International Journal on Document Analysis and Recognition, pp 1-15, URL http://dx.doi.org/10.1007/s10032-010-0133-5

Resource

CMDI File Link

License

unknown

Inventory Scope

local

Arbil

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Metadata Editor, Browser and Organiser for IMDI and CMDI

Description

Arbil (Archive Builder) is a metadata editor, browser and organiser for metadata in IMDI and CMDI format. It is a Java desktop application that runs on most operating systems. Arbil can be used to create new metadata from scratch for resources on your local machine, or it can be used to download and modify metadata that are already in an archive. Arbil is a generic CMDI editor and therefore supports all CMDI profiles. It has a built-in file type verification tool that is configured to check files against the list of accepted file types for The Language Arhive, this can however be overruled for other archives.

Project

The Language Archive

DOBES

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Research domain

General

Tool task

editing

metadata creation

Country

Netherlands

Tool Type

local desktop

Research Phase

Publishing Data / Software

Tool status

released

Output format

text/xml

Input Language

Language independent

Version

2.6

Access Contact

/mailto:tla@mpi.nl/

Project Contact

/mailto:tla@mpi.nl/

/mailto:dobes@mpi.nl/

Creator Contact

/mailto:tla@mpi.nl/

Documentation

Arbil CMDI Manual

Arbil Online CMDI Manual

Arbil CMDI User Guide

Source code

https://github.com/TheLanguageArchive/Arbil

Original source

http://portal.clarin.nl/node/1962

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

CMDI

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

CMDI Registry/editor

Description

The CMDI Registry/Editor allows metadata modelers and editors to share and reuse CMDI metadata schema or build new ones (partly) based on previous work. CMDI is the metadata framework adopted by CLARIN. Metadata for language resources and tools exists in a multitude of formats. Often these descriptions contain specialized information for a specific research community (e.g. TEI headers for text, IMDI for multimedia collections). To overcome this dispersion CLARIN has initiated the Component MetaData Infrastructure (CMDI). It provides a framework to describe and reuse metadata components that are pieces of the completemetadata schema. Such components can be grouped into a ready-made description format (a “profile”). Both are stored and shared with other users in the Component Registry to promote reuse. Such metadata profiles (equivalent to a metadata schema) can be used to instantiate metadata descriptions that describe language resources. The CMDI approach combines architectural freedom when modeling the metadata with powerful exploration and search possibilities over a broad range of language resources. The CMDI Registry development was supported by both the Dutch and German national CLARIN projects.

Project

CMDI

CLARIN National Project

CLARIN-NL

CLARIN centre

Hosted by CLARIN ERIC

Research domain

General

Tool task

editing

metadata creation

semantic registry and mapping

Country

Netherlands

Tool Type

web application

Research Phase

Publishing Data / Software

Tool status

published

Output format

text/xml

Input Language

Language independent

Access Contact

/mailto:-/

Project Contact

/mailto:-/

Creator Contact

/mailto:-/

Documentation

Component Registry, Browser and Editor Reference Manual

Source code

not specified

Original source

http://portal.clarin.nl/node/1953

Publications

Windhouwer, M, Indarto, E and Broeder, D. 2017. CMD2RDF: Building a Bridge from CLARIN to Linked Open Data. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 95–103. London:Ubiquity Press. DOI: https://doi.org/10.5334/bbi.8. License: CC-BY 4.0

Resource

CMDI File Link

License

unknown

Inventory Scope

local

OpenConvert

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

OpenConvert

Description

The OpenConvert tools convert to TEI or FOLiA from a number of input formats (alto, text, word, HTML, ePub). The tools are available as a Java command line tool, a web service and a web application.The OpenConvert Tools were created by IVDNT in the OpenConvert project. The OpenConvert tools convert to TEI or FOLiA from a number of input formats (alto, text, word, HTML, ePub). The tools are available as a Java command line tool, a web service and a web application. Furthermore, as a proof of concept, the website currently provides two annotation tools: a simple Tokenizer for TEI files and a modern Dutch part of speech tagger.

Project

OpenConvert

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Religion Studies

Communication and Media Studies

Cultural Sciences

History

Literary Studies

Philosophy

Political Studies

Tool task

corpus processing

format conversion

text conversion

tokenisation

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

released

Input format

text/plain

application/msword

text/html

text/xml

application/epub+zip

application/zip

Output format

text/xml

Input Language

Language independent

Access Contact

Institute for the Dutch Language

Project Contact

Jan Theo Bakker

Institute for the Dutch Language

Creator Contact

Jan Theo Bakker

Institute for the Dutch Language

Documentation

OpenConvert help

Source code

https://github.com/INL/OpenConvert

Original source

http://portal.clarin.nl/node/4224

Resource

CMDI File Link

License

other

Inventory Scope

local

Namescape Named Entity Recognition

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Namescape Named Entity Recognition

Description

Searching and visualizing Named Entities in modern Dutch novels. The named entity (NE) tagging and resolution in NameScape enables quantitative and repeatable research where previously only guesswork and anecdotal evidence was feasible. The visualisation module enables researchers with a less technical background to draw conclusions about functions of names in literary work and help them to explore the material in search of more interesting questions (and answers). Users from other communities (sociolinguistics, sentiment analysis, …) also benefit from the NE tagged data, especially since the NE recognizer is available as a web service, enabling researchers to annotate their own research data. Datasets in NameScape (total of 1.129 books): Corpus Sanders: A corpus of 582 Dutch novels written and published between 1970 and 2009 will. Corpus Huygens: Consists of 22 novels manually tagged with detailed named entity information. IPR for this corpus do not allow distribution. Corpus eBooks: Consists of 7000+ Dutch eBooks tagged automatically with basic NER features and person name Part information. IPR for this corpus do not allow distribution. Corpus SoNaR Books: 105 Dutch books; NE tagged. Corpus Gutenberg Dutch: Consists of 530 NE tagged TEI files converted from the Epub versions of the corresponding Gutenberg documents. Recent research has conclusively proven names in literary works can only be put fully into perspective when studied in a wider context (landscape) of names either in the same text or in related material (the onymic landscape or “namescape”). Research on large corpora is needed to gain a better understanding of e.g. what is characteristic for a certain period, genre, author or cultural region. The data necessary for research on this scale simply does not exist yet. NameScape aims to fill the need by providing a substantial amount of literary works annotated with a rich tag set, thereby enabling researchers to perform their research in more depth than previously possible. Several exploratory visualization tools help the scholar to answer old questions and uncover many more new ones, which can be addressed using the demonstrator.

Project

Namescape

CLARIN National Project

CLARIN-NL

CLARIN centre

Huygens ING

Research domain

Linguistics

Literary Studies

Linguistic Subject

Computational Linguistics

Tool task

corpus searching

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

text/html

application/msword

application/epub+zip

text/xml

Output format

text/xml

Input Language

Dutch

Access Contact