CLARIN-NL - text/csv

@Philostei

root — Mon, 08 Apr 2019 08:38:55 +0000

Description

The system here allows you to convert your book pages' images into editable text, presented in a particular text format called XML (eXtended Markup Language) of a particular type called Text-Encoding Initiative or TEI XML. This particular format was developed specifically for being able to mark-up or annotate the text you want to work on, i.e. to add all manner of further information to the actual text, e.g. to build a critical edition of it, which is most likely exactly what you want to do with your author's work.

CLARIN National Project

CLARIAH-CORE

CLARIN-NL

CLARIN centre

Dutch Language Institute

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

image/tiff

image/vnd.djvu

application/pdf

text/plain

text/xml

text/csv

Output format

text/xml

Input Language

Dutch

English

Finnish

French

German

German (Fraktur)

Classical Greek

Modern Greek

Icelandic

Italian

Latin

Polish

Portuguese

Russian

Spanish

Swedish

Access Contact

/mailto:servicedesk@ivdnt.org/

Institute for the Dutch Language

Project Contact

dr. Martin Reynaert

Creator Contact

Dr. Arianna Betti

Documentation

Usage

Source code

not specified

Original source

http://portal.clarin.nl/node/4190

Publications

Betti, A, Reynaert, M and van den Berg, H. 2017. @PhilosTEI: Building Corpora for Philosophers. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 379–392. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.32. License: CC-BY 4.0

Resource

CMDI File Link

License

unknown

Inventory Scope

local

TiCClops

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

TiCClops: Text-Induced Corpus Clean-up online processing system

Description

TICCL (Text Induced Corpus Clean-up) is a system that is designed to search a corpus for all existing variants of (potentially) all words occurring in the corpus. This corpus can be one text, or several, in one or more directories, located on one or more machines. TICCL creates word frequency lists, listing for each word type how often the word occurs in the corpus. These frequencies of the normalized word forms are the sum of the frequencies of the actual word forms found in the corpus. TICCL is a system that is intended to detect and correct typographical errors (misprints) and OCR errors (optical character recognition) in texts. When books or other texts are scanned from paper by a machine, that then turns these scans, i.e. images, into digital text files, errors occur. For instance, the letter combination `in' can be read as `m', and so the word `regeering' is incorrectly reproduced as `regeermg'. TICCL can be used to detect these errors and to suggest a correct form. Text-Induced Corpus Clean-up (TICCL) was developed first as a prototype at the request of the Koninklijke Bibliotheek - The Hague (KB) and reworked into a production tool according to KB specifications (currently at production version 2.0) mainly during the second half of 2008. It is a fully functional environment for processing possibly very large corpora in order to largely remove the undesirable lexical variation in them. It has provisions for various input and output formats, is flexible and robust and has very high recall and acceptable precision. As a spelling variation detection system it is to the developer’s knowledge unique in making principled use of the input text as possible source for target output canonical forms. As such it is far less domain-sensitive than other approaches: the domain is largely covered by the input text collection. TICCL comes in two variants: one with a classic CLAM web application interface, and one with the PhilosTEI interface.

Project

TiCClops: Text-Induced Corpus Clean-up online processing system

CLARIN National Project

CLARIN-NL

CLARIN centre

Dutch Language Institute

Research domain

Linguistics

Linguistic Subject

general linguistics

Orthography

Tool task

corpus processing

orthographic normalisation

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

image/tiff

image/vnd.djvu

application/pdf

text/plain

text/xml

text/csv

Output format

text/xml

Input Language

Dutch

English

Finnish

French

German

German (Fraktur)

Classical Greek

Modern Greek

Icelandic

Italian

Latin

Polish

Portuguese

Russian

Spanish

Swedish

Access Contact

/mailto:servicedesk@ivdnt.org/

Institute for the Dutch Language

Project Contact

dr. Martin Reynaert

Creator Contact

dr. Martin Reynaert

Documentation

TICCLops User and Demonstrator Documentation

Source code

not specified

Original source

http://portal.clarin.nl/node/1914

Publications

Reynaert, M. (2008). All, and only, the errors: More complete and consistent spelling and OCR-error correction evaluation. In: Proceedings of the Sixth International Language Resources and Evaluation (LREC’08), Marrakech, Morocco.

Reynaert, M. (2010). Character confusion versus focus word-based correction of spelling and ocr variants in corpora. International Journal on Document Analysis and Recognition, pp 1-15, URL http://dx.doi.org/10.1007/s10032-010-0133-5

Resource

CMDI File Link

License

unknown

Inventory Scope

local

Frog

root — Mon, 08 Apr 2019 08:38:48 +0000

http://dev.clarin.nl/sites/default/files/froglogo.svg

Title

Frog: An advanced Natural Language Processing Suite for Dutch (Web Service and Application)

Description

Frog is an integration of memory-based natural language processing (NLP) modules developed for Dutch. It performs automatic linguistic enrichment such as part of speech tagging, lemmatisation, named entity recognition, shallow parsing, dependency parsing and morphological analysis. All NLP modules are based on TiMBL.

Project

CGN

CLARIN-NL

CLARIAH-CORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

general linguistics

Syntax

Tool task

dependency parsing

shallow parsing

lemmatisation

morphological analysis

named entity recognition

part of speech tagging

sentence splitting

tokenisation

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

application/pdf

application/msword

text/folia+xml

text/plain

Output format

text/csv

Input Language

Dutch

Version

v0.15

Access Contact

Antal van den Bosch

Project Contact

/mailto:/

Creator Contact

Antal van den Bosch

Maarten van Gompel

Ko van der Sloot

Bertjan Busser

Iris Hendrickx

Sander Canisius

Jakub Zavrel

Documentation

Iris Hendrickx, Antal van den Bosch, Maarten van Gompel, Ko van der Sloot, Walter Daelemans. 2016.Frog: An Natural Language Processing suite for Dutch. CLST Technical Report 16-02.

Webservice Specification

readme

releaseNotes

issueTracker

contIntegration

Source code

https://github.com/LanguageMachines/frog

Publications

Iris Hendrickx, Antal van den Bosch, Maarten van Gompel, Ko van der Sloot and Walter Daelemans. 2016.Frog: A Natural Language Processing Suite for Dutch. CLST Technical Report 16-02, pp 99-114. Nijmegen, the Netherlands. https://github.com/LanguageMachines/frog/blob/master/docs/frogmanual.pdf

Van den Bosch, A., Busser, G.J., Daelemans, W., and Canisius, S. (2007). An efficient memory-based morphosyntactic tagger and parser for Dutch, In F. van Eynde, P. Dirix, I. Schuurman, and V. Vandeghinste (Eds.), Selected Papers of the 17th Computational Linguistics in the Netherlands Meeting, Leuven, Belgium, pp. 99-114. http://ilk.uvt.nl/downloads/pub/papers/tadpole-final.pdf

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

MIMORE

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

MIMORE: Microcomparative Morphosyntax Research Tool

Description

With the MIMORE search engine one can search three databases together, with text strings, part of speech tags and syntactic variables. The researcher can combine categories and features into complex tags or use predefined tags. All categories and features are defined in ISOcat. Since all sentences have a location code, the morphosyntactic phenomena found in a set of sentences resulting from a search can be automatically plotted on a geographic map. It is possible to include more than one morphosyntactic phenomenon in one map, thus visualizing potential correlations between these phenomena. There is also a user-friendly function to export the data to a statistical program. The data in DynaSAND, the dynamic syntactic atlas of the Dutch dialects (http://www.meertens.knaw.nl/sand/ (link is external)), were collected between 2000 and 2005 by oral interviews (fieldwork and telephone) in about 300 locations across The Netherlands, Belgium and a small part of north-west France. Dialect speakers were asked to judge and/or translate some 150 test sentences. DynaSAND makes available the full recordings and transcriptions of these interviews. Together, the DynSAND data cover the syntactic variation in the Dutch language area in the left periphery of the clause (the complementizer system and complementizer agreement), variation in subject pronoun form depending on syntactic position, subject pronoun doubling, cliticization on YES/NO, the reflexive system, fronting constructions (Wh-clauses, relative clauses, topicalization), word order and morphological variation in verb clusters, negation and quantification. The data in DiDDD (Diversity in Dutch DP Design; http://www.meertens.knaw.nl/diddd/ (link is external)) were collected between 2005 and 2009 with oral and written interviews in about 200 locations in the Dutch language area, with a methodology highly parallel to DynaSAND. The data involve translations of and judgements on test sentences. For 29 interviews there are sound recordings which have been lined up with their transcriptions. The DIDDD data cover the morphosyntactic variation within nominal groups, in particular possessives, partitives, noun ellipsis, the demonstrative system, the numeral modification system, what-for constructions, quantitative er, adjectival inflection, negation and exclamatives. The data in GTRP (Goeman, Taeldeman, van Reenen Project; http://www.meertens.knaw.nl/mand/database/ (link is external)) were collected between 1979 and 2000 with oral interviews in about 600 locations in the Dutch language area. Informants were asked to translate words or short sentences. Part of the transcriptions have been lined up with the sound recordings. The morphological data in GTRP include plural forms of nouns, diminutives, gender on nouns and adjectives, comparatives, superlatives, verbal inflection including participles, subject, object and possessive pronouns.

Project

MIMORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

Meertens/HuC

Research domain

Linguistics

Linguistic Subject

Dialectology

Morphology

Syntax

Tool task

corpus searching

corpus browsing

analysis

visualisation

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Tool status

published

Output format

text/csv

Input Language

Dutch

Access Contact

/mailto:info@meertens.knaw.nl/

Project Contact

prof. dr. Sjef Barbiers

Creator Contact

prof. dr. Sjef Barbiers

Documentation

Demonstration of the Microcomparative Morphosyntactic Research Tool

Architectuur MIMORE

MIMORE Video

Source code

not specified

Original source

http://portal.clarin.nl/node/1911

Publications

S. Barbiers, M. van Koppen, H. Bennis, N. Corver, MIcrocomparative MOrphosyntactic REsearch (MIMORE): Mapping partial grammars of Flemish, Brabantish and Dutch. Lingua Vol. 178, 5-31. doi:10.1016/j.lingua.2015.10.018

Resource

SearchPage

SearchService

CMDI File Link

License

unknown

Inventory Scope

local

MIGMAP

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

MIGMAP: Detailed interactive mapping of migration in The Netherlands in the 20th century.

Description

MIGMAP is a web application that can show migration flow between Dutch municipalities. The user first chooses generation (forward or backward in time) and gender, while subsequently the migration map of The Netherlands related to an interactively pointed municipality (or other aggregation unit) is shown. The data underlying the migration maps originate from the first name selection from the Civil Registration, acquired by Utrecht University and the Meertens Institute in 2006. These concern 16 million records from persons with Dutch citizenship, alive in 2006, and in addition 6 million persons deceased before 2006, but mentioned in other records – mainly as parents. The records include identifiers by which family relations can be reconstructed. After considerable efforts in data clearing and reconstruction of older generations, the data provide an almost complete overview of the Dutch population, born after 1930, and a fairly good sample from the period 1880-1930 (>25%). The user will be given options to choose generation (places of birth of the current population, their parents, grandparents grand-grandparents, or starting with the persons born between 1880-1900: the current places of residence of their children, grandchildren), and gender. Each map will be made available as a .csv record with municipality number and percentage as fields, and thus can be used by users in correlation studies with other variables. Utrecht University and the Meertens Institute have the signed permission of the "Basisadministratie voor Persoonsgegevens en Reisdocumenten, The Hague" to use the data for scientific purposes. The migration maps present the data in an aggregated way, and do not violate privacy requirements (no individual can possibly be identified from the maps). However, the underlying data containing information about individual persons and their family relations cannot be made available for reasons of privacy.

Project

MIGMAP

CLARIN National Project

CLARIN-NL

CLARIN centre

Meertens/HuC

Research domain

Linguistics

History

Linguistic Subject

Dialectology

Onomatology

Sociolinguistics

Tool task

searching

browsing

visualisation

analysis

Country

Netherlands

Tool Type

web application

Research Phase

Data analysis

Tool status

published

Output format

text/csv

Input Language

Dutch

Access Contact

/mailto:info@meertens.knaw.nl/

Project Contact

/mailto:info@meertens.knaw.nl/

Creator Contact

dr. ir. G. Bloothooft

Documentation

Background information - Instructions for use

Source code

not specified

Original source

http://portal.clarin.nl/node/1930

Publications

Bloothooft, G, Onland, D and Kunst, J.P. 2017. Mapping Migration across Generations. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 351–360. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.29. License: CC-BY 4.0

Ekamper, P. en Bloothooft, G. (2013), "Weg van je wortels. De afstand tussen overgrootouders en achterkleinkinderen", DEMOS 29, 2, p8.

Resource

CMDI File Link

License

Creative Commons (non-commercial)

Inventory Scope

local

Corpus Studio Web

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Corpus Studio Web

Description

Summary CorpusStudio is a web application that facilitates in-depth quantitative syntactic research for linguists. Background CorpusStudio is a web application that facilitates in-depth quantitative syntactic research for linguists. It does so by supporting researchers in writing queries that operate on syntactically parsed text corpora in a number of major xml formats. Queries that belong together are kept in xml documents that are called ‘Corpus Research Projects’ (CRPs). These documents contain the queries, the order in which they are to be executed, meta-information about the queries and the project as a whole, as well as a specification of the input used for the project. The use of CRPs helps improve the replicability of corpus research. Access Any CLARIN-NL user can access the CorpusStudio web application and make use of the 'standard' corpora. New users must provide a login name and password, after which they can make use of the application. Adaptable The CorpusStudio code is open-source. Users can take the code, adapt it and use it for their own purposes. Users can also take the code from GitHub as it is, but build their own server in order to run the application on their own text-corpora. User documentation and an API are available (see below). The current version of CorpusStudio supports xml text corpora in the FoLiA and Psdx formats. Extensions to other xml formats are possible. CrpxProcessor provides the basic functionality and is on github on https://github.com/ErwinKomen/CrpxProcessor. CrppServer takes care of /crpp and uses CrpxProcessor. It is on GitHub on https://github.com/ErwinKomen/CrppServer. CrpStudio is on https://github.com/ErwinKomen/CrpStudio, takes care of /crpstudio and uses CrpxProcessor. Main features Keep all important aspects of a research project in one file Define one or more search queries in a hierarchy Uses w3c developed Xquery and Xpath Integrated CorpusStudio-specific Xquery functions User-definable functions and variables Create corpus result databases with user-definable features accompanying each hit Divide the output into calculatable categories Divide the results into meta-data-dependent groups Parallel processing yields a speed-up of a factor 20-100 compared to the Windows version Compatibility with the Windows programs "Cesax" and "CorpusStudio" Limitations and future developments Current limitations to the program include: working with result database, restricted login system, no document view, grouping is restricted to system-defined groups, no query or project wizard. Although the CLARIN-NL project has stopped in December 2015, every effort will be undertaken to make sure that a number of essential features are going to be added.

Project

Corpus Studio Web

CLARIN National Project

CLARIN-NL

CLARIN centre

Meertens/HuC

Research domain

Linguistics

Linguistic Subject

Syntax

Morpho-syntax

Computational Linguistics

Tool task

corpus searching

querying

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Data analysis

Tool status

published

Output format

text/csv

Input Language

Language independent

Access Contact

Erwin Komen

Project Contact

Erwin Komen

Creator Contact

Erwin Komen

Documentation

Komen, Erwin R. 2015. "Corpus Studio: the web application". User documentation. version 1.7. Meertens Instituut, Amsterdam.

Komen, Erwin R. 2016. "An API for the CorpusStudio web application". version 1.3. Meertens Instituut, Amsterdam.

Source code

https://github.com/ErwinKomen/CrpxProcessor

https://github.com/ErwinKomen/CrppServer

https://github.com/ErwinKomen/CrpStudio

Original source

http://portal.clarin.nl/node/4239

Publications

Komen, E. R. 2017. Beyond Counting Syntactic Hits. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 259–268. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.21. License: CC-BY 4.0

Komen, Erwin R. 2011. Coreferenced corpora for information structure research. In Outposts of Historical Corpus Linguistics: From the Helsinki Corpus to a Proliferation of Resources. (Studies in Variation, Contacts and Change in English 10) Jukka Tyrkkö, Terttu Nevalainen, Matti Rissanen & Matti Kilpiö (eds). Helsinki, Finland: Research Unit for Variation, Contacts, and Change in English.

Komen, Erwin R. 2013. Finding focus: a study of the historical development of focus in English. Utrecht: LOT.

Komen, Erwin R. 2013. Corpus databases with feature pre-calculation. In Proceedings of the twelfth workshop on treebanks and linguistic theories (TLT12). Sandra Kübler, Petya Osenova & Martin Volk (eds), 85-96. Sofia, Bulgaria: The institute of information and communication technologies, Bulgarian academy of sciences.