CLARIN-NL - annotation

FLAT

root — Mon, 08 Apr 2019 08:38:55 +0000

https://github.com/proycon/flat/blob/master/flat/style/logo.svg

Title

FLAT: FoLiA-Linguistic-Annotation-Tool

Description

FLAT is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.github.io/folia), a rich XML-based format for linguistic annotation. FLAT allows users to view annotated FoLiA documents and enrich these documents with new annotations, a wide variety of linguistic annotation types is supported through the FoLiA paradigm. It is a document-centric tool that fully preserves and visualises document structure. Features Web-based, multi-user environment Server-side document storage, divided into 'namespaces', by default each user has his own namespace. Active documents are held in memory server-side. Read and write permissions to access namespaces are fully configurable. Concurrency (multiple users may edit the same document similtaneously) Full versioning control for documents (using git), allowing limitless undo operations. (in foliadocserve) Full annotator information, with timestamps, is stored in the FoLiA XML and can be displayed by the interface. The git log also contains verbose information on annotations. Annotators can indicate their confidence for each annotation Highly configurable interface; interface options may be disabled on a per-configuration basis. Multiple configurations can be deployed on a single installation Displays and retains document structure (divisions, paragraphs, sentence, lists, etc) Support for corrections, of text or linguistic annotations, and alternative annotations. Corrections are never mere substitutes, originals are always preserved! Spelling corrections for runons, splits, insertions and deletions are supported. Supports FoLiA Set Definitions to display label sets. Sets are not predefined in FoLiA and anybody can create their own. Supports Token Annotation and Span Annotation Supports complex span annotations such as dependency relations, syntactic units (constituents), predicates and semantic roles, sentiments, stratements/attribution, observations Simple metadata editor for editing/adding arbitrary metadata to a document. Selected metadata fields can be shown in the document index as well. User permission model featuring groups, group namespaces, and assignable permissions File/document management functions (copying, moving, deleting) Allows converter extensions to convert from other formats to FoLiA on upload In-document search (CQL or FQL), advanced searches can be predefined by administrators Morphosyntactic tree visualisation (constituency parses and morphemes) Higher-order annotation: associate features, comments, descriptions with any linguistic annotation

Project

CLARIN-NL

CLARIAH-CORE

CLARIN National Project

CLARIN-NL

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Linguistics

Linguistic Subject

general linguistics

Syntax

Morphology

Morpho-syntax

Orthography

Tool task

annotation

editing

Country

Netherlands

Version

v0.7.12

Access Contact

Maarten van Gompel

Project Contact

Jan Odijk

Creator Contact

Antal van den Bosch

Maarten van Gompel

Documentation

Installation Guide

Administration Guide

User Guide

FLAT Demonstration Video

Release Notes

Issue Tracker

Source code

https://github.com/proycon/flat

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

TQE

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

TQE: Transcription Quality Evaluation

Description

The Transcription Quality Evaluation (TQE) tool is an instrument that automatically evaluates the quality of phonetic transcriptions. The application makes it possible to upload pairs of files consisting of an audio file and a transcription file and process them as follows: the audio signal and the phonetic transcription are aligned, segment boundaries are derived for each phone, and for each segment-phone combination it is determined how well they fit together, i.e. for each phone a TQE measure (a confidence measure) is determined, a number ranging from 0-100%, indicating how good the fit is, i.e. the quality of the phone transcription. The higher the number, the better the fit. The output of the TQE tool consists of a TQE measure and the segment boundaries for each phone in the corpus. The TQE tool thus makes it possible to find (sequences of) segments for which the match of the phone symbols with the audio signal is not optimal, in other words, the TQE tool can be used to check the quality of phonetic transcriptions. This can be useful for validating (manual) phonetic transcriptions, but also to compare and select (‘competing’) transcriptions, e.g. to study pronunciation variation. The TQE tool can thus be usefully applied in all research – in various (sub-) fields of humanities and language and speech technology (L&ST) – in which audio and phonetic transcriptions are involved.

Project

TQE

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Research domain

Linguistics

Speech Processing

Linguistic Subject

Phonetics

Tool task

evaluation

annotation

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

published

Input format

audio/wav

text/plain

Output format

text/plain

Input Language

English

Access Contact

Project Contact

Dr. H. Strik

Creator Contact

Dr. H. Strik

Documentation

Manual

Source code

not specified

Original source

http://portal.clarin.nl/node/1912

Resource

CMDI File Link

License

unknown

Inventory Scope

local

Adelheid Visualiser/Editor

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

A Visualiser/Editor for part-of-speech tagged corpora

Description

With this web-application an end user can view and edit corpora tokenized, lemmatized and part-of-speech tagged with Adelheid.

Project

Adelheid

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Research domain

Linguistics

Linguistic Subject

general linguistics

Syntax

historical linguistics

Tool task

visualisation

querying

corpus browsing

annotation

editing

Country

Netherlands

Tool Type

web application

Research Phase

Visualisation

Tool status

released

Input Language

Language independent

Access Contact

/mailto:/

Project Contact

Dr. Hans van Halteren

Creator Contact

/mailto:/

Documentation

Annotation Tool Manual

Web service metadata

Source code

not specified

Original source

http://portal.clarin.nl/node/1918

Resource

LandingPage

CMDI File Link

License

unknown

Inventory Scope

local

Corpus Studio Web

Jan Odijk — Thu, 11 Aug 2016 14:52:48 +0000

Corpus Studio Web

Summary

CorpusStudio is a web application that facilitates in-depth quantitative syntactic research for linguists.

Background

CorpusStudio is a web application that facilitates in-depth quantitative syntactic research for linguists. It does so by supporting researchers in writing queries that operate on syntactically parsed text corpora in a number of major xml formats. Queries that belong together are kept in xml documents that are called ‘Corpus Research Projects’ (CRPs). These documents contain the queries, the order in which they are to be executed, meta-information about the queries and the project as a whole, as well as a specification of the input used for the project. The use of CRPs helps improve the replicability of corpus research.

Access

Any CLARIN-NL user can access the CorpusStudio web application and make use of the 'standard' corpora. New users must provide a login name and password, after which they can make use of the application.

Adaptable

The CorpusStudio code is open-source. Users can take the code, adapt it and use it for their own purposes. Users can also take the code from GitHub as it is, but build their own server in order to run the application on their own text-corpora. User documentation and an API are available (see below). The current version of CorpusStudio supports xml text corpora in the FoLiA and Psdx formats. Extensions to other xml formats are possible.

Main features

Keep all important aspects of a research project in one file
Define one or more search queries in a hierarchy
Uses w3c developed Xquery and Xpath
Integrated CorpusStudio-specific Xquery functions
User-definable functions and variables
Create corpus result databases with user-definable features accompanying each hit
Divide the output into calculatable categories
Divide the results into meta-data-dependent groups
Parallel processing yields a speed-up of a factor 20-100 compared to the Windows version
Compatibility with the Windows programs "Cesax" and "CorpusStudio"

Limitations and future developments

Current limitations to the program include: working with result database, restricted login system, no document view, grouping is restricted to system-defined groups, no query or project wizard. Although the CLARIN-NL project has stopped in December 2015, every effort will be undertaken to make sure that a number of essential features are going to be added.

Contacts

Project leader: Erwin Komen  
CLARIN center:
Help contact: E.Komen@Let.ru.nl

Links

Web-sites:
User scenario's (screencasts, screenshots): n.a.
Manual:
- Komen, Erwin R. 2015. "Corpus Studio: the web application". User documentation. version 1.7. Meertens Instituut, Amsterdam. http://hdl.handle.net/21.11114/COLL-0000-000B-C289-F
- Komen, Erwin R. 2016. "An API for the CorpusStudio web application". version 1.3. Meertens Instituut, Amsterdam. http://hdl.handle.net/21.11114/COLL-0000-000B-C288-0
Tool/Service link: http://hdl.handle.net/21.11114/COLL-0000-000B-C287-1
Publications:
- Komen, Erwin R. 2011. Coreferenced corpora for information structure research. In Outposts of Historical Corpus Linguistics: From the Helsinki Corpus to a Proliferation of Resources. (Studies in Variation, Contacts and Change in English 10) Jukka Tyrkkö, Terttu Nevalainen, Matti Rissanen & Matti Kilpiö (eds). Helsinki, Finland: Research Unit for Variation, Contacts, and Change in English.
- Komen, Erwin R. 2013. Finding focus: a study of the historical development of focus in English. Utrecht: LOT.
- Komen, Erwin R. 2013. Corpus databases with feature pre-calculation. In Proceedings of the twelfth workshop on treebanks and linguistic theories (TLT12). Sandra Kübler, Petya Osenova & Martin Volk (eds), 85-96. Sofia, Bulgaria: The institute of information and communication technologies, Bulgarian academy of sciences.

Research domain

Linguistics

Syntax

Language

Language independent

Resource tags

service

web-application

Tool task

annotation

browse

CLARIN centre

Meertens/HuC

Country

Netherlands

Nederlab

Erica Renckens — Mon, 10 Aug 2015 08:07:39 +0000

Nederlab, online laboratory for humanities research on Dutch text collections

Summary

A user-friendly and tool-enriched open access web interface that that aims at containing all digitized texts relevant for the Dutch national heritage and the history of Dutch language and culture (c. 800 - present).

Background

The Nederlab project aims to bring together all digitized texts relevant to Dutch national heritage, the history of Dutch language and culture (c. 800 - present) in one user-friendly and tool-enriched open access web interface, allowing scholars to simultaneously search and analyze data from texts spanning the full recorded history of the Netherlands, its language and culture. The project builds on various initiatives: for corpora Nederlab collaborates with the scientific libraries and institutions, for infrastructure with CLARIN (and CLARIAH), for tools with eHumanities programmes such as Catch, IMPACT and CLARIN (TICCL, frog).
Nederlab will offer a large number of search options with which researchers can find the occurrence of a particular term in a particular corpus or subcorpus. It'll also offer visualization of search results through line graphs, bar graphs, circle graphs, or scatter graphs. Furthermore, this online lab will offer a large set of tools, like tokenization tools, tools for spelling normalization, PoS-tagging tools, lemmatization tools, a computational historical lexicon and indices. Also, the use of (semi-) automatic syntactic parsing, tools for text mining, data mining and sentiment mining, Named Entity Recognition tools, coreference resolution tools, plagiarism detection tools, paraphrase detection tools and cartographical tools is offered
The first version of Nederlab was launched in early 2015, it’ll be expanded until the end of 2017. Nederlab is financed by NWO, KNAW, CLARIAH and CLARIN-NL.

Contacts

Project leader:  prof. dr. Hans Bennis, Meertens Institute
CLARIN center: Meertens Institute
Help contact: hennie.brugman@meertens.knaw.nl

Links

Web-sites: http://www.nederlab.nl/
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.nederlab.nl/onderzoeksportaal/?action=help
Tool/Service link: http://www.nederlab.nl/onderzoeksportaal/
Publications: http://www.nederlab.nl/wp/?page_id=12

Research domain

Cultural Sciences

History

Linguistics

Language

Dutch

Resource tags

data

corpus

text corpus

service

web-application

mono-lingual

Tool task

semantic registry & mapping

analysis

evaluation

annotation

corpus exploration

browse

visualisation

text processing

POS tagging

multiword unit identification

lemmatisation

parsing

co-reference assignment

tokenization

CLARIN centre

Meertens/HuC

Country

Netherlands

ColTime

Erica Renckens — Wed, 21 Jan 2015 12:39:39 +0000

ColTime: Collaboration on Time-Based Resources

Summary

An extension of ELAN and ANNEX for the annotation and display of time‐based resources such as audio and video with a referencing and note exchanging system.

Background

Reference to resources is typically only possible at the metadata session level, but not at the level of a time slice of a larger audio-visual document, let alone at the level of individual annotations. ColTime reduces the granularity of unique references from the document level to the annotation level. As a test case, ColTime's developers focused primarily on online and offline sign language corpora containing annotated video files (EAF document format), but the same technology can be exploited for any type of research that uses audio. ColTime lead to:

The generation of a link reference to sub‐segments of annotation documents in the online browser ANNEX or the offline annotation tool ELAN; the former including a persistent identifier to a document published in a standard archive, the latter including a reference to a document in for instance a sharable Dropbox environment. Units that will be referred to include plain time slices in the media file, and parts of annotation documents such as tiers and individual annotations.
Standardization of the ANNEX visualization service such that it (a) can process PIDs and part identifiers in a standardized way and (b) can be configured as a persistent service as is appropriate for a service that is to be referenced from publications.
The adaptation of the visualisation service of ANNEX for specific purposes as showing examples and counterexamples side by side.
An online service that allows for the creation, search, and exchange of notes that include the type of links mentioned above. The notes receive ISOcat‐based metadata in terms of properties such as author, date, type, purpose, status, and addressee.
Interaction between the note system and ELAN and ANNEX, so that notes can be created, searched for, and modified from within these tools.
Interaction of the above system with (a) mail and existing social media such as Facebook and Twitter, and (b) cloud services such as Dropbox, so as to allow for collaboration on resources that are not yet archived.

Contacts

Project leader: Dr. O.A. Crasborn (Radboud University)  
CLARIN center: Max Planck Institute for Psycholinguistics
Help contact : https://tla.mpi.nl/contact/

Links

Web-sites: http://www.ru.nl/sign-lang/projects/coltime/
User scenario's (screencasts, screenshots):
- Demonstration Scenario
- Screencast
Manual: http://www.mpi.nl/corpus/manuals/manual-elan.pdf
Tool/Service link: https://tla.mpi.nl/tools/tla-tools/elan/
Publications: n.a.

Research domain

Linguistics

Sign language

Language

Multiple languages

Language independent

Resource tags

multi-media/muliti-modal

service

web-application

local tool

Tool task

annotation

CLARIN centre

MPI for Psycholinguistics

Country

Netherlands

EXILSEA

Erica Renckens — Wed, 21 Jan 2015 12:33:44 +0000

EXILSEA: Exploiting ISOcat's Language Sections in ELAN and ANNEX

Summary

Enhancements of the multimedia annotation tool ELAN and the accompanying ANNEX browser for users of different languages with the multilingual features of ISOCAT.

Background

The CLARIN data category system ISOcat offers the possibility to create multiple language sections for names, definitions and descriptions of data categories, English being the only obligatory language. The use of these multilingual functions in ISOcat for the creation of multilingual versions of the corpus metadata and annotations will only be a solution if the tools to annotate multimodal data and to visualise those annotations actually exploit the multilingual features. EXILSEA enhances the multimedia annotation tool ELAN and the accompanying ANNEX browser for this purpose.
This new functionality is being demonstrated for the Corpus NGT (for Sign Language of the Netherlands), which is originally glossed, translated, and annotated in Dutch. Its existing IMDI metadata has been updated to CLARIN-standard CMDI descriptions using bilingual ISOcat categories, and has likewise standardised the Controlled Vocabularies in the annotation files by using references to bilingual ISOcat categories.

Contacts

Project leader:  Dr. O.A. Crasborn (Radboud University)
CLARIN center: Max Planck Institute for Psycholinguistics
Help contact : https://tla.mpi.nl/contact/

Links

Web-sites: http://www.ru.nl/sign-lang/projects/exilsea/
User scenario's (screencasts, screenshots): Screencast
Manual: http://www.mpi.nl/corpus/manuals/manual-elan.pdf
Tool/Service link: https://tla.mpi.nl/tools/tla-tools/elan/
Publications: n.a.

Research domain

Linguistics

Sign language

Language

Multiple languages

Language independent

Resource tags

multi-media/muliti-modal

service

web-application

local tool

multi-lingual

Tool task

annotation

CLARIN centre

MPI for Psycholinguistics

Country

Netherlands

SignLinC

Erica Renckens — Wed, 21 Jan 2015 12:20:57 +0000

SignLinC: Linking lexical databases and annotated corpora of signed

Summary

The core of SignLinC consists of enhancements for LEXUS 3.0 and ELAN 4.0, both released at the start of 2011.

Background

Additions to ELAN include the following:

Addition of a "Lexicon" tab at the top right of the interface. Annotations on a gloss tier can be looked up in a LEXUS lexicon. The user can select which fields from LEXUS to display in the Lexicon tab. (li)The possibility of creating a link to an 'external controlled vocabulary' that is published on a web server, and that can be modified independently of specific EAF files. Displaying and browsing a very long list of items in the pop-up menu that appears when creating an annotation on a tier that is linked to an External Controlled Vocabulary (ECV) is optimised by a number of preference options. At this moment it is not yet possible to generate an ECV from within LEXUS, but this will likely be included in future releases of LEXUS.

ANNEX, the online sibling of ELAN, has been modified independently of the project to allow the creation of URL-style links to segments of annotation files on a server. These links can be included on web pages, power-point presentations, or PDF files. In this way, quick access to published annotations is possible from within lexical resources.

SignLinC links two independently evolved data sets for a signed language: the Corpus NGT and the lexical database of the Dutch Sign Centre. The first is a corpus of video texts that was already fully compliant with CLARIN standards, while the latter is an independently evolved Microsoft SQL database. Both are prototypical for the situation of signed language resources in the world: corpora of running signing have only recently been under development and typically use ELAN as the annotation tool, while lexical databases have typically evolved as standalone applications to produce dictionaries in books or on CD/DVD-ROMs. In order to establish a link in both directions, a conversion of relevant parts of the lexical database to the CLARIN LMF standard for lexica was created for a small test set of lemmata.
The SignLinC project was a collaboration between Radboud University, the Dutch Sign Centre (NGc), and the MPI for Psycholinguistics; it was funded by CLARIN-NL and was completed in 2011.

Contacts

Project leader:  Dr. O.A. Crasborn (Radboud University)
CLARIN center: Max Planck Institute for Psycholinguistics (MPI)
Help contact:

Links

Web-sites: http://www.ru.nl/sign-lang/projects/completed-projects/signlinc/
User scenario's (screencasts, screenshots): http://youtu.be/je3ZKPw6w5s
Manual: Linking to Corpus NGT movies using ANNEX: http://www.ru.nl/publish/pages/515655/signlinc_deliverable_d5_v2.pdf IMDI metadata description of the SignLinC lexicon: http://www.ru.nl/publish/pages/515655/signlinc_deliverable_d3_v2.pdf
Tool/Service link: https://tla.mpi.nl/tools/tla-tools/elan/
Publications: The new ELAN functionality is described in a poster that was presented at the 4th workshop of the Sign Linguistics Corpora Network (SLCN) in Berlin, Dec. 2011 (pdf) http://www.ru.nl/publish/pages/515655/signlinc_slcn4-berlin_poster_v3.pdf

Research domain

Linguistics

Sign language

Language

Dutch Sign Language

Language independent

Resource tags

multi-media/muliti-modal

lexicon

service

web-application

local tool

Tool task

annotation

CLARIN centre

MPI for Psycholinguistics

Country

Netherlands

PaQu

Erica Renckens — Thu, 15 Jan 2015 13:00:04 +0000

PaQu - Parse and Query

Summary

The PaQu web service makes it possible to search in syntactically annotated corpora in Dutch. You can parse your own Dutch text corpus or use one of two corpora provided by the developers.

Background

Please note: This is a preliminary version of this application. Use Lassy (http://dev.clarin.nl/node/1966) for searching the Lassy Treebanks.

PaQu uses the Alpino parser to make treebanks of your own text corpus, and to search in these treebanks using an interface based on the LASSY Word Relations Search interface (http://dev.clarin.nl/node/1966). Two treebanks are already available in the application: Lassy Klein (1M words, manually checked syntactic analysis) and Lassy Groot (700M words, syntactic analysis automatically assigned by Alpino).
PaQu offers two ways to search through the syntactically annotated texts. The first option is to use the search bar to look for word pairs, optionally complemented by their syntactic relationship. The second search option is to use the query language XPath.

Contacts

Project leader: prof.dr. Gertjan van Noord  
Developer: Drs. P. Kleiweg (Groningen University)
CLARIN center: none
Help contact : p.c.j.kleiweg@rug.nl

Links

Web-sites: n.a.
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.let.rug.nl/alfa/paqu/info.html (http://zardoz.service.rug.nl:8067/info.html )
Tool/Service link: http://www.let.rug.nl/alfa/paqu (http://zardoz.service.rug.nl:8067/)
Publications: n.a.

Research domain

Computational Linguistics

Linguistics

Syntax

Language

Dutch

Resource tags

data

corpus

text corpus

service

text processing

mono-lingual

Tool task

annotation

corpus exploration

browse

text processing

grammatical relation assignment

parsing

Country

Netherlands

SHEBANQ

Erica Renckens — Mon, 12 Jan 2015 15:16:13 +0000

SHEBANQ: System for HEBrew Text: ANnotations for Queries and Markup

Summary

A web application that enables researchers to perform linguistic queries on the WIVU Hebrew Text Database and preserve significant results as annotations to this resource. This database contains the Hebrew text of the Old Testament enriched with many linguistic features at the morpheme level up to the discourse level.

Background

The WIVU (Werkgroep Informatica Vrije Universiteit) Hebrew Text Database contains the Biblia Hebraica Stuttgartensia (BHS) version of the text of the Hebrew Bible. Portions of other Semitic languages are included as well: the Aramaic sections of the Old Testament, two Syriac versions, and annotated portions of the Syriac and Aramaic translations. All these texts have been enriched with features that primarily result from linguistic analysis. The database can be queried by means of a language that is optimized to deal with data that is modeled as objects + features. SHEBANQ builds a bridge between the linguistically annotated Hebrew Text corpus and biblical scholars by (1) making this text, including its annotations, available to scholars; (2) demonstrating how queries can function to address research questions; the query saver and the metadata added to them will be a growing repository of valuable best practices of what queries are used in addressing research questions and how they contribute to answering these questions; (3) giving textual scholarship a more empirical basis, by creating the opportunity that claims made in scholarly articles (e.g.: “this syntactic pattern is not attested elsewhere in the Hebrew Bible”) can be accompanied by the unique identifiers that refer to the saved queries that have led to the claim. The WIVU database is a resource under long-term development. New features are being added, new corrections are being made over time.

Contacts

Project leader:  Prof. Dr. W.T. (Wido) van Peursen (VU University)
CLARIN center: Data Archiving and Networked Services (DANS)
Help contact : dirk.roorda@dans.knaw.nl

Links

Web-sites: http://shebanq.ancient-data.org/
User scenario's (screencasts, screenshots): n.a.
Manual: http://shebanq.ancient-data.org/help
Tool/Service link: http://shebanq.ancient-data.org/
Data link: https://easy.dans.knaw.nl/ui/datasets/id/easy-dataset:58245 (Persistent Identifier: urn:nbn:nl:ui:13-048i-71)
Publications:
- Roorda, D. (2015). The Hebrew Bible as Data: Laboratory - Sharing - Experiences http://arxiv.org/abs/1501.01866
- Roorda, D. (2014). LAF-Fabric: a data analysis tool for Linguistic Annotation Framework with an application to the Hebrew Bible, Computational Linguistics in the Netherlands Journal, Volume 4, December 2014, pp. 105-109 http://www.clinjournal.org/sites/default/files/08-Roorda-etal-CLIN2014.pdf and http://arxiv.org/abs/1410.0286