CLARIN-NL - audio-visual processing

ELAN

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

ELAN Multimedia Annotator

Description

ELAN is a professional tool for the creation of complex annotations on video and audio resources. With ELAN a user can add an unlimited number of annotations to audio and/or video streams. An annotation can be a sentence, word or gloss, a comment, translation or a description of any feature observed in the media. Annotations can be created on multiple layers, called tiers. Tiers can be hierarchically interconnected. An annotation can either be time-aligned to the media or it can refer to other existing annotations. The textual content of annotations is always in Unicode and the transcription is stored in an XML format. ELAN provides several different views on the annotations, each view is connected and synchronized to the media playhead. Up to 4 video files can be associated with an annotation document. Each video can be integrated in the main document window or displayed in its own resizable window. ELAN delegates media playback to an existing media framework, like Windows Media Player, QuickTime or JMF (Java Media Framework). As a result a wide variety of audio and video formats is supported and high performance media playback can be achieved. ELAN is written in the Java programming language and the sources are available for non-commercial use. It runs on Windows, Mac OS X and Linux. ELAN has been functionally extended with the help of the following CLARIN-NL-funded projects: - ColTime: Collaboration on Time-Based Resources. - EXILSEA: Exploiting ISOcat's Language Sections in ELAN and ANNEX. - MultiCon: Multilayer Concordance Functions in ELAN and ANNEX. - SignLinC: Linking lexical databases and annotated corpora of signed languages. Over the years, many funders have contributed to the development of ELAN in several projects, such as the Volkswagen Foundation, the Royal Netherlands Academy of Arts and Sciences, the Berlin-Brandenburg Academy of Sciences and Humanities, the German Federal Ministry of Education and Research, the Max Planck Society and the ARC Centre of Excellence for the Dynamics of Language.

Project

The Language Archive

DOBES

ColTime

EXILSEA

MultiCon

SignLinC

COEDL

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

released

Input Language

Language independent

Access Contact

/mailto:tla@mpi.nl/

Project Contact

O.A. Crasborn

/mailto:/

/mailto:coedl@anu.edu.au/

Creator Contact

/mailto:tla@mpi.nl/

Documentation

ELAN - user Guide

ELAN - Online User Guide

ELAN - Linguistic Annotator Manual

ELAN - Linguistic Annotator Online Manual

ELAN - Media Encoding Guideliens

Source code

not specified

Original source

http://portal.clarin.nl/node/4188

http://portal.clarin.nl/node/4187

http://portal.clarin.nl/node/1941

http://portal.clarin.nl/node/4186

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

AAM-LR

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Automatic Annotation of Multi-modal Language Resources

Description

The AAM-LR project provides a web service that helps field researchers to annotate audio- and video-recordings. At the top level the service marks the time intervals at which specific persons in the recording are speaking. In addition, the service provides a global phonetic annotation, using language independent phone models and phonetic features. Speech is separated from speaker noises such as laughing. Note: this service has been withdrawn and the URLs and PID do not resolve anymore!

Project

AAM-LR

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Research domain

Linguistics

Linguistic Subject

general linguistics

Language Documentation

Tool task

audio-visual processing

diarization

Country

Netherlands

Tool Type

web service

Research Phase

Enriching Data

Tool status

withdrawn

Output format

text/xml

Input Language

Language independent

Access Contact

/mailto:/

Project Contact

Em. prof. dr. Lou Boves

Creator Contact

/mailto:/

Documentation

Web service metadata

Source code

not specified

Original source

http://portal.clarin.nl/node/1909

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

TTNWW

root — Sun, 15 Jun 2014 13:01:54 +0000

TTNWW - TST Tools voor het Nederlands als Webservices in een Workflow

Summary

TTNWW integrates and makes available existing Language Technology (LT) software components for the Dutch language that have been developed in the STEVIN and CGN projects. The LT components (for text and speech) are made available as web-services in a simplified workflow system that enables researchers without much technical background to use standard LT workflow recipes.

Background

The web services are available in two separate domains: "Text" and "Speech" processing. For "Text", workflows for the following functionality is offered by TTNWW:

Orthographic Normalisation using TICCLops (version CLARIN-NL 1.0)
Part of Speech Tagging, Lemmatisation, Chunking, limited Multiword Unit Recognition, and Grammatical Relation Assignment by Frog (Version 012.012)
Syntactic Parsing (including grammatical relation assignment, limited named entity recognition, and limited multiword unit recognition) by the Alpino Parser (version 1.3)
Semantic Annotation
Named Entity Recognition
Co-reference Assignment

For "Speech", the following workflows are offered:

Automatic Transcription of speech files using a Netherlands Dutch acoustic model
Automatic Transcription of speech files using a Flemish Dutch acoustic model
Conversion of the input speech file to the required sampling rate, followed by automatic transcription

The TTNWW services have been created in a Dutch and Flemish collaboration project building on the results of past Dutch and Flemish projects. The web services are partly deployed in the SURF-SARA BiG-Grid cloud or at CLARIN centres in the Netherlands and at CLARIN VL University partners.

The architecture of the TTNWW portal consists out of several components and follows the principles of Service Oriented Architecture (SOA). The TTNWW GUI front-end is a Flex module that communicates with the TTNWW web-application which keeps track of the different sessions and knows which LT recipes are available. TTNWW communicates assigments (workflow specifications) to the WorkflowService that evaluates the requested workflow and requests the DeploymentSevice to start the required LT web-services. After initialization of the LT web-services, the workflow specification is sent to the Taverna Server, that takes further care of the workflow.

To facilitate the process of wrapping applications that were originally designed as standalone applications into web services, the CLAM (Computational Linguistics Application Mediator) wrapper software allows for easy and transparent transformation of applications into RESTful web services. The CLAM software has extensively been used in the TTNWW project for both text and speech processing tools. With the exception of Alpino and MBSRL all web services work operate on CLAM wrappers.

Given the number of web services involved in the TTNWW project and possibilities offered by the cloud environment the preferred method of delivering the web service installations was delivery of complete virtual machine images by the LT providers. These could be directly uploaded into the cloud environment and thus relieving the CLARIN centres nd LT providers from the original foreseen task of running the webservices themselves. A potential advantage of this method, that has not been exploited in the project yet, is that these images may be also be delivered directly to the end user so these can be run in a local configuration using virtualization software such as VMWare of VirtualBox.

The workflow engine used in the project was Taverna. But build on top of this was a a number of selectable task recipes, following a task oriented approach in line with the premises that users with no or little technical expertise should be able to use the system. In this context, tasks are understood in terms of end results of processes such as semantic role labelling, pos tagging or syntactic analysis and ready-made workflows are constructed that can be readily used by the end user. Contacts

Project leader: Marc Kemps-Snijders (NL), Ineke Schuurman (VL)  
CLARIN center: Meertens Institute (portal) and others (web-services).
Help contact : n.a.

Links

Web-sites: n.a.
User scenario's (screencasts, screenshots): n.a.
Manual: http://yago.meertens.knaw.nl/apache/TTNWW/assets/TTNWW.pdf
Tool/Service link: http://yago.meertens.knaw.nl/apache/TTNWW/
Publications: n.a.

Research domain

Communication & Media Studies

History

Oral History

Linguistics

Morpho-syntax

Orthography

Discourse

Semantics

Syntax

Language

Dutch

Resource tags

service

speech processing

text processing

web-application

web-service

Tool task

parsing

audio-visual processing

speech recognition

speech transcription

up/down sampling

text processing

chunking

co-reference assignment

grammatical relation assignment

multiword unit identification

orthographic normalisation

POS tagging

tokenization

lemmatisation

NE recognition

CLARIN centre

Meertens/HuC

Country

Netherlands

AAM-LR

root — Mon, 14 Apr 2014 18:05:02 +0000

AAM-LR: Automatic Annotation of Multi-modal Language Resources

Summary
The AAM-LR web service helps researchers to annotate audio and video recordings. At the top level the service marks the time intervals at which specific persons in the recording are speaking. In addition, the service provides a global phonetic annotation, using language independent phone models and phonetic features. Speech is separated from speaker noises such as laughing. The output of the web service is fed into the ELAN/ANNEX editor, to facilitate further manual annotation. The annotations conform to ISOCat and potential new categories were added to ISOCat.

Background
Analyzing large amounts of field work recordings is prohibitively time consuming and expensive. As a consequence, there is a rapidly growing pile of data that does exist, but that is practically impossible to use. It is estimated that by the year 2020 more than 90% of the field work recordings will be sitting unused in archives, unless automatic tools for annotating the data can be made available. Given the cost of the field work and making the recordings in the first place, the lack of efficient tools for processing the data is especially awkward. While the AAM-LR tool will not provide fully automatic analysis of the field work corpora, they will certainly reduce the time needed for making linguistic analysis by several orders of magnitude, thereby bringing effective usage of the data within the realm of what is feasible. Thus, the AAM-LR tools will not help with respect to a specific research question, but they will improve the working environment for linguists working in areas of language contact, language typology, language and cognition and many other sub-disciplines. The AAM-LR tools will also make fieldwork recordings accessible for other types of humanities research. [site:mail]

Contacts

Project leader:  Em. prof. dr. Lou Boves (Radboud University)
CLARIN center : Max Planck Institute for Psycholinguistics
Help contact : http://tla.mpi.nl/contact/

Web-site s: n.a.
User scenario's: n.a.
Manual : n.a.
Tool/Service link: 
- http://catalog.clarin.eu/aamlr/
- http://hdl.handle.net/1839/00-SERV-0000-0000-004F-F
Publications: Prawiro-Atmodjo, P., L. ten Bosch, 2010. Report on the AAM-LR project. RU NL-CLARIN report, RU Nijmegen. (Includes AAM-LR ISOCAT extension proposal.)