CLARIN-NL - Oral History

Automatic Transcription of Oral History Interviews

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

Automatic Transcription of Oral History Interviews

Description

This webservice and web application uses automatic speech recognition to provide the transcriptions of recordings spoken in Dutch. You can upload and process only one file per project. For bulk processing and other questions, please contact Henk van den Heuvel at h.vandenheuvel@let.ru.nl.

Project

unknown

CLARIN National Project

CLARIAH-CORE

CLARIN centre

none yet

Research domain

Oral History

Political Studies

Tool task

speech recognition

diarization

Country

Netherlands

Input Language

Dutch

Version

v0.1

Access Contact

Henk van den Heuvel

Project Contact

/mailto:/

Creator Contact

Henk van den Heuvel

Emre Yılmaz

Documentation

Iris Hendrickx, Antal van den Bosch, Maarten van Gompel, Ko van der Sloot, Walter Daelemans. 2016.Frog: An Natural Language Processing suite for Dutch. CLST Technical Report 16-02.

Webservice Specification

readme

issueTracker

Source code

https://github.com/schemreier/oralhistory

Resource

CMDI File Link

License

unknown

Inventory Scope

local

TTNWW

root — Mon, 08 Apr 2019 08:38:55 +0000

Title

TTNWW - TST Tools for the Dutch Language as Web services in a Workflow

Description

TTNWW integrates and makes available existing Language Technology (LT) software components for the Dutch language that have been developed in the STEVIN and CGN projects. The LT components (for text and speech) are made available as web-services in a simplified workflow system that enables researchers without much technical background to use standard LT workflow recipes. The web services are available in two separate domains: "Text" and "Speech" processing. For "Text", workflows for the following functionality is offered by TTNWW: - Orthographic Normalisation using TICCLops (version CLARIN-NL 1.0); - Part of Speech Tagging, Lemmatisation, Chunking, limited Multiword Unit Recognition, and Grammatical Relation Assignment by Frog (Version 012.012); - Syntactic Parsing (including grammatical relation assignment, limited named entity recognition, and limited multiword unit recognition) by the Alpino Parser (version 1.3); - Semantic Annotation; - Named Entity Recognition; - Co-reference Assignment. For "Speech", the following workflows are offered: - Automatic Transcription of speech files using a Netherlands Dutch acoustic model; - Automatic Transcription of speech files using a Flemish Dutch acoustic model; - Conversion of the input speech file to the required sampling rate, followed by automatic transcription. The TTNWW services have been created in a Dutch and Flemish collaboration project building on the results of past Dutch and Flemish projects. The web services are partly deployed in the SURF-SARA BiG-Grid cloud or at CLARIN centres in the Netherlands and at CLARIN VL University partners. The architecture of the TTNWW portal consists out of several components and follows the principles of Service Oriented Architecture (SOA). The TTNWW GUI front-end is a Flex module that communicates with the TTNWW web-application which keeps track of the different sessions and knows which LT recipes are available. TTNWW communicates assigments (workflow specifications) to the WorkflowService that evaluates the requested workflow and requests the DeploymentSevice to start the required LT web-services. After initialization of the LT web-services, the workflow specification is sent to the Taverna Server, that takes further care of the workflow. To facilitate the process of wrapping applications that were originally designed as standalone applications into web services, the CLAM (Computational Linguistics Application Mediator) wrapper software allows for easy and transparent transformation of applications into RESTful web services. The CLAM software has extensively been used in the TTNWW project for both text and speech processing tools. With the exception of Alpino and MBSRL all web services work operate on CLAM wrappers. Given the number of web services involved in the TTNWW project and possibilities offered by the cloud environment the preferred method of delivering the web service installations was delivery of complete virtual machine images by the LT providers. These could be directly uploaded into the cloud environment and thus relieving the CLARIN centres nd LT providers from the original foreseen task of running the webservices themselves. A potential advantage of this method, that has not been exploited in the project yet, is that these images may be also be delivered directly to the end user so these can be run in a local configuration using virtualization software such as VMWare of VirtualBox. The workflow engine used in the project was Taverna. But build on top of this was a a number of selectable task recipes, following a task oriented approach in line with the premises that users with no or little technical expertise should be able to use the system. In this context, tasks are understood in terms of end results of processes such as semantic role labelling, pos tagging or syntactic analysis and ready-made workflows are constructed that can be readily used by the end user.

Project

TTNWW

CLARIN National Project

CLARIN-NL

CLARIN centre

Meertens/HuC

Research domain

Linguistics

Communication and Media Studies

History

Oral History

Linguistic Subject

discourse analysis

Orthography

Semantics

Syntax

Tool task

grammatical relation assignment

coreference resolution

corpus processing

dependency parsing

lemmatisation

multiword unit identification

named entity recognition

orthographic normalisation

part of speech tagging

semantic role labeling

chunking

parsing

speech recognition

speech transcription

tokenisation

up/down sampling

Country

Netherlands

Tool Type

web application

Research Phase

Enriching Data

Tool status

withdrawn

Input format

text/plain

audio/wav

Output format

text/xml

Input Language

Dutch

Access Contact

Daan Broeder

Project Contact

/mailto:Daan.Broeder@meertens.knaw.nl/

Creator Contact

/mailto:Daan.Broeder@meertens.knaw.nl/

Documentation

TTNWW handleiding

Source code

not specified

Original source

http://portal.clarin.nl/node/1964

Publications

Kemps-Snijders, M, Schuurman, I, Daelemans, W, Demuynck, K, Desplanques, B, Hoste, V, Huijbregts, M, Martens, J-P, Paulussen, H, Pelemans, J, Reynaert, M, Vandeghinste, V, van den Bosch, A, van denHeuvel, H, van Gompel, M, van Noord, G and Wambacq, P. 2017. TTNWW to the Rescue: No Need to Know How to Handle Tools and Resources. In: Odijk, J and van Hessen, A. (eds.) CLARIN in the Low Countries, Pp. 83–93. London: Ubiquity Press. DOI: https://doi.org/10.5334/bbi.7. License: CC-BY 4.0

Resource

CMDI File Link

License

unknown

Inventory Scope

local

ANNEX

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

Web-based Annotation Explorer

Description

Annex (Annotation Explorer) is a web-based tool for exploring and viewing annotated multimedia recordings in an archive. ANNEX can play audio and video files in a web browser along with annotations in a variety of formats: ELAN (EAF), Shoebox/Toolbox text, CHAT (CHILDES annotation format), Plain text, CSV, PDF, SubRip, Praat TextGrid, HTML and XML. Annex will visualise the annotations in synchrony with the media files as long as time-alignment information is available. If no time-alignment information is available, a default segment duration is assumed. Annex has a graphical interface that resembles the interface of the ELAN annotation tool to some extent, with a number of different view modes such as subtitle view, timeline view and grid view. Annex runs in any modern web browser with the Adobe Flash plugin (> version 10) installed. ANNEX has been functionally extended with the help of the following CLARIN-NL-funded projects: - ColTime: Collaboration on Time-Based Resources. - EXILSEA: Exploiting ISOcat's Language Sections in ELAN and ANNEX. - MultiCon: Multilayer Concordance Functions in ELAN and ANNEX. - SignLinC: Linking lexical databases and annotated corpora of signed languages. Over the years, many funders have contributed to the development of ANNEX in several projects, such as the Volkswagen Foundation, the Royal Netherlands Academy of Arts and Sciences, the Berlin-Brandenburg Academy of Sciences and Humanities, the German Federal Ministry of Education and Research and the the Max Planck Society.

Project

The Language Archive

DOBES

ColTime

EXILSEA

MultiCon

SignLinC

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Research domain

Cultural Sciences

Oral History

Linguistics

Linguistic Subject

general linguistics

Sign language

language acquisition

psycholinguistics

anthropological linguistics

discourse analysis

Language Documentation

Morpho-syntax

text and corpus linguistics

Tool task

alignment

morphosyntactic tagging

part of speech tagging

phonetic annotation

analysis

speech transcription

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

retired

Input Language

Language independent

Version

1.6

Access Contact

/mailto:tla@mpi.nl/

Project Contact

O.A. Crasborn

/mailto:/

Creator Contact

/mailto:tla@mpi.nl/

Documentation

ANNEX Manual

ANNEX Online Manual

ANNEX Flyer

ANNEX A4 Guide

Source code

not specified

Original source

http://portal.clarin.nl/node/4188

http://portal.clarin.nl/node/4187

http://portal.clarin.nl/node/1941

http://portal.clarin.nl/node/4186

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

Oral History Annotation Tool

root — Mon, 08 Apr 2019 08:38:48 +0000

Description

The Oral History Annotation tool, developed by the Centre for Language and Speech Technology (CLST) at the Radboud University Nijmegen, enables one to annotate and search in oral history resources. The tool has been used to enrich a corpus of 250 interviews from the Living Oral History Workbench with commentary . All 250 interviews are searchable through a fragment finder and can be annotated. These annotations can be shared with other researchers, making the interviews available and easier accessible for a much wider range of researchers in the humanities in general and in linguistics in particular. The Annotation Tool is only available for scientific research and only after approval by the Veterans Institute. Interview data can be used in a number of ways, such as comparative research, restudy or follow-up study, re-analysis / secondary analysis, research design and methodological advancement, replication and validation of published work, and for teaching and learning. Recent experiences with the re-use of interview data show that there is an enormous potential for this type of data. Especially in the field of interview data related to the Second World War and other military conflicts multidisciplinary research is carried out. This corpus consists of (about) 30 interviews that are fully transcribed from the Veteran Tapes VP project, and 250 interviews resulting from the Living Oral History Workbench project: - 120 World War II interviews presenting a range of experiences and frames of reference of Dutch soldiers between 1935-1945; - 100 interviews with veterans of the Dutch East Indies. This collection exhibits a large diversity in experiences at the local level in guerilla warfare; - 30 interviews with veterans of New Guinea. This is a relatively unknown conflict with very interesting elements (soldiers left in uncertainty and isolation, and the pressure of the international community to decolonize the area). Each interview lasts between 1 and 1.5 hours.

Project

INTER-VIEWs

CLARIN National Project

CLARIN-NL

CLARIN centre

DANS

Research domain

History

Oral History

Tool task

corpus searching

other

Country

Netherlands

Tool Type

web application

Research Phase

Browsing and Searching

Tool status

published

Input Language

Dutch

Access Contact

Project Contact

Dr Henk van den Heuvel

Creator Contact

Dr Henk van den Heuvel

Documentation

Manual Oral History Annotation Tool

Source code

not specified

Original source

http://portal.clarin.nl/node/1915

Resource

CMDI File Link

License

unknown

Inventory Scope

local

ELAN

root — Mon, 08 Apr 2019 08:38:48 +0000

Title

ELAN Multimedia Annotator

Description

ELAN is a professional tool for the creation of complex annotations on video and audio resources. With ELAN a user can add an unlimited number of annotations to audio and/or video streams. An annotation can be a sentence, word or gloss, a comment, translation or a description of any feature observed in the media. Annotations can be created on multiple layers, called tiers. Tiers can be hierarchically interconnected. An annotation can either be time-aligned to the media or it can refer to other existing annotations. The textual content of annotations is always in Unicode and the transcription is stored in an XML format. ELAN provides several different views on the annotations, each view is connected and synchronized to the media playhead. Up to 4 video files can be associated with an annotation document. Each video can be integrated in the main document window or displayed in its own resizable window. ELAN delegates media playback to an existing media framework, like Windows Media Player, QuickTime or JMF (Java Media Framework). As a result a wide variety of audio and video formats is supported and high performance media playback can be achieved. ELAN is written in the Java programming language and the sources are available for non-commercial use. It runs on Windows, Mac OS X and Linux. ELAN has been functionally extended with the help of the following CLARIN-NL-funded projects: - ColTime: Collaboration on Time-Based Resources. - EXILSEA: Exploiting ISOcat's Language Sections in ELAN and ANNEX. - MultiCon: Multilayer Concordance Functions in ELAN and ANNEX. - SignLinC: Linking lexical databases and annotated corpora of signed languages. Over the years, many funders have contributed to the development of ELAN in several projects, such as the Volkswagen Foundation, the Royal Netherlands Academy of Arts and Sciences, the Berlin-Brandenburg Academy of Sciences and Humanities, the German Federal Ministry of Education and Research, the Max Planck Society and the ARC Centre of Excellence for the Dynamics of Language.

Project

The Language Archive

DOBES

ColTime

EXILSEA

MultiCon

SignLinC

COEDL

CLARIN National Project

CLARIN-NL

CLARIN centre

MPI for Psycholinguistics

Research domain

Linguistics

Cultural Sciences

Oral History

Linguistic Subject

general linguistics

Sign language

language acquisition

psycholinguistics

anthropological linguistics

discourse analysis

Language Documentation

Morpho-syntax

text and corpus linguistics

Tool task

speech transcription

phonetic annotation

morphosyntactic tagging

part of speech tagging

alignment

analysis

audio-visual processing

Country

Netherlands

Tool Type

local desktop

Research Phase

Enriching Data

Tool status

released

Input Language

Language independent

Access Contact

/mailto:tla@mpi.nl/

Project Contact

O.A. Crasborn

/mailto:/

/mailto:coedl@anu.edu.au/

Creator Contact

/mailto:tla@mpi.nl/

Documentation

ELAN - user Guide

ELAN - Online User Guide

ELAN - Linguistic Annotator Manual

ELAN - Linguistic Annotator Online Manual

ELAN - Media Encoding Guideliens

Source code

not specified

Original source

http://portal.clarin.nl/node/4188

http://portal.clarin.nl/node/4187

http://portal.clarin.nl/node/1941

http://portal.clarin.nl/node/4186

Resource

CMDI File Link

License

GNU GPL

Inventory Scope

local

INTER-VIEWS Data

root — Sun, 25 Jan 2015 17:41:24 +0000

INTER-VIEWs: Curation of Interview Data

Summary

Background

Interview data can be used in a number of ways, such as comparative research, restudy or follow-up study, re-analysis / secondary analysis, research design and methodological advancement, replication and validation of published work, and for teaching and learning. Recent experiences with the re-use of interview data show that there is an enormous potential for this type of data. Especially in the field of interview data related to the Second World War and other military conflicts multidisciplinary research is carried out. This corpus consists of (about) 30 interviews that are fully transcribed from the Veteran Tapes VP project, and 250 interviews resulting from the Living Oral History Workbench project:
- 120 World War II interviews presenting a range of experiences and frames of reference of Dutch soldiers between 1935-1945.
- 100 interviews with veterans of the Dutch East Indies. This collection exhibits a large diversity in experiences at the local level in guerilla warfare.
- 30 interviews with veterans of New Guinea. This is a relatively unknown conflict with very interesting elements (soldiers left in uncertainty and isolation, and the pressure of the international community to decolonize the area). Each interview lasts between 1 and 1.5 hours.

Contacts

Project leader:  Dr Henk van den Heuvel (Nijmegen University)
CLARIN center: Data Archiving and Networking Services (DANS)
Help contact : http://www.watveteranenvertellen.nl/annotationtool/signup.php (Request account)

Links

Web-sites: http://www.watveteranenvertellen.nl/annotationtool/
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.watveteranenvertellen.nl/annotationtool/?p=manual (Dutch)
Tool/Service link: http://www.watveteranenvertellen.nl/annotationtool/
Data link (VLO): http://catalog.clarin.eu/vlo/search?q=IPNV&fq=languageCode:code:nld
Publications: Heuvel, H. van den, Sanders, E., Rutten, R., Scagliola, S. and Witkamp, P. (2012), "An Oral History Annotation Tool for INTER-VIEWs". In Calzolari, N., Choukri, K., Declerck, T. , Doğan, M.U., Maegaard, B., Mariani, J., Odijk, J. and Piperidis, S. (eds.), Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12). Istanbul, Turkey: European Language Resources Association (ELRA), pp. 215-218.

Metadata fro this project/data-set available from RU, data is hosted at DANS (established DBroeder 2-11-2020)

Country

Netherlands

CLARIN centre

DANS

Language

Dutch

Research domain

History

Oral History

Linguistics

Discourse

Resource tags

data

corpus

multi-media/muliti-modal

mono-lingual

Annotations

Orthographic Transcription

Format

Textual data

XML

IPNV

root — Fri, 03 Oct 2014 08:58:14 +0000

IPNV - Interview Project Dutch Veterans

Summary

The IPNV data set contains the public part of a collection of interviews collected by the Dutch Veteran Institute. They contain stories covering almost all conflicts and military missions where the Netherlands were involved. The public part of this collection of about 500 interviews was made available via the internet the non-public part. For CLARIN the data was curated by the DCS (http://dev.clarin.nl/node/1963) in May 2013.

Background

The IPNV Corpus is a corpus originally compiled by the Veteraneninstituut (VI). It comprises a collection of more than 1100 (recorded) interviews with veterans who were involved in wars and other military actions that the Dutch military forces took part in. The average duration of an interview is 2.5 hours. Most interviews are with veterans of World War II, the decolonization wars with Indonesia and New Guinea, the UN action in Korea, the UN observe mission in Lebanon, UN missions in Cambodia and former Yugoslavia, and the NATO missions in Iraq and Aghanistan. Some 100 interviews are with veterans who were involved in small-scale observation, monitoring and humanitarian missions. In the INTER-VIEWs project (http://dev.clarin.nl/node/1915) 246 of the interviews were curated: the audio recordings (in WAV format) of the interviews were transferred to DANS and the metadata were made available in CMDI/ISOcat format. The data and metadata can be accessed through the EASY system.

Contacts

CLARIN center: DANS
Help contact : n.a.

Links

Web-sites: Veteran Institute project website, DANS/VI website
Manual: DCS curation report
Data link (VLO): DANS Archive
Publications: n.a.

Country

Netherlands

CLARIN centre

DANS

Language

Dutch

Research domain

History

Oral History

Resource tags

data

corpus

multi-media/muliti-modal

Annotations

Linguistic Annotation

Orthographic

Orthographic Transcription

Format

Media data

wav

TTNWW

root — Sun, 15 Jun 2014 13:01:54 +0000

TTNWW - TST Tools voor het Nederlands als Webservices in een Workflow

Summary

Background

The web services are available in two separate domains: "Text" and "Speech" processing. For "Text", workflows for the following functionality is offered by TTNWW:

Orthographic Normalisation using TICCLops (version CLARIN-NL 1.0)
Part of Speech Tagging, Lemmatisation, Chunking, limited Multiword Unit Recognition, and Grammatical Relation Assignment by Frog (Version 012.012)
Syntactic Parsing (including grammatical relation assignment, limited named entity recognition, and limited multiword unit recognition) by the Alpino Parser (version 1.3)
Semantic Annotation
Named Entity Recognition
Co-reference Assignment

For "Speech", the following workflows are offered:

Automatic Transcription of speech files using a Netherlands Dutch acoustic model
Automatic Transcription of speech files using a Flemish Dutch acoustic model
Conversion of the input speech file to the required sampling rate, followed by automatic transcription

The TTNWW services have been created in a Dutch and Flemish collaboration project building on the results of past Dutch and Flemish projects. The web services are partly deployed in the SURF-SARA BiG-Grid cloud or at CLARIN centres in the Netherlands and at CLARIN VL University partners.

The architecture of the TTNWW portal consists out of several components and follows the principles of Service Oriented Architecture (SOA). The TTNWW GUI front-end is a Flex module that communicates with the TTNWW web-application which keeps track of the different sessions and knows which LT recipes are available. TTNWW communicates assigments (workflow specifications) to the WorkflowService that evaluates the requested workflow and requests the DeploymentSevice to start the required LT web-services. After initialization of the LT web-services, the workflow specification is sent to the Taverna Server, that takes further care of the workflow.

To facilitate the process of wrapping applications that were originally designed as standalone applications into web services, the CLAM (Computational Linguistics Application Mediator) wrapper software allows for easy and transparent transformation of applications into RESTful web services. The CLAM software has extensively been used in the TTNWW project for both text and speech processing tools. With the exception of Alpino and MBSRL all web services work operate on CLAM wrappers.

Given the number of web services involved in the TTNWW project and possibilities offered by the cloud environment the preferred method of delivering the web service installations was delivery of complete virtual machine images by the LT providers. These could be directly uploaded into the cloud environment and thus relieving the CLARIN centres nd LT providers from the original foreseen task of running the webservices themselves. A potential advantage of this method, that has not been exploited in the project yet, is that these images may be also be delivered directly to the end user so these can be run in a local configuration using virtualization software such as VMWare of VirtualBox.

The workflow engine used in the project was Taverna. But build on top of this was a a number of selectable task recipes, following a task oriented approach in line with the premises that users with no or little technical expertise should be able to use the system. In this context, tasks are understood in terms of end results of processes such as semantic role labelling, pos tagging or syntactic analysis and ready-made workflows are constructed that can be readily used by the end user. Contacts

Project leader: Marc Kemps-Snijders (NL), Ineke Schuurman (VL)  
CLARIN center: Meertens Institute (portal) and others (web-services).
Help contact : n.a.

Links

Web-sites: n.a.
User scenario's (screencasts, screenshots): n.a.
Manual: http://yago.meertens.knaw.nl/apache/TTNWW/assets/TTNWW.pdf
Tool/Service link: http://yago.meertens.knaw.nl/apache/TTNWW/
Publications: n.a.

Research domain

Communication & Media Studies

History

Oral History

Linguistics

Morpho-syntax

Orthography

Discourse

Semantics

Syntax

Language

Dutch

Resource tags

service

speech processing

text processing

web-application

web-service

Tool task

parsing

audio-visual processing

speech recognition

speech transcription

up/down sampling

text processing

chunking

co-reference assignment

grammatical relation assignment

multiword unit identification

orthographic normalisation

POS tagging

tokenization

lemmatisation

NE recognition

CLARIN centre

Meertens/HuC

Country

Netherlands

INTER-VIEWS

root — Sun, 20 Apr 2014 14:46:21 +0000

INTER-VIEWs: Curation of Interview Data

Summary

A corpus of 250 interviews from the Living Oral History Workbench enriched with commentary in the Oral History Annotation tool, developed by the Centre for Language and Speech Technology (CLST) at the Radboud University Nijmegen. All 250 interviews are searchable through a fragment finder and can be annotated. These annotations can be shared with other researchers, making the interviews available and easier accessible for a much wider range of researchers in the humanities in general and in linguistics in particular. The Annotation Tool is only available for scientific research and only after approval by the Veterans Institute.

Background

Contacts

Project leader:  Dr Henk van den Heuvel (Nijmegen University)
CLARIN center: Data Archiving and Networking Services (DANS)
Help contact : http://www.watveteranenvertellen.nl/annotationtool/signup.php (Request account)

Links

Web-sites: http://www.watveteranenvertellen.nl/annotationtool/
User scenario's (screencasts, screenshots): n.a.
Manual: http://www.watveteranenvertellen.nl/annotationtool/?p=manual (Dutch)
Tool/Service link: http://www.watveteranenvertellen.nl/annotationtool/annotationtool/
Publications: Heuvel, H. van den, Sanders, E., Rutten, R., Scagliola, S. and Witkamp, P. (2012), "An Oral History Annotation Tool for INTER-VIEWs". In Calzolari, N., Choukri, K., Declerck, T. , Doğan, M.U., Maegaard, B., Mariani, J., Odijk, J. and Piperidis, S. (eds.), Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC'12). Istanbul, Turkey: European Language Resources Association (ELRA), pp. 215-218.

Research domain

History

Oral History

Linguistics

Discourse

Language

Dutch

Resource tags

data

corpus

multi-media/muliti-modal

mono-lingual

Tool task

annotation

CLARIN centre

DANS

Country

Netherlands