TQE




TQE: Transcription Quality Evaluation

Summary

The Transcription Quality Evaluation tool can be used to check the quality of phonetic transcription. The only thing the researcher has to do is upload pairs of files consisting of an audio file and a transcription file. After uploading he’ll receive an e-mail with the matching output.

Background

The Transcription Quality Evaluation (TQE) tool is an instrument that automatically evaluates the quality of phonetic transcriptions. The application makes it possible to upload pairs of files consisting of an audio file and a transcription file and process them as follows: the audio signal and the phonetic transcription are aligned, segment boundaries are derived for each phone, and for each segment-phone combination it is determined how well they fit together, i.e. for each phone a TQE measure (a confidence measure) is determined, a number ranging from 0-100%, indicating how good the fit is, i.e. the quality of the phone transcription. The higher the number, the better the fit. The output of the TQE tool consists of a TQE measure and the segment boundaries for each phone in the corpus.
The TQE tool thus makes it possible to find (sequences of) segments for which the match of the phone symbols with the audio signal is not optimal, in other words, the TQE tool can be used to check the quality of phonetic transcriptions. This can be useful for validating (manual) phonetic transcriptions, but also to compare and select (‘competing’) transcriptions, e.g. to study pronunciation variation. The TQE tool can thus be usefully applied in all research – in various (sub-) fields of humanities and language and speech technology (L&ST) – in which audio and phonetic transcriptions are involved.

Contacts Links

Research domain

Speech recognition
Linguistics
Phonetics

Language

Language independent

Resource tags

service
speech processing
web-application

Tool task

evaluation
annotation

CLARIN centre

MPI for Psycholinguistics

Country

Netherlands