• search hit 6 of 12
Back to Result List

Open Source Automatic Lecture Subtitling

  • We present a fully automatic solution for German video subtitling, with a focus on lecture videos. We rely entirely on open source models and scripts for German ASR, automatic punctuation reconstruction and subtitle segmentation. All training scripts, 1000h of German speech training data, pre-trained models and the final subtitling program are publicly available. It can readily be integrated into lecture video platforms such as Lecture2Go. The automatically generated subtitles can also serve as a basis to make the video material more accessible (e.g. via search, keyword clouds, and the like) or for further manual revision, potentially helping in significantly speeding up manual work. A particular challenge that we observe in lectures are technical terms that are frequent in a particular lecture, but infrequent in a typical language model and that might be out of vocabulary for a general purpose ASR. We approach this challenge by extracting texts from accompanying lecture slides to adapt the language model of our TDNN-HMM based ASR system. We demonstrate the usability of the full system and its generated subtitles and evaluate on a dataset of manually transcribed lectures with an average of 26.3% WER.

Export metadata

Additional Services

Share in Twitter Search Google Scholar Statistics
Metadaten
Author:Benjamin Milde, Robert Geislinger, Irina Lindt, Timo BaumannORCiDGND
URN:urn:nbn:de:gbv:18-228-7-2523
URL / DOI:https://www.essv.de/pdf/2021_128_135.pdf?id=1109
Parent Title (English):Proceedings of Elektronische Sprachsignalverarbeitung (ESSV): Tagungsband der 32. Konferenz, Berlin, 3.-5. März 2021
Publisher:Förderverein Elektronische Sprachsignalverabeitung e.V.
Place of publication:Berlin, Germany
Document Type:conference proceeding (article)
Language:English
Year of first Publication:2021
Release Date:2022/04/09
Tag:Untertitelung; automatische Spracherkennung; freie Software
First Page:128
Last Page:135
Institutes:Fakultät Informatik und Mathematik
Begutachtungsstatus:peer-reviewed
Publication:Externe Publikationen
research focus:Information und Kommunikation
Licence (German):Keine Lizenz - Es gilt das deutsche Urheberrecht: § 53 UrhG