TY - CHAP A1 - Milde, Benjamin A1 - Geislinger, Robert A1 - Lindt, Irina A1 - Baumann, Timo T1 - Open Source Automatic Lecture Subtitling T2 - Proceedings of Elektronische Sprachsignalverarbeitung (ESSV): Tagungsband der 32. Konferenz, Berlin, 3.-5. März 2021 N2 - We present a fully automatic solution for German video subtitling, with a focus on lecture videos. We rely entirely on open source models and scripts for German ASR, automatic punctuation reconstruction and subtitle segmentation. All training scripts, 1000h of German speech training data, pre-trained models and the final subtitling program are publicly available. It can readily be integrated into lecture video platforms such as Lecture2Go. The automatically generated subtitles can also serve as a basis to make the video material more accessible (e.g. via search, keyword clouds, and the like) or for further manual revision, potentially helping in significantly speeding up manual work. A particular challenge that we observe in lectures are technical terms that are frequent in a particular lecture, but infrequent in a typical language model and that might be out of vocabulary for a general purpose ASR. We approach this challenge by extracting texts from accompanying lecture slides to adapt the language model of our TDNN-HMM based ASR system. We demonstrate the usability of the full system and its generated subtitles and evaluate on a dataset of manually transcribed lectures with an average of 26.3% WER. KW - automatische Spracherkennung KW - freie Software KW - Untertitelung Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:18-228-7-2523 UR - https://www.essv.de/pdf/2021_128_135.pdf?id=1109 SP - 128 EP - 135 PB - Förderverein Elektronische Sprachsignalverabeitung e.V. CY - Berlin, Germany ER - TY - CHAP A1 - Geislinger, Robert A1 - Milde, Benjamin A1 - Baumann, Timo A1 - Biemann, Chris T1 - Live Subtitling for BigBlueButton with Open-Source Software T2 - INTERSPEECH 2021: (Show & Tell Contribution), 30 August – 3 September, 2021, Brno, Czechia N2 - We present an open source plugin for live subtitling in the popular open source video conferencing software BigBlueBut-ton. Our plugin decodes each speaker’s audio stream separately and in parallel, thereby obliviating the need for speaker di-arization and seamlessly handling overlapped talk. Any Kaldi-compatible nnet3 model can be used with our plugin and we demonstrate it using freely available TDNN-HMM-based ASR models for English and German. Our subtitles can be used as they are (e.g., in loud environments) or can form the basis for further NLP processes. Our tool can also simplify the collection of remotely recorded multi-party dialogue corpora. KW - automatic speech recognition KW - automatic subtitles KW - computer-supported collaborative work KW - meeting transcription KW - multi-party dialogue KW - videoconferencing KW - VoIP Y1 - 2021 UR - https://www.isca-speech.org/archive/pdfs/interspeech_2021/geislinger21_interspeech.pdf SP - 3319 EP - 3320 CY - Brno, Czechia ER -