TY - CHAP A1 - Bocklet, Tobias A1 - Maier, Andreas A1 - Riedhammer, Korbinian A1 - Nöth, Elmar T1 - Towards a Language-independent Intelligibility Assessment of Children with Cleft Lip and Palate T2 - WOCCI '09 Proceedings of the 2nd Workshop on Child, Computer and Interaction (WOCCI 2009), Cambridge, Massachusetts, November 2009, Article No. 6. N2 - We describe a novel evaluation system for the intelligibility assessment of children with CLP on standardized tests. The system is solely based on standard cepstral features in form of MFCCs. No other information like word alignments is used. So the system can be easily adapted to other languages. For each child one GMM is created by adaptation of a UBM to the speaker-specific MFCCs. The components of this GMM are concatenated in order to create a so-called GMM supervector. These GMM supervectors are then used as meta features for an SVR. We evaluated our language-independent system on two different datasets of children suffering from CLP. One dataset contains recordings of 35 German children, where the children named different pictograms. The other dataset contains recordings of 14 Italian speaking children, who repeated standardized sentences. On both datasets we achieved high correlations: up to 0.81 for the German dataset and 0.83 for the Italian dataset. KW - Speech Recognition Y1 - 2009 SP - 2015 EP - 2018 ER - TY - CHAP A1 - Faria, Arlo A1 - Riedhammer, Korbinian A1 - Janin, Adam A1 - Bauer, A. T1 - REMEETING: Searchable Conversations T2 - INTERSPEECH 2016, Annual Conference of the International Speech Communication Association (ISCA), IEEE Workshop on Spoken Language Technologies (SLT), San Francisco, USA, September 2016. KW - Speech Recognition Y1 - 2016 ER - TY - CHAP A1 - Faria, Arlo A1 - Riedhammer, Korbinian T1 - REMEETING — Get More Out Of Meetings T2 - INTERSPEECH 2015, 16th Annual Conference of the International Speech Communication Association, Dresden, Germany, September 2015. N2 - Remeeting is a tool that helps you get more out of in-person meetings. Calendar integration and a special email address allow users to email agenda items prior to a certain meeting. A discrete notification at the time of the meeting reminds the user to start the recording. During the meeting, the user focuses on the conversation, or can add notes and photos if desired. After the meeting, every participant gets notified by an automated email that lists the participants along with automatically extracted keywords, notes and photos. This stimulates collaboration, and keeps follow-up contributions at a central place: Just reply to add further notes to the meeting. The resulting meeting “document” can be shared with others and reviewed using a web app that acts as a visual index to the meeting. This makes Remeeting the perfect tool for regular group meetings, standups and interviews, where people typically track progress and follow up on. Remeeting is leveraging, promoting and contributing to open source projects including kaldi and docker. KW - Speech Recognition KW - speaker identification KW - automatic summarization KW - productivity Y1 - 2015 ER - TY - CHAP A1 - Faria, Arlo A1 - Riedhammer, Korbinian T1 - REMEETING — Get More Out of Meetings T2 - INTERSPEECH 2014, 15th Annual Conference of the International Speech Communication Association, IEEE Workshop on Spoken Language Technologies (SLT), Singapore, September 2014. KW - Speech Recognition KW - speaker identification KW - automatic summarization KW - productivity Y1 - 2014 ER - TY - CHAP A1 - Garg, Nikhil A1 - Favre, Benoit A1 - Riedhammer, Korbinian A1 - Hakkani-Tür, Dilek T1 - A Graph Based Method for Meeting Summarization T2 - INTERSPEECH 2009, 10th Annual Conference of the International Speech Communication Association, Brighton, United Kingdom, September 2009. N2 - This paper presents an unsupervised, graph based approach for extractive summarization of meetings. Graph based methods such as TextRank have been used for sentence extraction from news articles. These methods model text as a graph with sentences as nodes and edges based on word overlap. A sentence node is then ranked according to its similarity with other nodes. The spontaneous speech in meetings leads to incomplete, informed sentences with high redundancy and calls for additional measures to extract relevant sentences. We propose an extension of the TextRank algorithm that clusters the meeting utterances and uses these clusters to construct the graph. We evaluate this method on the AM I meeting corpus and show a significant improvement over TextRank and other baseline methods. KW - Summarization KW - Page Rank Y1 - 2009 SP - 1499 EP - 1502 ER - TY - CHAP A1 - Gillick, Dan A1 - Riedhammer, Korbinian A1 - Favre, Benoit A1 - Hakkani-Tür, Dilek T1 - A Global Optimization Framework for Meeting Summarization T2 - 2009 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Taipei, Taiwan, April 2009. N2 - We introduce a model for extractive meeting summarization based on the hypothesis that utterances convey bits of information, or concepts. Using keyphrases as concepts weighted by frequency, and an integer linear program to determine the best set of utterances, that is, covering as many concepts as possible while satisfying a length constraint, we achieve ROUGE scores at least as good as a ROUGE-based oracle derived from human summaries. This brings us to a critical discussion of ROUGE and the future of extractive meeting summarization. KW - meeting summarization KW - integer linear programming KW - summarization evaluation Y1 - 2009 SP - 4769 EP - 4772 ER - TY - CHAP A1 - Riedhammer, Korbinian A1 - Favre, Benoit A1 - Hakkani-Tür, Dilek T1 - A Keyphrase Based Approach to Interactive Meeting Summarization T2 - 2008 IEEE Workshop on Spoken Language Technologies (SLT), Goa, India, December 2008. N2 - Rooted in multi-document summarization, maximum marginal relevance (MMR) is a widely used algorithm for meeting summarization (MS). A major problem in extractive MS using MMR is finding a proper query: the centroid based query which is commonly used in the absence of a manually specified query, can not significantly outperform a simple baseline system. We introduce a simple yet robust algorithm to automatically extract keyphrases (KP) from a meeting which can then be used as a query in the MMR algorithm. We show that the KP based system significantly outperforms both baseline and centroid based systems. As human refined KPs show even better summarization performance, we outline how to integrate the KP approach into a graphical user interface allowing interactive summarization to match the user's needs in terms of summary length and topic focus. KW - meeting summarization KW - keyword generation KW - user interaction Y1 - 2008 SP - 153 EP - 156 ER - TY - CHAP A1 - Tur, Gokhan A1 - Stolcke, Andreas A1 - Voss, Lynn A1 - Dowding, John A1 - Favre, Benoit A1 - Fernandez, Raquel A1 - Frampton, Matthew A1 - Frandsen, Michael A1 - Frederickson, Clive A1 - Graciarena, Martin A1 - Hakkani-Tür, Dilek A1 - Kintzing, Donald A1 - Leveque, Kyle A1 - Mason, Shane A1 - Niekrasz, John A1 - Peters, Stanley A1 - Purver, Matthew A1 - Riedhammer, Korbinian A1 - Shriberg, Elizabeth A1 - Tien, Jing A1 - Vergyri, Dimitra A1 - Yang, Fan T1 - The CALO Meeting Speech Recognition and Understanding System T2 - 2008 IEEE Workshop on Spoken Language Technologies (SLT), Goa, India, December 2008. N2 - The CALO meeting assistant provides for distributed meeting capture, annotation, automatic transcription and semantic analysis of multiparty meetings, and is part of the larger CALO personal assistant system. This paper summarizes the CALO-MA architecture and its speech recognition and understanding components, which include real-time and offline speech transcription, dialog act segmentation and tagging, question-answer pair identification, action item recognition, decision extraction, and summarization. KW - Speech Recognition KW - multiparty meetings processing KW - spoken language understanding Y1 - 2008 SP - 69 EP - 72 ER - TY - CHAP A1 - Riedhammer, Korbinian A1 - Gillick, Dan A1 - Favre, Benoit A1 - Hakkani-Tür, Dilek T1 - Packing the Meeting Summarization Knapsack T2 - INTERSPEECH 2008, 9th Annual Conference of the International Speech Communication Association (ISCA), Brisbane, Australia, September 2008. N2 - Despite considerable work in automatic meeting summarization over the last few years, comparing results remains difficult due to varied task conditions and evaluations. To address this issue, we present a method for determining the best possible extractive summary given an evaluation metric like ROUGE. Our oracle system is based on a knapsack-packing framework, and though NP-Hard, can be solved nearly optimally by a genetic algorithm. To frame new research results in a meaningful context, we suggest presenting our oracle results alongside two simple baselines. We show oracle and baseline results for a variety of evaluation scenarios that have recently appeared in this field. KW - summarization KW - meetings KW - evaluation Y1 - 2008 SP - 2434 EP - 2437 ER - TY - CHAP A1 - Riedhammer, Korbinian A1 - Stemmer, Georg A1 - Haderlein, Tino A1 - Schuster, Mario A1 - Rosanowski, Frank A1 - Nöth, Elmar A1 - Maier, Andreas T1 - Towards Robust Automatic Evaluation of Pathologic Telephone Speech T2 - 2007 IEEE Workshop on Automatic Speech Recognition & Understanding (ASRU), Kyoto, Japan, December 2007. N2 - For many aspects of speech therapy an objective evaluation of the intelligibility of a patient's speech is needed. We investigate the evaluation of the intelligibility of speech by means of automatic speech recognition. Previous studies have shown that measures like word accuracy are consistent with human experts' ratings. To ease the patient's burden, it is highly desirable to conduct the assessment via phone. However, the telephone channel influences the quality of the speech signal which negatively affects the results. To reduce inaccuracies, we propose a combination of two speech recognizers. Experiments on two sets of pathological speech show that the combination results in consistent improvements in the correlation between the automatic evaluation and the ratings by human experts. Furthermore, the approach leads to reductions of 10% and 25% of the maximum error of the intelligibility measure. KW - Biomedical acoustics KW - Speech intelligibility KW - Speech processing KW - Acoustic applications Y1 - 2007 SP - 717 EP - 722 ER - TY - CHAP A1 - Haderlein, Tino A1 - Riedhammer, Korbinian A1 - Maier, Andreas A1 - Nöth, Elmar A1 - Toy, Hikmet A1 - Rosanowski, Frank T1 - An Automatic Version of the Post-Laryngectomy Telephone Test T2 - TSD 2007, 10th International Conference on Text, Speech and Dialogue, Proceedings, Pilsen, Czech Republic, September 2007. N2 - Tracheoesophageal (TE) speech is a possibility to restore the ability to speak after total laryngectomy, i.e. the removal of the larynx. The quality of the substitute voice has to be evaluated during therapy. For the intelligibility evaluation of German speakers over telephone, the Post-Laryngectomy Telephone Test (PLTT) was defined. Each patient reads out 20 of 400 different monosyllabic words and 5 out of 100 sentences. A human listener writes down the words and sentences understood and computes an overall score. This paper presents a means of objective and automatic evaluation that can replace the subjective method. The scores of 11 naïve raters for a set of 31 test speakers were compared to the word recognition rate of speech recognizers. Correlation values of about 0.9 were reached. KW - Automatic Speech Recognition KW - Mono Poly KW - Total Laryngectomy KW - Speech Recognition System KW - Automatic Evaluation Y1 - 2007 SP - 238 EP - 245 PB - Springer-Verlag ER - TY - CHAP A1 - Nöth, Elmar A1 - Maier, Andreas A1 - Haderlein, Tino A1 - Riedhammer, Korbinian A1 - Rosanowski, Frank A1 - Schuster, Maria T1 - Automatic Evaluation of Pathologic Speech - from Research to Routine Clinical Use T2 - TSD 2007, 10th International Conference on Text, Speech and Dialogue, Pilsen, Czech Republic, September 2007. N2 - Previously we have shown that ASR technology can be used to objectively evaluate pathologic speech. Here we report on progress for routine clinical use: 1) We introduce an easy-to-use recording and evaluation environment. 2) We confirm our previous results for a larger group of patients. 3) We show that telephone speech can be analyzed with the same methods with only a small loss of agreement with human experts. 4) We show that prosodic information leads to more robust results. 5) We show that text reference instead of transliteration can be used for evaluation. Using word accuracy of a speech recognizer and prosodic features as features for SVM regression, we achieve a correlation of .90 between the automatic analysis and human experts. KW - Automatic Speech Recognition KW - Pathologic Speech KW - Automatic Evaluation KW - Prosodic Feature KW - Speech Recognizer Y1 - 2007 SP - 294 EP - 301 PB - Springer-Verlag ER - TY - CHAP A1 - Haderlein, Tino A1 - Eysholdt, Ulrich A1 - Riedhammer, Korbinian A1 - Nöth, Elmar A1 - Rosanowski, Frank T1 - Automatisierung des Postlaryngektomie-Telefontests (PLTT) T2 - Aktuelle phoniatrisch-pädaudiologische Aspekte N2 - In früheren Arbeiten wurde gezeigt, dass automatische Spracherkennungsverfahren verwendet werden können, um die Verständlichkeit von Sprechern mit tracheoösophagealer Ersatzstimme (TE-Stimme) automatisch zu bewerten [1,2]. In diesem Beitrag wird eine automatische Version des Postlaryngektomie-Telefontests (PLTT, [3]) vorgestellt, der einen eingeführten Standardtest für die Verständlichkeit über das Telefon darstellt. KW - Spracherkennung Y1 - 2007 SP - 66 EP - 69 ER - TY - CHAP A1 - Riedhammer, Korbinian A1 - Haderlein, Tino A1 - Schuster, Maria A1 - Rosanowski, Frank A1 - Nöth, Elmar T1 - Automatic Evaluation of Tracheoesophageal Telephone Speech T2 - First International Language Technologies Conference (IS-LTC 2006), Ljubljana, Slovenia, October 2006. N2 - The tracheoesophageal (TE) substitute voice is currently state–of–the–art treatment to restore the ability to speak after laryngectomy. The intelligibility while talking over a telephone is an important clinical factor, as it is a crucial part of the patients’ social life. An objective way to rate the intelligibility of substitute voices when talking over a telephone is desirable to improve the post–laryngectomy speech therapy. An automatic speech recognition (ASR) system was applied to 41 high quality recordings of post–laryngectomy patients. The ASR system was trained with normal, non–pathologic speech. It yielded a word accuracy (WA) of 36.9%±18.0%; compared to the intelligibility rating of a group of human experts the ASR system had a correlation coefficient of -.88. After downsampling the 41 recordings to telephone quality, the ASR system reached a WA of 26.4%±13.9% leading to a correlation coefficient of -.80. These results confirm that an ASR system can be used for objective intelligibility rating over the telephone. KW - Speech Recognition Y1 - 2006 SP - 17 EP - 22 ER - TY - CHAP A1 - Riedhammer, Korbinian A1 - Haderlein, Tino A1 - Nöth, Elmar A1 - Toy, Hikmet A1 - Eysholdt, Ulrich A1 - Rosanowski, Frank T1 - Die tracheoösophageale Ersatzstimme: Automatische Verständlichkeitsbewertung über das Telefon T2 - 23. Wissenschaftliche Jahrestagung der Deutschen Gesellschaft für Phoniatrie und Pädaudiologie. Heidelberg, September 2006. Aktuelle phoniatrisch-pädaudiologische Aspekte. N2 - Die tracheoösophageale Ersatzstimme TE ist heute "state of the art" der Stimmrehabilitation nach einer Laryngektomie. In dieser Studie, einem Teilprojekt eines von der Deutschen Krebshilfe geförderten Forschungsvorhabens, ging es um die objektive Bewertung des Behandlungsfortschritts. Untersucht wurden 41 Laryngektomierte mit einer TE (Provox-Stimmventilprothese) durchgeführt. Ziel der Studie war es, die Verständlichkeit im Gespräch und am Telefon objektiv zu beurteilen und zu vergleichen, um den Patienten in der Zukunft die telefonische Evaluation von zuhause aus zu ermöglichen. Zur Bewertung diente ein für Marktzwecke professionalisiertes automatisches Spracherkennungssystem. Es wurden zunächst Nahbesprechungsaufnahmen des "Nordwind und Sonne"-Textes von fünf Experten hinsichtlich ihrer Verständlichkeit beurteilt. Aus diesen Aufnahmen entstanden durch Abspielen über ein Telefon simulierte Telefonaufnahmen. Zielkriterium der automatischen Analyse war die Wortakkuratheit WA, die mit der an Schulnoten orientierten Stimmbewertung durch die Experten korreliert wurde. Die Studie ergab eine Korrelation von -0,82 für die Nahbesprechungs- und -0,69 für die Telefonaufnahmen. Die Ergebnisse zeigen, dass die automatische Verständlichkeitsbewertung von Ersatzstimmen auch per Telefon prinzipiell möglich ist. Möglichkeiten, die Qualitätsverluste durch die Telefonübertragung und die somit niedrigere Korrelation zu kompensieren, werden aufgezeigt. KW - Spracherkennung Y1 - 2006 SP - 51 EP - 53 ER - TY - BOOK A1 - Riedhammer, Korbinian T1 - Interactive Approaches to Video Lecture Assessment N2 - Folks that have been here last winter prior to ASRU might be familiar with the title of that talk. But don't be misled, I'll have something new for you. In this talk, I will give an overview over the FAU Lecture Browser which I developed in the context of my thesis. I will start out with the description of a novel data set: The LME Lectures are a corpus of two series of graduate level computer science lectures with 18 recordings each. The courses cover topics in medical image processing and pattern analysis/machine learning. The roughly 40 hours of speech were manually transcribed, and one particular lecture was annotated with key phrases by five human raters. Using this data set, I trained three different speech recognizers using regular continuous, multi-codebook semi-continuous and subspace Gaussian mixture models, that show an error rate of about 10% WER. I will then briefly describe the key phrase extraction and automatic ranking, which was then compared against five raters on one lecture recording. Finally, I will talk about a little usability study where 10 students were asked to perform a certain task-- with and without the proposed lecture browser. Although the number of contestants is limited, the numbers are interesting: the users that had the interface could complete the tasks about 30% faster than the control group, while maintaining about the same accuracy. KW - Speech Recognition Y1 - 2012 PB - Logos Verlag Berlin GmbH CY - Berlin ER - TY - BOOK A1 - Riedhammer, Korbinian T1 - An Automatic Intelligibility Test Based on the Post-Laryngectomy Telephone Test KW - Speech Recognition Y1 - 2008 PB - Mueller Verlag CY - Nürnberg ER - TY - JOUR A1 - Haderlein, Tino A1 - Riedhammer, Korbinian A1 - Nöth, Elmar A1 - Toy, Hikmet A1 - Schuster, Maria A1 - Eysholdt, Ulrich A1 - Hornegger, Joachim A1 - Rosanowski, Frank T1 - Application of Automatic Speech Recognition to Quantitative Assessment of Tracheoesophageal Speech in Different Signal Quality JF - Folia Phoniatrica Et Logopaedica N2 - Tracheoesophageal voice is state-of-the-art in voice rehabilitation after laryngectomy. Intelligibility on a telephone is an important evaluation criterion as it is a crucial part of social life. An objective measure of intelligibility when talking on a telephone is desirable in the field of postlaryngectomy speech therapy and its evaluation. Based upon successful earlier studies with broadband speech, an automatic speech recognition (ASR) system was applied to 41 recordings of postlaryngectomy patients. Recordings were available in different signal qualities; quality was the crucial criterion for this study. Compared to the intelligibility rating of 5 human experts, the ASR system had a correlation coefficient of r = -0.87 and Krippendorff's alpha of 0.65 when broadband speech was processed. The rater group alone achieved alpha = 0.66. With the test recordings in telephone quality, the system reached r = -0.79 and alpha = 0.67. For medical purposes, a comprehensive diagnostic approach to (substitute) voice has to cover both subjective and objective tests. An automatic recognition system such as the one proposed in this study can be used for objective intelligibility rating with results comparable to those of human experts. This holds for broadband speech as well as for automatic evaluation via telephone. KW - Speech Recognition Software Y1 - 2008 VL - 2008 IS - 61(1) SP - 12 EP - 17 ER - TY - JOUR A1 - Bocklet, Tobias A1 - Riedhammer, Korbinian A1 - Nöth, Elmar A1 - Eysholdt, Ulrich A1 - Haderlein, Tino T1 - Automatic Intelligibility Assessment of Speakers After Laryngeal Cancer by Means of Acoustic Modeling JF - Journal of Voice N2 - One aspect of voice and speech evaluation after laryngeal cancer is acoustic analysis. Perceptual evaluation by expert raters is a standard in the clinical environment for global criteria such as overall quality or intelligibility. So far, automatic approaches evaluate acoustic properties of pathologic voices based on voiced/unvoiced distinction and fundamental frequency analysis of sustained vowels. Because of the high amount of noisy components and the increasing aperiodicity of highly pathologic voices, a fully automatic analysis of fundamental frequency is difficult. We introduce a purely data-driven system for the acoustic analysis of pathologic voices based on recordings of a standard text. KW - Speech Recognition KW - Lung cancer technologies Y1 - 2012 IS - 26(3) SP - 390 EP - 397 ER - TY - JOUR A1 - Riedhammer, Korbinian A1 - Favre, Benoit A1 - Hakkani-Tür, Dilek T1 - Long story short - Global unsupervised models for keyphrase based meeting summarization JF - SPEECH COMMUNICATION KW - Speech Recognition KW - Meeting Summarization Y1 - 2010 VL - 2010 IS - 52(10) SP - 801 EP - 815 ER -