TY - CHAP A1 - Ranzenberger, Thomas A1 - Bocklet, Tobias A1 - Freisinger, Steffen A1 - Georges, Munir A1 - Glocker, Kevin A1 - Herygers, Aaricia A1 - Riedhammer, Korbinian A1 - Schneider, Fabian A1 - Simic, Christopher A1 - Zakaria, Khabbab ED - Baumann, Timo T1 - Extending HAnS: Large Language Models For Question Answering, Summarization, And Topic Segmentation In An ML-based Learning Experience Platform T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - The use of chatbots based on large language models (LLMs) and their impact on society are influencing our learning experience platform Hochschul-Assistenz-System (HAnS). HAnS uses machine learning (ML) methods to support students and lecturers in the online learning and teaching processes [1]. This paper introduces LLM-based features available in HAnS which are using the transcript of our improved Automatic Speech Recognition (ASR) pipeline with an average transcription duration of 45 seconds and an average word error rate (WER) of 6.66% on over 8 hours of audio data of 7 lecture videos. A LLM-based chatbot could be used to answer questions on the lecture content as the ASR transcript is provided as context. The summarization and topic segmentation uses the LLM to improve our learning experience platform. We generate multiple choice questions using the LLM and the ASR transcript as context during playback in a period of 3 minutes and display them in the HAnS frontend. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-71032 SN - 978-3-95908-325-6 SP - 219 EP - 224 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Kisser, Lea A1 - Busch, Matthias A1 - Siegert, Ingo ED - Baumann, Timo T1 - Review of Usage and Potentials of Conversational Interfaces at Universities and in Students Daily Lifes T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - The continuous advancement of digitization extends beyond educational institutions, giving rise to numerous innovations, particularly in the realm of study information [1]. One avenue for incorporating digital methodologies involves leveraging conversational agents (CAs) [2], serving as interactive interfaces bridging the gap between humans and computers. In the broader context, conversational agents are gaining prominence, offering several benefits to their users. The overarching goal is to comprehensively assist users through these intelligent systems. Consequently, exploring existing university chatbots becomes imperative to discern the areas where they excel. This research aims to scrutinize diverse chatbot systems, delving into their use cases and the challenges they encounter, employing a systematic review. Here it turns out that chatbots support universities the most in the fields of administration, e-learning and mental health. Furthermore, the study will investigate practical experiences on the potential applications and implementation of these systems in university settings, incorporating insights from an online survey and interviews, both made with experts. Here it comes to conclusion that preparation in relation to a chatbot implementation is the key factor to success. Otherwise, a failed system is nearly impossible to be saved, once users lost trust in the system. Therefore, carefully made preparations in the technical and organisational field are necessary to provide a helpful assistant. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70789 SN - 978-3-95908-325-6 SP - 38 EP - 45 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Walther, Mathias A1 - Zeuner, Elisabeth A1 - Rykova, Eugenia ED - Baumann, Timo T1 - Interaktionsverhalten eines Avatars im digitalen sprachtherapeutischen Setting T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - Die Therapie-App aphaDIGITAL wird im Rahmen eines Forschungsprojekts entwickelt, um Menschen mit Aphasie im häuslichen Umfeld zu unterstützen. Das Projekt kombiniert bewährte Therapiemethoden mit digitalen Technologien, einschließlich künstlicher Intelligenz und einem interaktiven Avatar namens Eva. Dieser Artikel betrachtet die Analyse und Entwicklung der Interaktionsmechanismen, die für eine digitale Assistenz von Aphasietherapie den größten Einfluss haben. Es wurden dazu reale Therapiesitzungen zwischen sprachgeschädigten Menschen und ihren Therapeuten konversationsanalytisch nach spezifischen Merkmalen untersucht. Darauf aufbauend wurde durch manuelle Animation ein prototypisches Mundbild modelliert und ein eigenes Artikulationssystem konzipiert, um ein entsprechend authentisches Modell der deutschen Artikulations- und Koartikulationsmuster abzubilden. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70774 SN - 978-3-95908-325-6 SP - 30 EP - 37 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Kany, Valentin A1 - Trouvain, Jürgen ED - Baumann, Timo T1 - Computergestützte Bestimmung des Sprechflusses bei Vorschulkindern T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - Die vorliegende Studie untersucht, inwiefern sich die in der Phonetik verbreiteten Skripte zur automatisierten Feststellung von verschiedenen Aspekten des Sprechflusses von de Jong et al. zur Beurteilung des Sprachstands bei Kindern eignen und in welcher Art und Weise die Methodik angepasst werden könnte. Dazu wurden Sprachdaten von Vorschulkindern mit Deutsch als Muttersprache bzw. als Zweitsprache mithilfe eines Serious Game zur Sprachstandserhebung elizitiert. Die Audiodaten wurden bezüglich Artikulationsrate, Pausen und Füllpartikeln sowohl automatisiert durch die Skripte als auch manuell annotiert. Die Ergebnisse zeigen, dass sich die Skripte zur Ermittlung der Artikulationsrate mit einer relativ hohen Übereinstimmung mit der manuellen Ermittlung zur Verwendung in Sprachstandserhebungsverfahren eignen. Auch die automatische Erkennung von Sprechpausen weist einen hohen Precision-Wert auf und könnte als Instrument in Sprachstandserhebungen verwendet werden. Eine solche Verwendung würde mit einer Erweiterung um die hier vorgestellte manuelle Methode zum Annotieren von disfluenten und nicht disfluenten Pausen profitieren. Bei den Füllpartikeln stellte sich die automatisierte Klassifizierung hingegen als weniger geeignet heraus. Hier wurde keine hohe Übereinstimmung mit der menschlichen Annotation festgestellt. Um in der Praxis Verwendung finden zu können, muss diese Methode noch erweitert werden, zum Beispiel durch Miteinbeziehen der Pausenerkennung. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70819 SN - 978-3-95908-325-6 SP - 62 EP - 69 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Eliseeva, Uliana A1 - Yuen, Ivan A1 - Möbius, Bernd ED - Baumann, Timo T1 - Perception of Formant Distortion in German Words and Non-words T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - Concatenative text-to-speech (TTS) systems remain a widely used cheaper alternative to neural TTS systems. Yet concatenation of prerecorded units entails some drawbacks, such as spectral distortion, the perceptual consequences of which remain unclear. In an attempt to bridge this gap, our study focused on the effect of spectral distortion in vowel formants on perceived speech quality in naturally-read manipulated German words as well as non-words. More specifically, we explored the distortion effect on a varying number of affected formants, at different magnitude and directionality in two corner vowels /a:/ and /i:/. The results indicate that single formant manipulations have a less pronounced effect on the listeners’ perception compared to multiple formant perturbations. The threshold at which the distortion became generally audible was estimated to lie between 0.4 and 1.0 bandwidth. The directionality of the distortion was not found to be significant. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70793 SN - 978-3-95908-325-6 SP - 46 EP - 53 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Kuhn, Johannes A1 - Wolff, Matthias A1 - Borislavov, Borislav ED - Baumann, Timo T1 - Epsilon-Verarbeitung bei minimalistischen Grammatiken für Zahlen T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - Um bei Minimalistischen Grammatiken (MG) Übergenerierung zu vermeiden, kann man Einträge mit leeren Exponenten (ε-Einträge) verwenden. Ein Eintrag besteht aus einem Exponenten, der die Äußerung oder Schrift eines Wortes repräsentiert, einer Merkmalsliste, welche die Syntax kodiert und einem λ-Ausdruck, der die Semantik repräsentiert. Leere Einträge führen allerdings zu einer schlechteren Verwendbarkeit der Grammatik für das Parsen. Die vorliegende Arbeit wird ein Umformungsalgorithmus für MGs vorstellen, sodass die Anzahl der ε-Einträge verringert werden kann, um sie wieder für Parser verwendbar zu machen. Hierzu werden die ε-Einträge mit den anderen Einträgen vorverarbeitet und dadurch neue Einträge geschaffen. Die nun überflüssigen ε-Einträge können dann problemlos entfernt werden. Der Algorithmus wurde anhand von über 260 Zahlwortgrammatiken getestet. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70830 SN - 978-3-95908-325-6 SP - 78 EP - 85 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Höge, Harald ED - Baumann, Timo T1 - The Use of Temporal Features in Cortical Segmentation of Syllables T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - There is high confidence for the hypothesis that in speech perception the cycles of a θ-oscillation segment the auditory signal into syllables [8]. Yet the functionality of the oscillator generating the θ-oscillation is unknown. We follow the finding that, within an auditory scene, speech is perceived as a stream given by temporal coherence [12]. We work with the hypotheses that the θ-oscillator is driven by temporal features providing this coherence. We propose a new temporal feature called O-distance, which detects the onset of a syllable - the starting point to of a θ-cycle–triggered by the temporal distance from to to the instance of the maximal rise of the loudness curve of the vowel. To extract to from the auditory signal, we use the statistical properties of this distance based on the C-center hypothesis [25], which predicts a close temporal relation of the onset consonants to the onset of a vowel. The statistics are derived from reference O-distance extracted from an articulatory database, where the minima and maxima of the loudness are related to maxima and minima of the lower incisor and tongue tip. To judge the quality of the O-distance extracted from the auditory signal, we regard the temporal deviation of the O-distance to the reference O-distance. Currently we achieve a mean deviation of 34ms. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70823 SN - 978-3-95908-325-6 SP - 70 EP - 77 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Schaffer, Stefan A1 - Schwaetzer, Eva A1 - Ruß, Aaron A1 - Gustke, Oliver ED - Baumann, Timo T1 - Chatbot in the Museum – A Field Study of User Experience and Modality Usage T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - This paper describes a field study conducted with a museum chatbot at the Städel Museum Frankfurt. The chatbot uses the BERT language model for natural language processing and can be operated via touchscreen as well as via speech input. Prior to the study, hypotheses regarding the user experience of the system were formulated and a system-specific questionnaire was designed, which was used to inquire (among other things) about the perceived quality of the speech output and the frequency of audio guide use in museums. During the interaction with the chatbot, log data was collected and stored in the back-end system. The results show a significant correlation between perceived speech quality and user experience. An exploratory data analysis revealed that participants who used only speech input rated the system as significantly more stimulating than participants who used only touch input. Touch input turned out to be the most efficient input modality in terms of answer correctness and was rated highest regarding pragmatic quality. Interestingly touch input was preferred by younger participants. We discuss our findings and conclude that speech interaction should be seriously considered to create engaging conversational user experiences in museums. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70758 SN - 978-3-95908-325-6 SP - 14 EP - 21 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Possamai de Menezes, João Vítor A1 - Kleiner, Christian A1 - Kainz, Marie-Anne A1 - Echternach, Matthias A1 - Birkholz, Peter ED - Baumann, Timo T1 - Synchrony of Glottal Area Waveform Parameters During the Production of Obstruents in Vowel Context T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - Obstruents are phonemes which require partial or total obstruction of airflow through the vocal tract. Their articulation also requires adjustments of the laryngeal settings, e. g., an abduction gesture to stop vocal fold vibration for voiceless obstruents. This study investigated the laryngeal settings during the production of voiced and voiceless obstruents in vowel context to analyze the degree of synchrony of the involved glottal gestures. High-speed laryngoscopy images were used to determine the glottal area waveform, from which the time functions of the parameters open quotient (OQ), fundamental frequency (f0), and AC and DC amplitude (ACA and DCA) were calculated and analyzed. Significant correlations were found between all pairs of parameters, with strong correlations between some of them, e.g. Open Quotient and AC Amplitude. Correlations were also either consistently positive or negative for specific pairs of parameters across all investigated phonemes. These results could point to consistent patterns in laryngeal gestures that could enhance articulatory speech synthesis. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70808 SN - 978-3-95908-325-6 SP - 54 EP - 61 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Hillmann, Stefan A1 - Kowol, Philine A1 - Ahmad, Adnan A1 - Tang, Ruochen A1 - Möller, Sebastian ED - Baumann, Timo T1 - Usability and User Experience of a Chatbot for Student Support T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - This paper describes the usability evaluation of the parts of the CHATU chatbot. The evaluation was conducted with 21 participants. A focus of this paper is the description of the carefully designed evaluation procedure, which aims to avoid textual priming of the participants. The general evaluation procedure can be applied to other speech- or text-based conversational systems, and additional material is provided. The evaluation results show that the usability and user experience of CHATU are positively rated. However, the naturalness and novelty of the interaction are not optimal, and the potential influence of users’ experience with LLMs on the evaluation is discussed. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70760 SN - 978-3-95908-325-6 SP - 22 EP - 29 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Kruspe, Anna ED - Baumann, Timo T1 - More than words: Advancements and Challenges in Speech Recognition for Singing T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - This paper addresses the challenges and advancements in speech recognition for singing, a domain distinctly different from standard speech recognition. Singing encompasses unique challenges, including extensive pitch variations, diverse vocal styles, and background music interference. We explore key areas such as phoneme recognition, language identification in songs, keyword spotting, and full lyrics transcription. I will describe some of my own experiences when performing research on these tasks just as they were starting to gain traction, but will also show how recent developments in deep learning and large-scale datasets have propelled progress in this field. My goal is to illuminate the complexities of applying speech recognition to singing, evaluate current capabilities, and outline future research directions. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70748 SN - 978-3-95908-325-6 SP - 1 EP - 10 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Schuler, Christian A1 - Nayak, Shravan A1 - Saha, Debjoy A1 - Baumann, Timo ED - Baumann, Timo T1 - Can We See Your Response Before You Speak? Exploring Linguistic Information Found in Inter-Utterance Pauses T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - In this work we assess whether there is information in pauses in-between utterances of the same or different speakers that are predictive of the following speaker’s utterance. We present models that connect a person’s visual features before they speak to their upcoming utterance. In our experiments we find that outof-the-box pre-trained models can already reach a better-than-chance performance in correlating video embeddings to utterance embeddings. In contrast, models that attempt to predict the first word after the pause do not outperform a unigram model, indicating that our models do not read lips (based e.g. on co-articulation effects) but rather capture more fundamental aspects of the upcoming utterance. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70949 SN - 978-3-95908-325-6 SP - 165 EP - 172 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Schubert, Martha A1 - Sinha, Yamini A1 - Krüger, Julia A1 - Siegert, Ingo ED - Baumann, Timo T1 - Speech Recognition Errors in ASR Engines and Their Impact on Linguistic Analysis in Psychotherapies T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - Modern intervention planning in psychotherapies may benefit from predicting process relevant psychotherapy constructs by automated speech analysis. One essential step is the extraction of relevant linguistic speech markers by ASR engines, which because of highly sensible data, work offline. We analyze transcription errors from NeMo, Whisper, and Wav2Vec2.0, focusing on their impact on linguistic markers usually requiring high quality transcripts. By utilizing part-of-speech tagging, we examine error occurrences among different word types. The Linguistic Inquiry and Word Count (LIWC) software aids in extracting markers. We highlight challenges in transcribing spontaneous speech, prevalent in therapy, and compare results with the Mozilla CommonVoice dataset, which features read speech. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70999 SN - 978-3-95908-325-6 SP - 203 EP - 210 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Harnisch, Philipp L. A1 - Hillmann, Stefan ED - Baumann, Timo T1 - Empirical Evaluation of ASR and NLU in a Multimodal Dialogue System for Survey Answering T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - PROM surveys, used to measure the effect of rehabilitation treatments, are typically filled out on paper, and often suffer from low response rates. Replacing it with a multimodal survey system, supporting touch and speech interaction, could lead to lower hurdles and therefore more data quantity. To do this, it requires task-specific training samples for the Automatic Speech Recognition (ASR) and Natural Language Understanding (NLU) to classify spoken answers into one of the standardized PROM answer options. Due to the lack of training data for medical PROM surveys, we created augmented text samples with each answer option description, combined with different templates. To improve training capabilities, introduce a proper test set, and evaluate the ASR, we also collected 1,797 real voice samples within an empirical study. Further, we incorporate the contextual knowledge of the current question into our NLU architecture by implementing one classifier for every question scale. Our results reveal that training with empirical data leads to better results than augmented data from templates and original answer option descriptions. Because of participant mislabeling of 33% due to the ambiguity of the task, we receive overall low NLU performances with up to 51.1% accuracy, and rank-1-accuracy up to 79.3%. We also find that our implementation of many scale-specific NLU classifiers significantly outperforms one NLU classifier for all labels, that incorporates the same contextual knowledge after the prediction, by 8 percent points. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-71007 SN - 978-3-95908-325-6 SP - 211 EP - 218 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Venkateswaran, Siddarth A1 - Al Foysal, Abdullah A1 - Shaik, Nazeer Basha A1 - Böck, Ronald ED - Baumann, Timo T1 - Is there Text in Wine? – S+U Learning-based Named Entity Recognition and Triplet Extraction from Wine Aroma Descriptors T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - Wine making is usually considered a domain being far off the processing of speech and language. But in a particular aspect, the domains of speech processing and wine making are related, namely, in the description of wine aromas. These descriptors are used for creating wine expertise as well as more general (advertisement-like) textual representations. In the current paper, we use Natural Language Processing techniques, especially Named Entity Recognition, to identify Aspects and Opinions, reflecting wine characteristics. These are combined with analyses of respective relations (triplet extraction) building Aspect-Opinion-Pairs to establish indicative aroma descriptors, also trying to approach the complex interplay amongst these individual statements. In our experiments, we rely on the Falstaff corpus comprising a huge set of wine descriptions. This results in an average F1 score of around 0.85 for Aspect-Opinion classification. For triplet generation multiple strategies were compared, resulting in an average F1 score of 0.67 in this challenging task. For both tasks we rely only on a handful of manually annotated samples, applying pseudo-labeling methods from seed data to achieve automatic labeling. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70931 SN - 978-3-95908-325-6 SP - 157 EP - 164 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Bauer, Judith A1 - Zalkow, Frank A1 - Müller, Meinard A1 - Dittmar, Christian ED - Baumann, Timo T1 - Evaluating the Impact of Prosody Feature Normalization on the Controllability of Pitch in Speech Synthesis T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - Recent neural text-to-speech (TTS) models are able to synthesize highly natural speech signals using deep learning techniques. In practical applications, it can be desirable to have explicit control over the prosody (speech rate, fundamental frequency, and energy) of the synthesized speech. Such controllability can be achieved by adding prosody prediction modules, whose main purpose is to estimate plausible prosody features for each phoneme in the text input. This explicit modeling also allows for changing prosody features at inference time, consequently enabling the adjustment of the prosody in the synthesized audio. In this paper, we evaluate to which extent deliberate manipulation of such prosody features is reflected in the resulting speech audio. We focus particularly on changing the pitch (i.e., fundamental frequency) while applying different normalization strategies. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70976 SN - 978-3-95908-325-6 SP - 188 EP - 195 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Sinha, Yamini A1 - Hintz, Jan A1 - Siegert, Ingo ED - Baumann, Timo T1 - Evaluation of Audio Deepfakes – Systematic Review T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - Generative models for audio are commonly used for music composition, sound effects generation for video game development, audio restoration, voice cloning, etc. The ease of generating indistinguishable fake audio with deep learning poses a major threat to personal privacy, online security, and political discourse. Evaluating the quality and realism of these synthetic utterances is crucial for mitigating the potential for misinformation and harm. To assess this threat, this paper conducts a systematic review, using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), on how these deepfake models are currently evaluated. The analysis of 86 papers shows that the majority of the evaluation is conducted on a machine level and highlights a research gap regarding the human perception of deepfakes. This paper explores various methods and perceptual measures employed in assessing audio deepfakes and evaluating their strengths, limitations, and future directions. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70960 SN - 978-3-95908-325-6 SP - 181 EP - 187 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Sering, Konstantin ED - Baumann, Timo T1 - Speech/Non-Speech Classification Slightly Improves Synthesis Quality in PAULE T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - One of the tasks PAULE[1, 2] solves is finding suitable control parameter (cp-)trajectories for a given target acoustic. These cp-trajectories can be used to synthesize speech with the articulatory speech synthesizer of the VocalTractLab (VTL) [3]. If the target acoustic contains substantial microphone noise or other background noises, occasionally PAULE optimizes not for the speech in the target, but for this background noises. By adding a speech/non-speech classifier to the feedback and planning-loop in PAULE this resynthesis of background noises should be mitigated. Unfortunately, the improvements were minor, which might be due to uninformative gradients of the classifier. The importance of informative gradients and the use classifiers to adapt PAULE to different tasks are explained and discussed. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70955 SN - 978-3-95908-325-6 SP - 173 EP - 180 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Mousavi, Neda A1 - Grawunder, Sven ED - Baumann, Timo T1 - The influence of signal segmentation methods on rhythm-bassed speaker recognition T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - This study investigates the effects of speech segmentation methods on speaker recognition models, particularly with regard to the use of rhythmic feature sets. Using three automatic methods and one manual method on the German database of Kiel corpus, segmentation was performed based on the identification of vowel onsets. Subsequently rhythmic variability indices derived from these intervals were calculated and used for principal component analysis and support vector machine model in order to investigate the variation among speakers. The results underline the influence of signal segmentation methods on speaker recognition models. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-71014 SN - 978-3-95908-325-6 SP - 225 EP - 232 PB - TUDpress CY - Dresden ER - TY - JOUR A1 - Hillebrand, Patrick A1 - Westner, Markus T1 - Success factors of long-term CIOs JF - Information Systems and e-Business Management N2 - Although the average tenure of CIOs has increased over the last years, the majority of CIOs have been in their positions for only three years or less. Nevertheless, some CIOs have been successful in their position for a long time. In this study, we use tenure as a proxy for success as a CIO. The goal of this paper is to examine factors that are critical to the success of long-term CIOs. For this purpose, we created and analyzed resumes of 384 CIOs. Out of these 384, we conducted 19 interviews with CIOs from top-tier companies and collected and analyzed both qualitative and quantitative data. In the process, we were able to identify nine factors that are critical for the success (CSF) of CIOs. These factors fall into three categories. Category “Personality” includes “Accepting and embracing change” (CSF #1), “Being perseverant to pursue long-term goals” (CSF #2), “Anticipating the future through visionary thinking” (CSF #3), and “Being empathetic to deal with uncertainty felt by co-workers” (CSF #4). The “Role Fulfilment” category includes “Cross-functional involvement and integration of the IT organization” (CSF #5), “Positioning and restructuring of the IT organization” (CSF #6), and “Well-connected and communicative leadership” (CSF #7). The “Organizational Environment” category consists of “Availability of skilled workforce” (CSF #8) and “Reporting line to the CEO” (CSF #9). CSFs 1, 2, and 3 were perceived as most important by the participating CIOs. The results may be of particular interest both to aspiring CIOs and equally their employing organizations, as they reflect what long-term CIOs value during their time in office. KW - Chief information officer KW - CIO tenure KW - Critical success factors KW - CIO roles KW - Interview-based exploratory mixed-method study Y1 - 2022 U6 - https://doi.org/10.1007/s10257-021-00546-z N1 - Corresponding Author: Markus Westner VL - 20 SP - 79 EP - 122 PB - Springer Nature ER - TY - JOUR A1 - Stein, Oliver T1 - On analytic properties of the standard zeta function attached to a vector-valued modular form JF - Research in Number Theory N2 - We proof a Garrett–Böcherer decomposition of a vector-valued Siegel Eisenstein series E2l,0 of genus 2 transforming with the Weil representation of Sp2(Z) on the group ring C[(L′/L)2]. We show that the standard zeta function associated to a vector-valued common eigenform f for the Weil representation can be meromorphically continued to the whole s-plane and that it satisfies a functional equation. The proof is based on an integral representation of this zeta function in terms of f and E2l,0. Y1 - 2022 U6 - https://doi.org/10.1007/s40993-022-00368-z N1 - Corresponding author: Oliver Stein VL - 8 IS - 4 SP - 1 EP - 27 PB - Springer Nature ER - TY - CHAP A1 - Schenke, Diana Marie A1 - Baumann, Timo ED - Möller, Sebastian ED - Knoeferle, Pia ED - Schulte, Britta ED - Feldhus, Nils T1 - Controlled Diversity: Length-optimized Natural Language Generation T2 - Proceedings of the ISCA/ITG Workshop on Diversity in Large Speech and Language Models, February 20, 2025 in Berlin, Germany N2 - LLMs are not generally able to adjust the length of their outputs based on strict length requirements, a capability that would improve their usefulness in applications that require adherence to diverse user and system requirements. We present an approach to train LLMs to acquire this capability by augmenting existing data and applying existing fine-tuning techniques, which we compare based on the trained models’ adherence to the length requirement and overall response quality relative to the baseline model. Our results demonstrate that these techniques can be successfully applied to train LLMs to adhere to length requirements, with the trained models generating texts which better align to the length requirements. Our results indicate that our method may change the response quality when using training data that was not generated by the baseline model. This allows simultaneous alignment to another training objective in certain scenarios, but is undesirable otherwise. Training on a dataset containing the model’s own responses eliminates this issue. Y1 - 2025 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-80534 ER - TY - INPR A1 - Amanpour, Ali A1 - Baumann, Timo A1 - Hofmann, Ulrich G. T1 - Optimizing Neural Data Analysis: Determining Minimum Recording Length for Unambigous Signal Processing N2 - Advanced silicon electrode arrays facilitate the recording of thousands of neurons, generating extensive neural data that imposes a significant burden on researchers and processing algorithms. Thus, real-time analysis pipelines are gaining increasing value, while at the same time having to deal with non-stationary and noisy data. We intend to apply Machine Learning (ML) algorithms to a dense set of recordings from rat brains in order to prepare a functional atlas, correlating neuronal signals with anatomical position. While doing so, we needed to decide on a rational way which recording snippet length would best represent the original, longer source sequence and thus suffices to be further processed for anatomical correlation. We implemented an algorithm to evaluate the spectral information of systematically length varied records based on similarity to the original record. For our dataset a recording duration of 3 seconds satisfied moderate requirements across all channels, thus allowing us to reduce computational load for ongoing ML classification of microprobe sourced electrophysiologic signals. Y1 - 2025 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-80606 ER -