TY - CHAP A1 - Withanage, Daksitha A1 - Lingenfelser, Florian A1 - Kuch, Johanna A1 - Grothe, Otto A1 - Schlagowski, Ruben A1 - André, Elisabeth A1 - Mertes, Silvan ED - Gebhard, Patrick ED - Schneeberger, Tanja ED - Biancardi, Beatrice ED - Sabouret, Nicolas ED - Schmitz, Michael ED - Yumak, Zerrin T1 - VoiceX as a Design Tool for Virtual Agents' Voices T2 - Proceedings of the 25th ACM International Conference on Intelligent Virtual Agents KW - text-to-speech KW - TTS KW - voice creation KW - voice adaptation KW - voice customization Y1 - 2025 SN - 979-8-4007-1508-2 U6 - https://doi.org/10.1145/3717511.3749296 PB - ACM CY - New York, NY, USA ER - TY - CHAP A1 - Holzinger, Johanna A1 - Heimerl, Alexander A1 - Schlagowski, Ruben A1 - André, Elisabeth A1 - Mertes, Silvan ED - Ludovico, Luca Andrea ED - Mauro, Davide Andrea T1 - A Machine Learning-Driven Interactive Training System for Extreme Vocal Techniques T2 - AM '24: Proceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures KW - extreme vocals KW - learning application KW - interactive learning KW - vocal techniques KW - interaction design Y1 - 2024 SN - 979-8-4007-0968-5 U6 - https://doi.org/10.1145/3678299.3678334 SP - 348 EP - 354 PB - ACM CY - New York, NY, USA ER - TY - CHAP A1 - Schlagowski, Ruben A1 - Mertes, Silvan A1 - Nazarenko, Dariia A1 - Dauber, Alexander A1 - André, Elisabeth ED - Ludovico, Luca Andrea ED - Mauro, Davide Andrea T1 - XR Composition in the Wild: The Impact of User Environments on Creativity, UX and Flow during Music Production in Augmented Reality T2 - AM '24: Proceedings of the 19th International Audio Mostly Conference: Explorations in Sonic Cultures KW - creativity KW - creativity support tools KW - augmented reality KW - musical KW - XR KW - head-mounted displays KW - mixed reality KW - spatial computing KW - generative adversarial networks Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:384-opus4-1154500 SN - 979-8-4007-0968-5 SP - 152 EP - 161 PB - ACM CY - New York, NY, USA ER - TY - CHAP A1 - van Rijn, Pol A1 - Mertes, Silvan A1 - Janowski, Kathrin A1 - Weitz, Katharina A1 - Jacoby, Nori A1 - André, Elisabeth ED - Mueller, Florian Floyd ED - Kyburz, Penny ED - Williamson, Julie R. ED - Sas, Corina ED - Wilson, Max L. ED - Toups Dugas, Phoebe ED - Shklovski, Irina T1 - Giving Robots a Voice: Human-in-the-Loop Voice Creation and Open-Ended Labeling T2 - CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems KW - crowdsourcing KW - personalization KW - text/speech/language KW - robot Y1 - 2024 SN - 979-8-4007-0330-0 U6 - https://doi.org/10.1145/3613904.3642038 SP - 10394 EP - 10427 PB - Association for Computing Machinery (ACM) CY - New York, NY, USA ER - TY - CHAP A1 - Withanage Don, Daksitha Senel A1 - Schiller, Dominik A1 - Hallmen, Tobias A1 - Mertes, Silvan A1 - Baur, Tobias A1 - Lingenfelser, Florian A1 - André, Elisabeth A1 - Müller, Mitho A1 - Kaubisch, Lea A1 - Reck, Corinna T1 - Towards Automated Annotation of Infant-Caregiver Engagement Phases with Multimodal Foundation Models T2 - ICMI '24: Proceedings of the 26th International Conference on Multimodal Interaction KW - developmental psychology KW - caregiver-infant interaction KW - still face KW - paradigm KW - automated annotation KW - self-supervised learning Y1 - 2024 UR - https://opus.bibliothek.uni-augsburg.de/opus4/frontdoor/deliver/index/docId/116607/file/116607.pdf SN - 979-8-4007-0462-8 U6 - https://doi.org/10.1145/3678957.3685704 SP - 428 EP - 438 PB - ACM CY - New York ER - TY - CHAP A1 - Mertes, Silvan A1 - Strobl, Marcel A1 - Schlagowski, Ruben A1 - André, Elisabeth ED - André, Elisabeth ED - Chetouani, Mohamed ED - Vaufreydaz, Dominique ED - Lucas, Gale ED - Schultz, Tanja ED - Morency, Louis-Philippe ED - Vinciarelli, Alessandro T1 - ASMRcade: Interactive Audio Triggers for an Autonomous Sensory Meridian Response T2 - ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction KW - ASMR KW - interactive ASMR KW - ASMR generation KW - GAN KW - stress KW - audio KW - synthesis Y1 - 2023 UR - https://opus.bibliothek.uni-augsburg.de/opus4/frontdoor/deliver/index/docId/113727/file/113727.pdf SN - 979-8-4007-0055-2 U6 - https://doi.org/10.1145/3577190.3614155 SP - 70 EP - 78 PB - ACM CY - New York, NY ER - TY - CHAP A1 - Schlagowski, Ruben A1 - Mertes, Silvan A1 - Schiller, Dominik A1 - Can, Yekta Said A1 - André, Elisabeth ED - Fred, Ana ED - Hadjali, Allel ED - Gusikhin, Oleg ED - Sansone, Carlo T1 - Exploring Physiology-Based Classification of Flow During Musical Improvisation in Mixed Reality T2 - Deep Learning Theory and Applications: 5th International Conference, DeLTA 2024, Dijon, France, July 10–11, 2024, Proceedings, Part I KW - affective computing KW - machine learning KW - physiological signals KW - flow state KW - music collaboration KW - networked music performance KW - mixed reality KW - augmented reality KW - virtual reality Y1 - 2024 SN - 978-3-031-66693-3 SN - 978-3-031-66694-0 U6 - https://doi.org/10.1007/978-3-031-66694-0_18 SN - 1865-0929 SN - 1865-0937 IS - Schriftenreihe: Communications in Computer and Information Science, 2171 SP - 296 EP - 309 PB - Springer Nature Switzerland CY - Cham ER - TY - CHAP A1 - Schiller, Dominik A1 - Mertes, Silvan A1 - Achzet, Marcel A1 - Hellmann, Fabio A1 - Schlagowski, Ruben A1 - André, Elisabeth ED - Fred, Ana ED - Hadjali, Allel ED - Gusikhin, Oleg ED - Sansone, Carlo T1 - More Than Noise: Assessing the Viscosity of Food Products Based on Sound Emission T2 - Deep Learning Theory and Applications: 5th International Conference, DeLTA 2024, Dijon, France, July 10–11, 2024, Proceedings, Part I KW - machine learning KW - Industry 4.0 KW - viscosity estimation Y1 - 2024 SN - 978-3-031-66693-3 SN - 978-3-031-66694-0 U6 - https://doi.org/10.1007/978-3-031-66694-0_13 SN - 1865-0929 SN - 1865-0937 IS - Schriftenreihe: Communications in Computer and Information Science, 2171 SP - 210 EP - 218 PB - Springer Nature Switzerland CY - Cham ER - TY - CHAP A1 - Ritschel, Hannes A1 - Aslan, Ilhan A1 - Mertes, Silvan A1 - Seiderer, Andreas A1 - André, Elisabeth T1 - Personalized Synthesis of Intentional and Emotional Non-Verbal Sounds for Social Robots T2 - 2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII) KW - sound synthesis KW - non-verbal sounds KW - emotions KW - intents KW - adaptation KW - social robots KW - appearance-constrained robots Y1 - 2019 SN - 978-1-7281-3888-6 U6 - https://doi.org/10.1109/ACII.2019.8925487 SN - 2156-8111 SP - 364 EP - 370 PB - IEEE ER - TY - CHAP A1 - Kiderle, Thomas A1 - Dobre, Cristina Georgiana A1 - Nasir, Jauwairia A1 - Gonzalez Diaz, Carlos A1 - Ritschel, Hannes A1 - Klein, Stina A1 - Mertes, Silvan A1 - André, Elisabeth ED - Gebhard, Patrick ED - Schneeberger, Tanja ED - Biancardi, Beatrice ED - Sabouret, Nicolas ED - Schmitz, Michael ED - Yumak, Zerrin T1 - Multimodal Generation of Contextualized Jokes for a Real-Time Virtual Character T2 - Proceedings of the 25th ACM International Conference on Intelligent Virtual Agents KW - meta-human KW - humor KW - joke KW - LLM KW - marker KW - humor-framing-devices KW - listening KW - real-time interaction KW - human-centered computing KW - human computer interaction (HCI) Y1 - 2025 SN - 979-8-4007-1508-2 U6 - https://doi.org/10.1145/3717511.3749299 N1 - Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s). PB - ACM CY - New York ER - TY - CHAP A1 - Withanage Don, Daksitha Senel A1 - Kiderle, Thomas A1 - Mertes, Silvan A1 - Schiller, Dominik A1 - Ritschel, Hannes A1 - André, Elisabeth ED - Li, Toby ED - Paternò, Fabio ED - Väänänen, Kaisa ED - Leiva, Luis ED - Spano, Davide ED - Verbert, Katrien T1 - MeLaX: Conversations with Generative AI in Socially Interactive Agents T2 - Companion Proceedings of the 30th International Conference on Intelligent User Interfaces KW - generative AI KW - socially interactive agents KW - real-time systems KW - human-centered computing KW - machine learning theory Y1 - 2025 SN - 9798400714092 U6 - https://doi.org/10.1145/3708557.3716363 N1 - Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s). SP - 163 EP - 166 PB - ACM CY - New York ER - TY - CHAP A1 - Kuch, Johanna Magdalena A1 - Heisler, Marcel A1 - Klein, Stina A1 - Mertes, Silvan A1 - Eing, Lennart A1 - André, Elisabeth A1 - Becker-Asano, Christian T1 - Your Robot, My Voice: Enhancing Android Robot Likability through Personalization by Cloning the User’s Voice T2 - 2025 34th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) KW - design methodology KW - cloning KW - humanoid robots KW - human-robot interaction KW - speech recognition KW - acoustic measurements KW - acoustics KW - androids KW - anthropomorphism KW - robots Y1 - 2025 SN - 979-8-3315-8771-0 U6 - https://doi.org/10.1109/RO-MAN63969.2025.11217611 SN - 1944-9437 SP - 192 EP - 198 PB - IEEE CY - New York ER - TY - CHAP A1 - Mertes, Silvan A1 - Huber, Tobias A1 - Karle, Christina A1 - Weitz, Katharina A1 - Schlagowski, Ruben A1 - Conati, Cristina A1 - André, Elisabeth ED - Larson, Kate T1 - Relevant Irrelevance: Generating Alterfactual Explanations for Image Classifiers T2 - IJCAI '24: Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence Y1 - 2024 UR - https://opus.bibliothek.uni-augsburg.de/opus4/frontdoor/deliver/index/docId/113725/file/113725.pdf SN - 978-1-956792-04-1 U6 - https://doi.org/10.24963/ijcai.2024/52 SP - 467 EP - 475 PB - International Joint Conferences on Artificial Intelligence CY - California ER - TY - CHAP A1 - Hallmen, Tobias A1 - Mertes, Silvan A1 - Schiller, Dominik A1 - Lingenfelser, Florian A1 - André, Elisabeth ED - Fred, Ana ED - Conte, Donatello ED - Gusikhin, Oleg ED - Sansone, Carlo T1 - Phoneme-Based Multi-task Assessment of Affective Vocal Bursts T2 - Deep Learning Theory and Applications. KW - data2vec KW - wav2vec2 KW - wav2vec2phoneme KW - vocal bursts KW - affective vocal bursts Y1 - 2023 SN - 978-3-031-39059-3 U6 - https://doi.org/10.1007/978-3-031-39059-3_14 SN - 1865-0937 IS - Communications in Computer and Information Science,1875 SP - 209 EP - 222 PB - Springer Nature Switzerland CY - Cham ER - TY - CHAP A1 - Heimerl, Alexander A1 - Mertes, Silvan A1 - Schneeberger, Tanja A1 - Baur, Tobias A1 - Liu, Ailin A1 - Becker, Linda A1 - Rohleder, Nicolas A1 - Gebhard, Patrick A1 - André, Elisabeth ED - Rodrigo, Maria Mercedes ED - Matsuda, Noburu ED - Cristea, Alexandra I. ED - Dimitrova, Vania T1 - Generating Personalized Behavioral Feedback for a Virtual Job Interview Training System Through Adversarial Learning T2 - Lecture Notes in Computer Science KW - job interview training KW - generative adversarial networks KW - counterfactual explanations KW - engagement Y1 - 2022 SN - 978-3-031-11644-5 U6 - https://doi.org/10.1007/978-3-031-11644-5_67 SN - 1611-3349 VL - 13355 SP - 679 EP - 684 PB - Springer International Publishing CY - Cham ER - TY - CHAP A1 - Schlagowski, Ruben A1 - Nazarenko, Dariia A1 - Can, Yekta A1 - Gupta, Kunal A1 - Mertes, Silvan A1 - Billinghurst, Mark A1 - André, Elisabeth ED - Schmidt, Albrecht ED - Väänänen, Kaisa ED - Goyal, Tesh ED - Kristensson, Per Ola ED - Peters, Anicia ED - Mueller, Stefanie ED - Williamson, Julie R. ED - Wilson, Max L. T1 - Wish You Were Here: Mental and Physiological Effects of Remote Music Collaboration in Mixed Reality T2 - Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems KW - mixed reality KW - augmented reality KW - remote collaboration KW - head‑mounted displays KW - networked music performance KW - co-presence KW - social presence KW - physiological signal processing KW - psychophysiology Y1 - 2023 SN - 978-3-031-39059-3 U6 - https://doi.org/10.1145/3544548.3581162 SN - 1865-0937 PB - ACM CY - New York ER - TY - CHAP A1 - Kiderle, Thomas A1 - Ritschel, Hannes A1 - Mertes, Silvan A1 - André, Elisabeth ED - Lugrin, Birgit ED - Latoschik, Marc ED - von Mammen, Sebastian ED - Kopp, Stefan ED - Pécune, Florian ED - Pelachaud, Catherine T1 - Multimodal Irony for Virtual Characters T2 - Proceedings of the 23rd ACM International Conference on Intelligent Virtual Agents Y1 - 2023 SN - 978-3-031-39059-3 U6 - https://doi.org/10.1145/3570945.3607299 SN - 1865-0937 N1 - Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s). PB - ACM CY - New York ER - TY - CHAP A1 - Mertes, Silvan A1 - Schiller, Dominik A1 - Dietz, Michael A1 - André, Elisabeth A1 - Lingenfelser, Florian T1 - The AffectToolbox: Affect Analysis for Everyone T2 - 2024 12th International Conference on Affective Computing and Intelligent Interaction (ACII) KW - affective computing KW - social signal analysis KW - open source KW - emotion recognition KW - affect recognition KW - multimodel fusion KW - pleasure KW - valence KW - arousal KW - dominance Y1 - 2024 SN - 979-8-3315-1643-7 U6 - https://doi.org/10.1109/ACII63134.2024.00026 SP - 185 EP - 193 PB - IEEE ER - TY - CHAP A1 - Kuch, Johanna Magdalena A1 - Nasir, Jauwairia A1 - Mertes, Silvan A1 - Schlagowski, Ruben A1 - Becker-Asano, Christian A1 - André, Elisabeth T1 - Evaluating Gender Ambiguity, Novelty and Anthropomorphism in Humming and Talking Voices for Robots T2 - 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN) Y1 - 2024 U6 - https://doi.org/10.1109/RO-MAN60168.2024.10731423 SP - 2219 EP - 2225 PB - IEEE ER - TY - CHAP A1 - Ritschel, Hannes A1 - Mertes, Silvan A1 - Lingenfelser, Florian A1 - Kiderle, Thomas A1 - André, Elisabeth ED - Lugrin, Birgit ED - Latoschik, Marc ED - von Mammen, Sebastian ED - Kopp, Stefan ED - Pécune, Florian ED - Pelachaud, Catherine T1 - The Affective Bar Piano T2 - Proceedings of the 23rd ACM International Conference on Intelligent Virtual Agents KW - affective computing KW - virtual agents KW - interactive music KW - musical storytelling Y1 - 2023 SN - 978-3-031-39059-3 U6 - https://doi.org/10.1145/3570945.3607358 SN - 1865-0937 N1 - Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s). PB - ACM CY - New York ER - TY - CHAP A1 - Mertes, Silvan A1 - Lingenfelser, Florian A1 - Kiderle, Thomas A1 - Dietz, Michael A1 - Diab, Lama A1 - André, Elisabeth ED - Fred, Ana ED - Sansone, Carlo ED - Madani, Kurosh T1 - Continuous Emotions: Exploring Label Interpolation in Conditional Generative Adversarial Networks for Face Generation T2 - Proceedings of the 2nd International Conference on Deep Learning Theory and Applications KW - generative adversarial networks KW - face generation KW - conditional GAN KW - emotion generation KW - label interpolation Y1 - 2021 U6 - https://doi.org/10.5220/0010549401320139 SP - 132 EP - 139 PB - SCITEPRESS - Science and Technology Publications CY - Setúbal ER - TY - CHAP A1 - Mertes, Silvan A1 - Karle, Christina A1 - Huber, Tobias A1 - Weitz, Katharina A1 - Schlagowski, Ruben A1 - André, Elisabeth T1 - Alterfactual Explanations – The Relevance of Irrelevance for Explaining AI Systems Y1 - 2022 U6 - https://doi.org/10.48550/arXiv.2207.09374 ER - TY - CHAP A1 - van Rijn, Pol A1 - Mertes, Silvan A1 - Schiller, Dominik A1 - Dura, Piotr A1 - Siuzdak, Hubert A1 - Harrison, Peter M. C. A1 - André, Elisabeth A1 - Jacoby, Nori T1 - VoiceMe: Personalized Voice Generation in TTS T2 - Interspeech 2022 KW - voice KW - personalization KW - speech KW - avatar KW - characters KW - human-computer interaction Y1 - 2022 U6 - https://doi.org/10.21437/Interspeech.2022-10855 SP - 2588 EP - 2592 ER - TY - CHAP A1 - Huber, Tobias A1 - Demmler, Maximilian A1 - Mertes, Silvan A1 - Olson, Matthew L. A1 - André, Elisabeth ED - Agmon, Noa ED - An, Bo ED - Ricci, Alessandro ED - Yeoh, William T1 - GANterfactual-RL: Understanding Reinforcement Learning Agents’ Strategies through Visual Counterfactual Explanations T2 - AAMAS '23: Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems KW - explainable deep reinforcement learning KW - explainable artificial intelligence KW - interpretable machine learning Y1 - 2023 UR - https://dl.acm.org/doi/10.5555/3545946.3598751 SN - 978-1-4503-9432-1 SP - 1097 EP - 1106 PB - International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS) CY - Richland, SC ER - TY - CHAP A1 - Kiderle, Thomas A1 - Ritschel, Hannes A1 - Janowski, Kathrin A1 - Mertes, Silvan A1 - Lingenfelser, Florian A1 - André, Elisabeth T1 - Socially-Aware Personality Adaptation T2 - 2021 9th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW) KW - personality adaptation KW - socially-aware reinforcement learning KW - virtual agent KW - personality expression Y1 - 2021 SN - 978-1-6654-0021-3 U6 - https://doi.org/10.1109/ACIIW52867.2021.9666197 PB - IEEE ER - TY - CHAP A1 - Huber, Tobias A1 - Mertes, Silvan A1 - Rangelova, Stanislava A1 - Flutura, Simon A1 - André, Elisabeth T1 - Dynamic Difficulty Adjustment in Virtual Reality Exergames through Experience-driven Procedural Content Generation T2 - 2021 IEEE Symposium Series on Computational Intelligence (SSCI) KW - dynamic difficulty adjustment KW - procedural content generation KW - exergames KW - virtual reality KW - deep reinforcement learning Y1 - 2021 SN - 978-1-7281-9048-8 U6 - https://doi.org/10.1109/SSCI50451.2021.9660086 PB - IEEE ER - TY - CHAP A1 - Rijn, Pol van A1 - Mertes, Silvan A1 - Schiller, Dominik A1 - Harrison, Peter M.C. A1 - Larrouy-Maestri, Pauline A1 - André, Elisabeth A1 - Jacoby, Nori T1 - Exploring Emotional Prototypes in a High Dimensional TTS Latent Space T2 - Interspeech 2021 KW - emotion KW - prosody KW - speech KW - TTS KW - human-computer interaction KW - computational paralinguistics Y1 - 2021 U6 - https://doi.org/10.21437/Interspeech.2021-1538 SP - 3870 EP - 3874 PB - ISCA ER - TY - CHAP A1 - Schiller, Dominik A1 - Mertes, Silvan A1 - van Rijn, Pol A1 - André, Elisabeth T1 - Bridging the Gap: End-to-End Domain Adaptation for Emotional Vocalization Classification using Adversarial Learning T2 - Proceedings of the 3rd International on Multimodal Sentiment Analysis Workshop and Challenge KW - adversarial learning KW - domain adaptation KW - emotion KW - vocalization KW - Generative Adversarial Networks KW - cycleGANs Y1 - 2022 SN - 978-1-4503-9484-0 U6 - https://doi.org/10.1145/3551876.3554816 SP - 95 EP - 100 PB - ACM CY - New York, USA ER - TY - CHAP A1 - Mertes, Silvan A1 - Margraf, Andreas A1 - Geinitz, Steffen A1 - André, Elisabeth ED - Fred, Ana ED - Sansone, Carlo ED - Madani, Kurosh T1 - Alternative Data Augmentation for Industrial Monitoring Using Adversarial Learning T2 - Deep Learning Theory and Applications KW - image-to-image translation KW - carbon fiber KW - data augmentation KW - computer vision KW - industrial monitoring KW - adversarial learning Y1 - 2023 SN - 9783031373190 U6 - https://doi.org/10.1007/978-3-031-37320-6_1 SN - 1865-0929 VL - 1854 IS - (Communications in Computer and Information Science, 1854) SP - 1 EP - 23 PB - Springer Nature CY - Cham ER - TY - CHAP A1 - Mertes, Silvan A1 - Baird, Alice A1 - Schiller, Dominik A1 - Schuller, Björn W. A1 - André, Elisabeth T1 - An Evolutionary-based Generative Approach for Audio Data Augmentation T2 - 2020 IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP) KW - sound generation KW - data augmentation KW - evolutionary computing KW - latent vector evolution KW - generative adversarial networks Y1 - 2020 SN - 978-1-7281-9320-5 U6 - https://doi.org/10.1109/MMSP48831.2020.9287156 PB - IEEE ER -