TY - CHAP A1 - Hillmann, Stefan A1 - Kowol, Philine A1 - Ahmad, Adnan A1 - Tang, Ruochen A1 - Möller, Sebastian ED - Baumann, Timo T1 - Usability and User Experience of a Chatbot for Student Support T2 - Elektronische Sprachsignalverarbeitung 2024, Tagungsband der 35. Konferenz, Regensburg, 6.-8. März 2024 N2 - This paper describes the usability evaluation of the parts of the CHATU chatbot. The evaluation was conducted with 21 participants. A focus of this paper is the description of the carefully designed evaluation procedure, which aims to avoid textual priming of the participants. The general evaluation procedure can be applied to other speech- or text-based conversational systems, and additional material is provided. The evaluation results show that the usability and user experience of CHATU are positively rated. However, the naturalness and novelty of the interaction are not optimal, and the potential influence of users’ experience with LLMs on the evaluation is discussed. Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-70760 SN - 978-3-95908-325-6 SP - 22 EP - 29 PB - TUDpress CY - Dresden ER -