TY - CHAP A1 - Bieber, Carina A1 - Harms, Patrick A1 - Leppich, Dominick A1 - Proschek, Katrin T1 - AI-based User Emotion Recognition from Interaction Data : Challenges and Guidelines for Training Data Creation T2 - MODELS Companion ´24 N2 - Artificial Intelligence (AI) is a rising topic in the field of emotion recognition, e.g., from facial expressions. However, existing methods often require to be performed in staged set ups and are obtrusive by gathering additional data. Especially, collecting video data includes a high data protection risk. Our approach is to provide an unobtrusive emotion recognition tool based on Keystroke, Mouse and Touchscreen (KMT) data. Recently, we published a data set for emotion recognition from keystroke and mouse interaction data. In this paper, we present the challenges we faced during the creation of the data set. This covers collecting User Interface (UI) data as well as emotional ground truth data. For each of seven mentioned challenges, we provide our solutions as well as guidelines for other researchers to prevent them. The challenges include possible issues with recorded data as well as issues of automated facial coding engines. We provide a possible approach for manual facial coding and describe aspects attention should be paid to. Furthermore, we indicate issues when using different software tools to collect the data. The paper aims to help other researchers by providing insights and a guideline for the creation of the data set. We make these insights available for other researchers who want to create similar data sets or who want to expand ours. By sharing our insights, we aim to improve the reproducibility of AI training data creation and AI-based emotion recognition from user interaction data. KW - data set, artificial intelligence, emotion recognition, user interaction Y1 - 2024 U6 - https://doi.org/10.1145/3652620.3686245 ER - TY - JOUR A1 - Leppich, Dominick A1 - Bieber, Carina A1 - Proschek, Katrin A1 - Harms, Patrick A1 - Schubert, Ulf T1 - DUX : a dataset of user interactions and user emotions JF - i-com : Journal of Interactive Media N2 - User experience evaluation is becoming increasingly important, and so is emotion recognition. Recognizing users’ emotions based on their interactions alone would not be intrusive to users and can be implemented in many applications. This is still an area of active research and requires data containing both the user interactions and the corresponding emotions. Currently, there is no public dataset for emotion recognition from keystroke, mouse and touchscreen dynamics. We have created such a dataset for keyboard and mouse interactions through a dedicated user study and made it publicly available for other researchers. This paper examines our study design and the process of creating the dataset. We conducted the study using a test application for travel expense reports with 50 participants. We want to be able to detect predominantly negative emotions, so we added emotional triggers to our test application. However, further research is needed to determine the relationship between user interactions and emotions. KW - dataset KW - user emotions KW - user experience KW - user interactions Y1 - 2023 U6 - https://doi.org/10.1515/icom-2023-0014 SN - 2196-6826 IS - 2 PB - Oldenburg Wissenschaftsverlag CY - Oldenburg ER -