TY - CHAP A1 - Ezer, Timur A1 - Greiner, Matthias A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Eye tracking al technology in education; data quality analysis and improvements T2 - Proceedings of the 16th annual International Conference of Education, Research and Innovation (ICERI 2023), Seville, Spain, 11/13/2023 - 11/14/2023 N2 - Eye tracking has proven to be a powerful tool in a variety of empirical research areas; hence, it is steadily gaining attention. Driven by the expanding frontiers of Artificial Intelligence and its potential for data analysis, eye tracking technology offers promising applications in diverse fields, from usability research to cognitive research. The education sector in particular can benefit from the increased use of eye tracking technology - both indirectly, for example by studying the differences in gaze patterns between experts and novices to identify promising strategies, and directly by using the technology itself to teach in future classrooms. As with any empirical method, the results depend directly on the quality of the data collected. That raises the question of which parameters educators or researchers can influence to maximize the data quality of an eye tracker. This is the starting point of the present work: In an empirical study of eye tracking as an (educational) technology, we systematically examine factors that influence the data quality, such as illumination, sampling frequency, and head orientation - parameters that can be varied without much additional effort in everyday classroom or research use - using two human subjects, an artificial face, and the Tobii Pro Spectrum. We rely on metrics derived from the raw gaze data, such as accuracy or precision, to measure data quality. The obtained results derive practical advice for educators and researchers, such as using the lowest sampling frequency appropriate for a certain purpose. Thereby, this research fills a gap in the current understanding of eye tracker performance and, by offering best practices, enables researchers or teachers to produce data of the highest quality possible and therefore best results when using eye trackers in laboratories or future classrooms. Y1 - 2023 U6 - https://doi.org/10.21125/iceri.2023.1127 SP - 4500 EP - 4509 PB - IATED ER - TY - CHAP A1 - Homann, Alexander A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - An Eye Tracking Study on MISRA C Coding Guidelines T2 - ECSEE '23: Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - C is one of the most widely used programming languages - MISRA C is one of the most known sets of coding guidelines for C. This paper examines the usefulness and comprehensibility of the MISRA C:2012 guidelines in an eye tracking study. There, subjects encounter non-compliant code in four different code review settings: with no additional reference, with an actual MISRA C guideline, with a case-specific interpretation of a MISRA C guideline, and with a compliant version of the code. The data collected was analyzed not only in terms of the four presentation styles, but also by dividing the subjects into experience levels based on their semesters of study or years of work experience. Regarding the difference between actual and interpreted guidelines, we found that for interpreted guidelines the error detection rate is higher whereas the duration and frequency of visits to the guideline itself are mainly lower. This suggest that the actual guidelines are less useful and more difficult to understand. The former is contradicted by the subjects’ opinions: when surveyed, they rated the usefulness of the actual guidelines higher. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593671 SP - 130 EP - 137 PB - ACM ER - TY - CHAP A1 - Bock, T. A1 - Mottok, Jürgen A1 - Köhler, Thorsten ED - Mottok, Jürgen ED - Ziemann, Olaf T1 - A gesture-based human-machine interface using stereoscopic depth images T2 - 2nd Applied Research Conference 2012 (ARC 2012), 25./26. June 2012, Nuremberg N2 - Reasonable integration of gesture-based automotive HMI-functionality offers potential safety benefits by reducing driver distractions and glance times to operate tertiary in-car devices. Stereo camera systems are a well investigated choice to perform the task of generating depth data for spatial gesture recognition. This paper describes the functionality of our stereo vision software, which is intended for application in a target system based on CMOS wafer-level cameras. The retrieved point cloud data was passed to a gesture-based sample application. Y1 - 2012 SP - 166 EP - 169 PB - Shaker CY - Aachen ER - TY - CHAP A1 - Maier, Robert A1 - Mottok, Jürgen ED - Trapp, Mario ED - Saglietti, Francesca ED - Spisländer, Marc ED - Bitsch, Friedemann T1 - BayesianSafety - an Open-Source Package for Causality-Guided, Multi-Model Safety Analysis T2 - Computer Safety, Reliability, and Security, 41st International Conference (SAFECOMP 2022): Munich, Germany, September 6–9, 2022, Proceedings T2 - Lecture notes in computer science ; 13414 N2 - Development and verification of modern, dependable automotive systems require appropriate modelling approaches. Classic automotive safety is described by the normative regulations ISO 26262, its relative ISO/PAS 21448, and their respective methodologies. In recent publications, an emerging demand to combine environmental influences, machine learning, or reasoning under uncertainty with standard-compliant analysis techniques can be noticed. Therefore, adapting established methods like FTA and proper tool support is necessary. We argue that Bayesian Networks (BNs) can be used as a central component to address and merge these demands. In this paper, we present our Open-Source Python package BayesianSafety. First, we review how BNs relate to data-driven methods, model-to-model transformations, and causal reasoning. Together with FTA and ETA, these models form the core functionality of our software. After describing currently implemented features and possibilities of combining individual modelling approaches, we provide an informal view of the tool’s architecture and of the resulting software ecosystem. By comparing selected publicly available safety and reliability analysis libraries, we outline that many relevant methodologies yield specialized implementations. Finally, we show that there is a demand for a flexible, unifying analysis tool that allows researching system safety by using multi-model and multi-domain approaches. KW - Package BayesianSafety KW - Causality KW - Bayesian Networks KW - Event Tree Analysis KW - Fault Tree Analysis Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-14835-4_2 SP - 17 EP - 30 PB - Springer Nature CY - Cham ER - TY - CHAP A1 - Maier, Robert A1 - Grabinger, Lisa A1 - Urlhart, David A1 - Mottok, Jürgen ED - Seguin, Christel ED - Zeller, Marc ED - Prosvirnova, Tatiana T1 - Towards Causal Model-Based Engineering in Automotive System Safety T2 - Model-Based Safety and Assessment, 8th International Symposium, IMBSA 2022: Munich, Germany, September 5–7, 2022, Proceedings N2 - Engineering is based on the understanding of causes and effects. Thus, causality should also guide the safety assessment of complex systems such as autonomous driving cars. To ensure the safety of the intended functionality of these systems, normative regulations like ISO 21448 recommend scenario-based testing. An important task here is to identify critical scenarios, so-called edge and corner cases. Data-driven approaches to this task (e.g. based on machine learning) cannot adequately address a constantly changing operational design domain. Model-based approaches offer a remedy – they allow including different sources of knowledge (e.g. data, human experts) into safety considerations. With this paper, we outline a novel approach for ensuring automotive system safety. We propose to use structural causal models as a probabilistic modelling language to combine knowledge about an open-context environment from different sources. Based on these models, we investigate parameter configurations that are candidates for critical scenarios. In this paper, we first discuss some aspects of scenario-based testing. We then provide an informal introduction to causal models and relate their development lifecycle to the established V-model. Finally, we outline a generic workflow for using causal models to identify critical scenarios and highlight some challenges that arise in the process. Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-15842-1_9 SP - 116 EP - 129 PB - Springer Nature CY - Cham ER - TY - CHAP A1 - Maier, Robert A1 - Mottok, Jürgen T1 - Causality and Functional Safety - How Causal Models Relate to the Automotive Standards ISO 26262, ISO/PAS 21448, and UL 4600 T2 - 27th International Conference on Applied Electronics (AE): 06-07 September 2022, Pilsen, CZ N2 - With autonomous driving, the system complexity of vehicles will increase drastically. This requires new approaches to ensure system safety. Looking at standards like ISO 26262 or ISO/PAS 21448 and their suggested methodologies, an increasing trend in the recent literature can be noticed to incorporate uncertainty. Often this is done by using Bayesian Networks as a framework to enable probabilistic reasoning. These models can also be used to represent causal relationships. Many publications claim to model cause-effect relations, yet rarely give a formal introduction of the implications and resulting possibilities such an approach may have. This paper aims to link the domains of causal reasoning and automotive system safety by investigating relations between causal models and approaches like FMEA, FTA, or GSN. First, the famous “Ladder of Causation” and its implications on causality are reviewed. Next, we give an informal overview of common hazard and reliability analysis techniques and associate them with probabilistic models. Finally, we analyse a mixed-model methodology called Hybrid Causal Logic, extend its idea, and build the concept of a causal shell model of automotive system safety. KW - Causality KW - Reliability KW - Functional Safety Y1 - 2022 U6 - https://doi.org/10.1109/AE54730.2022.9920053 PB - IEEE ER - TY - CHAP A1 - Kristen, Meret A1 - Engl, Fabian A1 - Mottok, Jürgen T1 - Enhancing Phishing Detection: An Eye-Tracking Study on User Interaction and Oversights in Phishing Emails T2 - SECURWARE 2024 : The Eighteenth International Conference on Emerging Security Information, Systems and Technologies, November 03-07, 2024, Nice, France N2 - Phishing remains a significant threat to organizational security, necessitating effective countermeasures. This paper presents findings from an in-depth eye-tracking study with 103 participants, evaluating the effectiveness of phishing awareness tools and trainings. The study examines how a phishing awareness system influences user behavior, efficiency, and the ability to identify phishing attempts. By analyzing eye movements, the study reveals real-time interactions and oversights, providing insights into the decision-making process. Results indicate that while the system improves the efficiency of users already proficient in phishing detection, it does not universally enhance recognition rates. Notably, participants using the tool spent significantly less time looking at attachment-related phishing markers, indicating partial efficiency improvements. Since phishing attempts containing suspicious attachments were successful in 19% of cases, as compared to an overall phishing success rate of 15%, the phishing awareness tool is particularly useful here. A usability evaluation revealed that users reporting a higher perceived usability score profited more from the help of the tool. Additionally, no improvement in phishing detection rates was observed in users who had completed prior IT-security training, highlighting the necessity for a paradigm shift in phishing training to adequately prepare users for phishing attempts. Y1 - 2024 UR - https://www.thinkmind.org/library/SECURWARE/SECURWARE_2024/securware_2024_2_80_30041.html SN - 978-1-68558-206-7 SP - 71 EP - 80 PB - IARIA ER - TY - CHAP A1 - Staufer, Susanne A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Nadimpalli, Vamsi Krishna A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Learning elements in online learning management systems T2 - Proceedings of the 16th annual International Conference of Education, Research and Innovation (ICERI 2023), Seville, Spain, 11/13/2023 - 11/14/2023 Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-67725 SP - 3121 EP - 3130 PB - IATED ER - TY - CHAP A1 - Staufer, Susanne A1 - Nadimpalli, Vamsi Krishna A1 - Hauser, Florian A1 - Bittner, Dominik A1 - Grabinger, Lisa A1 - Bugert, Flemming A1 - Ezer, Timur A1 - Röhrl, Simon A1 - Mottok, Jürgen T1 - Persistence of Questionnaire Data on Learning Styles, Learning Strategies AND Personality Traits T2 - ICERI2024 Proceedings: 17th Annual International Conference of Education, Research and Innovation, 11th-13th November 2024, Seville, Spain N2 - In the context of learning, questionnaires are carried out to gain information about learners. This learner profile has various benefits, like adapting the learning content, promoting of self-reflection, or increasing motivation in learning and therefore better learning results. Some researchers take the results of such questionnaires as ground truth or trust them blindly. Examining how persistent questionnaires are, asking the same questions twice, and comparing the results is a way to prove or falsify this statement. Our research procedure compares the results of three different questionnaires. The first questionnaire is the ILS (index of learning styles) according to the Felder-Silverman Learning Style Model (FSLSM) with about 44 questions. Learning strategies are examined with the LIST-K questionnaire consisting of 39 questions after Klingsieck. The third and last questionnaire is about personality traits. With only ten questions, Rammstedt et al. describe the BFI-10 questionnaire for personality traits. To compare results, the same study with the three named questionnaires is carried out twice with three to four months in between. The sample includes 35 students in their bachelor studies taking the course Software Engineering in a blended learning format. After collecting the questionnaire data from the students, a comparison is made in two different ways. First, we compare the data points based on the given answers. Second, a comparison is made based on the calculated questionnaire results because each of the three questionnaires has its own analysis method. For example, the analysis method of the ILS delivers as a result four integers representing the four characteristics of a learning style, while LIST-K makes a factor analysis. The results of the paper show that both the given answers and the calculated questionnaire results differ. Not one student has given the same answer inside each questionnaire with causes, like a change of learning style, learning strategy, and personality traits, or not filling in conscientiously. KW - learning style KW - learning strategy KW - personality traits KW - questionnaire study Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-78246 SN - 978-84-09-63010-3 SN - 2340-1095 SP - 6310 EP - 6319 PB - IATED ER - TY - CHAP A1 - De, Sangita A1 - Niklas, Michael A1 - Brada, Premek A1 - Mottok, Jürgen T1 - Model Transformation of Application Software Component from Classic to Adaptive AUTOSAR: An Approach to Migrate Software Components T2 - SEAA 2018, the 44th EUROMICRO Conference on Software Engineering and Advanced Applications, August 29 - 31 2018, Prague, Czech Republic Y1 - 2018 SN - 978-3-902457-50-9 ER - TY - CHAP A1 - Bugert, Flemming A1 - Staufer, Susanne A1 - Bittner, Dominik A1 - Nadimpalli, Vamsi Krishna A1 - Ezer, Timur A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Mottok, Jürgen T1 - Ariadne's Thread for Unravelling Learning Paths: Identifying Learning Styles via Hidden Markov Models T2 - 2024 IEEE Global Engineering Education Conference (EDUCON), 08-11 May 2024, Kos Island, Greece N2 - Modern education through Learning Management Systems (LMSs) provides learners with personalized learning paths. This is achieved by first querying the learning style according to the theory of Felder and Silverman to recommend suitable learning content. However, a rigid learning style representation is lacking of adaptability to the learners' choices. Therefore, the present study evaluates the idea of providing adaption to the representation of learning styles by using Hidden Markov Models (HMMs). Thus, data is collected from participants out of the Higher Education Area. The Index of Learning Styles questionnaire is used to obtain the learning style based on the theory of Felder and Silverman. Also, a questionnaire that asks the respondents to create a preferred learning path with the sequence length of nine learning elements is provided. From the given data, we initially evaluate the probability relationships between learning styles and learning elements. Then, we use the Viterbi algorithm in HMMs to identify alterations in learning styles from the provided learning paths. The alignment is then quantified by introducing a metric called support value. The findings imply that our concept can be used to adapt the learning style based on the user's real choice of learning elements. Thus, the proposed model also offers a way to integrate a feedback loop within LMSs leading to an improvement of learning path recommendation algorithms. KW - Surveys KW - Knowledge engineering KW - Feedback loop KW - Learning management systems KW - Uncertainty KW - Viterbi algorithm Y1 - 2024 U6 - https://doi.org/10.1109/EDUCON60312.2024.10578825 SN - 2165-9567 SP - 1 EP - 7 PB - IEEE ER - TY - CHAP A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Mottok, Jürgen A1 - Jahn, Sabrina A1 - Nadimpalli, Vamsi Krishna T1 - The Expert’s View: Eye Movement Modeling Examples in Software Engineering Education T2 - Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - This study investigates the impact of eye movement modeling examples in Software Engineering education. Software Engineering is a highly visual domain. The daily tasks of a software engineer (e.g., formulating requirements, creating UML diagrams, or conducting a code review) require in many cases the use of certain visual strategies. Although these strategies can be found for experts, it has been observed in different eye tracking studies that students have difficulties in learning and applying them. To familiarize students with these visual strategies and to provide them with a better understanding for the cognitive processes involved, a total of seven eye movement modeling examples was created. The seven eye movement modeling examples cover relevant parts of an introductory Software Engineering lecture; they are focused on typical situations in which visual strategies are applied. The results of a questionnaire-based evaluation shows that students consider the eye movement modeling examples as useful, feel supported in their learning process, and would like to see more use of them in the Software Engineering lecture. Furthermore, the students suggested that eye movement modeling examples should also be used in other lectures. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593683 SP - 148 EP - 152 PB - ACM ER - TY - CHAP A1 - Bugert, Flemming A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Hauser, Florian A1 - Nadimpalli, Vamsi Krishna A1 - Staufer, Susanne A1 - Mottok, Jürgen T1 - Towards Learning Style Prediction based on Personality T2 - Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - This paper assesses the relation between personality, demographics, and learning style. Hence, data is collected from 200 participants using 1) the BFI-10 to obtain the participant’s expression of personality traits according to the five-factor model, 2) the ILS to determine the participant’s learning style according to Felder and Silverman, and 3) a demographic questionnaire. From the obtained data, we train and evaluate a Bayesian network. Using Bayesian statistics, we show that age and gender slightly influence personality and that demographics as well as personality have at least a minor effect on learning styles. We also discuss the limitations and future work of the presented approach. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593682 SP - 48 EP - 55 PB - ACM ER - TY - CHAP A1 - Bittner, Dominik A1 - Hauser, Florian A1 - Nadimpalli, Vamsi Krishna A1 - Grabinger, Lisa A1 - Staufer, Susanne A1 - Mottok, Jürgen T1 - Towards Eye Tracking based Learning Style Identification T2 - Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - The dropout rate at universities has been very high for years. Thereby, the inexperience and lack of knowledge of students in dealing with individual learning paths in various courses of study plays a decisive role. Adaptive learning management systems are suitable countermeasures, in which learners’ learning styles are classified using questionnaires or computationally intensive algorithms before a learning path is suggested accordingly. In this paper, a study design for student learning style classification using eye tracking is presented. Furthermore, qualitative and quantitative analyses clarify certain relationships between students’ eye movements and learning styles. With the help of classification based on eye tracking, the filling out of questionnaires or the integration of computationally or cost-intensive algorithms can be made redundant in the future. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593680 SP - 138 EP - 147 PB - ACM ER - TY - CHAP A1 - Nadimpalli, Vamsi Krishna A1 - Bugert, Flemming A1 - Bittner, Dominik A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Staufer, Susanne A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Towards personalized learning paths in adaptive learning management systems: bayesian modelling of psychological theories T2 - Proceedings of the 16th annual International Conference of Education, Research and Innovation (ICERI 2023), Seville, Spain, 11/13/2023 - 11/14/2023 N2 - In educational research, non-personalized learning content increases learners' cognitive load, causing them to lower their performance and sometimes drop out of the course. Personalizing learning content with learners’ unique characteristics, like learning styles, personality traits, and learning strategies, is being suggested to improve learners’ success. Several theories exist for assessing learners’ unique characteristics. By the end of 2020, 71 learning style theories have been formulated, and research has shown that combining multiple learning style theories to recommend learning paths yields better results. As of the end of 2022, there is no single research that demonstrates a relationship between the Index of Learning Styles (ILS) based Felder-Silverman learning style model (FSLSM) dimensions, Big Five (BFI-10) based personality traits, and the Learning strategies in studying (LIST-K) based learning strategies factors for personalizing learning content. In this paper, an innovative approach is proposed to estimate the relationship between these theories and map the corresponding learning elements to create personalized learning paths. Respective questionnaires were distributed to 297 higher education students for data collection. A three-step approach was formulated to estimate the relationship between the models. First, a literature search was conducted to find existing studies. Then, an expert interview was carried out with a group of one software engineering education research professor, three doctoral students, and two master’s students. Finally, the correlations between the students' questionnaire responses were calculated. To achieve this, a Bayesian Network was built with expert knowledge from the three-step approach, and the weights were learned from collected data. The probability of individual FSLSM learning style dimensions was estimated for a new test sample. Based on the literature, the learning elements were mapped to the respective FSLSM learning style dimensions and were initiated as learning paths to the learners. The next steps are proposed to extend this framework and dynamically recommend learning paths in real time. In addition, the individual levels of learning style dimensions, personality traits, and learning strategies can be considered to improve the recommendations. Further, using probabilities for mapping learning elements to learning styles can increase the chance of initiating multiple learning paths for an individual learner. Y1 - 2023 U6 - https://doi.org/10.21125/iceri.2023.1144 SP - 4593 EP - 4603 PB - IATED ER - TY - CHAP A1 - Ezer, Timur A1 - Plößl, Moritz A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Staufer, Susanne A1 - Nadimpalli, Vamsi Krishna A1 - Bugert, Flemming A1 - Hauser, Florian A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Deep learning for eye movement classification T2 - ICERI 2024 Proceedings, 17th annual International Conference of Education, Research and Innovation,11-13 November, 2024, Seville, Spain Y1 - 2024 U6 - https://doi.org/10.21125/iceri.2024.1028 SP - 4056 EP - 4065 PB - IATED ER - TY - CHAP A1 - Bittner, Dominik A1 - Hauser, Florian A1 - Engl, Fabian A1 - Mottok, Jürgen ED - Mottok, Jürgen ED - Hagel, Georg T1 - Eye Movement Modelling Examples on Usability Heuristics T2 - Proceedings of the 6th European Conference on Software Engineering Education : ECSEE 2025, Seeon Germany, June 02-04, 2025 N2 - The user interface (UI) and user experience (UX) design is of crucial importance for human-computer interaction (HCI), particularly in the context of web applications. In light of the high expectations of users and the competitive nature of the market, it is imperative to employ usability measurement techniques to avoid losing users. Heuristic evaluation (HE) is a cost- and resource-efficient method for evaluating the usability of websites in which evaluators are guided by heuristics. However, the level of expertise of the evaluators has a significant impact on the results, with experts identifying up to 50% more usability issues than novices. To address this gap, this paper proposes Eye Movement Modeling Examples (EMMEs) to demonstrate Jakob Nielsen’s ten usability heuristics in an easy-to-understand format for all levels of experience while also incorporating expert knowledge. In particular, the eye movements and verbal feedback of a usability expert are recorded as the expert analyses the usability of a simple website application in terms of Jakob Nielsen’s ten usability heuristics. This reveals the strategies and cognitive processes of the expert when assessing the usability of a website and makes them more tangible for non-experts or novices. The findings of a questionnaire-based assessment indicate that EMMEs are perceived as beneficial and supportive during the learning process. Ultimately, this comprehensive analysis not only enables a deeper understanding of heuristics for usability novices, but could also lead to EMMEs being applied more efficiently in diverse domains. Y1 - 2025 SN - 9798400712821 U6 - https://doi.org/10.1145/3723010.3723035 SP - 106 EP - 114 PB - ACM ER - TY - CHAP A1 - Hauser, Florian A1 - Staufer, Susanne A1 - Grabinger, Lisa A1 - Röhrl, Simon A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - On the analysis of student learning strategies: using the LIST-K questionnaire ro generate ai-based individualized learning paths T2 - Proceedings of the 16th annual International Conference of Education, Research and Innovation (ICERI 2023), Seville, Spain, 11/13/2023 - 11/14/2023 N2 - This paper presents the results of a data collection with the LIST-K questionnaire. This questionnaire measures students’ learning strategies and shows which strategies are particularly dominant or rather weak. Learning strategies have long been a major area of research in educational science and psychology. In these disciplines, learning strategies are understood as intentional behaviors and cognitive skills that learners employ to effectively complete learning tasks, by selecting, acquiring, organizing, and integrating information into their existing knowledge for long-term retention. The LIST-K, developed by Klingsieck in 2018, was chosen for accessing learning strategies due to its thematic suitability, widespread use, and test economy. It covers a total of four main categories (i.e., cognitive strategies, metacognitive strategies, management of internal resources, and management of external resources), each of which are subdivided into further subscales. With a total of 39 items answered via a 5-step Likert scale, the LIST-K can cover the topic relatively comprehensively and at the same time be completed in a reasonable amount of time of approximately 10 minutes. The LIST-K was used as part of a combined data collection along with other questionnaires on their personal data, their preferences regarding certain learning elements, their learning style (i.e. the ILS), and personality (i.e. the BFI-10). A total of 207 students from different study programs participated via an online survey created using the survey tool "LimeSurvey". Participation in the study was voluntary, anonymously, and in compliance with the GDPR. Overall, the results of the LIST-K show that students are willing to work intensively on relevant topics intensively and to perform beyond the requirements of the course seeking additional learning material. At the same time, however, it is apparent that the organization of their own learning process could still be improved. For example, students start repeating content too late (mean=2.70; SD=0.92) and do not set goals for themselves and do not create a learning plan (mean=3.19; SD=0.90). They also learn without a schedule (mean=2.23; SD=0.97) and miss opportunities to learn together with other students (mean=3.17; SD=0.94). The findings of the data collection will be used to create an AI-based adaptive learning management system that will create individualized learning paths for students in their respective courses. From the results of the LIST-K, it appears that the adaptive learning management system should primarily support organizational aspects of student learning. Even small impulses (an individual schedule of when to learn what or a hierarchical structuring of the learning material) could help students to complete their courses more successfully and improve their learning. Y1 - 2023 U6 - https://doi.org/10.21125/iceri.2023.1147 SP - 4611 EP - 4620 PB - IATED ER - TY - CHAP A1 - Bugert, Flemming A1 - Nadimpalli, Vamsi Krishna A1 - Bittner, Dominik A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Maier, Robert A1 - Röhrl, Simon A1 - Staufer, Susanne A1 - Hauser, Florian A1 - Mottok, Jürgen ED - Mottok, Jürgen ED - Hagel, Georg T1 - ML based Evaluation Methodology for Learning Path Recommender Systems T2 - Proceedings of the 6th European Conference on Software Engineering Education : ECSEE 2025, Seeon Germany, June 02-04, 2025 N2 - In education, recommender systems can provide students with personalized learning materials based on their preferences. When comparing various recommendation algorithms, the main question is, which algorithm provides the most suitable recommendations for each student. Answering this question requires a quantitative evaluation methodology (i.e. a concrete metric) for ranking the results of (even non-deterministic) recommender systems. While there is already literature on this topic, the uniqueness of our approach lies in the application of machine learning: we deploy a likelihood based analysis via Hidden Markov Models named Aiakos. With this strategy, we aim to provide data-driven insights about accuracy and stability of recommendations towards a more reasonable selection of the appropriate recommender system. The training data for the Hidden Markov Models is collected from 80 students. Data from another 26 students is then used to discuss the behavior of our evaluation procedure considering a single recommendation as well as the results from 100 recommendations. Furthermore, the proposed concept allows to be applied to other domains as well. Y1 - 2025 SN - 9798400712821 U6 - https://doi.org/10.1145/3723010.3723022 SP - 40 EP - 48 PB - ACM ER - TY - CHAP A1 - Nadimpalli, Vamsi Krishna A1 - Bugert, Flemming A1 - Bittner, Dominik A1 - Staufer, Susanne A1 - Röhrl, Simon A1 - Hauser, Florian A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Maier, Robert A1 - Mottok, Jürgen T1 - Probabilistic Machine Learning for Simulating Complex Learner Profiles T2 - 2024 21st International Conference on Information Technology Based Higher Education and Training (ITHET), 06-08 November 2024, Paris, France N2 - Data is the foundation of all machine learning applications. In education science, especially for the learner characteristics that drive personalized learning, it is difficult to collect and often uncertain. It is challenging to model, train, evaluate, and analyze the underlying algorithms when developing AI-based systems and having small sample sizes. To address these problems, we present a synthetic data generator utilising probabilistic models. This generator can effectively model and simulate complex learner profiles. To achieve this, we collected extensive data on learning styles, learning strategies, personalities, and preferred learning paths from 593 students over several semesters at a higher education level. Then, Bayesian networks, Hidden Markov Models, and Markov Chains are used to model the relationships between learner profiles. Using the Bayesian information criterion, and cross-validation with log-likelihood scores, we compare various models to select the best fitting one for synthesizing the data. The synthetic data is then evaluated using statistical validation techniques. In addition, we developed a simulation module with the option to simulate learner profiles based on manual user-defined inputs. The data and code used in this work are available as open source1110.5281/zenodo.13768136 [Titel anhand dieser DOI in Citavi-Projekt übernehmen] contributing to open science and developers for customized simulated data. In the future, this data will refine the training, evaluation, analysis, and benchmarking of algorithms for personalized learning. KW - probabilistic models KW - synthetic data KW - learner characteristics KW - generative AI KW - higher education area Y1 - 2024 SN - 979-8-3315-1663-5 U6 - https://doi.org/10.1109/ITHET61869.2024.10837641 SN - 2473-2060 SP - 1 EP - 10 PB - IEEE ER -