TY - JOUR A1 - Röhrl, Simon A1 - Staufer, Susanne A1 - Bugert, Flemming A1 - Nadimpalli, Vamsi Krishna A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Ezer, Timur A1 - Altweck, Ricardo A1 - Graf, Sabine A1 - Kriza, Thomas A1 - Mottok, Jürgen T1 - Ethical Considerations of AI in Education: A Case Study based on Pythia Learning Enhancement System JF - IEEE Access N2 - As the use of AI in education increases, addressing ethical concerns is essential for its responsible use and implementation. This study explores the ethical considerations of AI in education by analyzing a concrete application, the Pythia Learning Enhancement System, which enables personalized and adaptive educational experiences. In this case study, the concrete implementation of Pythia, contrary to high-level abstract analyses, provides practical insights into these ethical issues. To achieve this goal, we first define Pythia and outline its implementation. Using the various topics covered by Pythia, the ethical issues associated with each of these topics are outlined, resulting in a list of ten distinct ethical issues. Because there is overlap in issues covered by similar applications, they can benefit from this identification. An ethical (human rights) and didactic (constructivism) theoretical background is then provided as a basis for further discussion. This is used to build the arguments used in the main study. This consists of analyzing each of the issues and providing recommendations to mitigate potential harm arising from these issues. This helps to provide guidelines for future applications. In the analysis, the ethical discussion is mainly based on the human rights of the stakeholders involved, emphasizing human dignity. After the analysis, each of the issues is contextualized with the recent AI Act of the European Union, providing a novel mapping of the issues of AI in education to the AI Act. Finally, the limitations of the study are stated and a plan for future research is presented. KW - Ethics KW - Artificial intelligence KW - Education KW - Stakeholders KW - Psychology KW - Privacy KW - Search problems KW - Guidelines KW - Focusing KW - Europe Y1 - 2025 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-83403 SN - 2169-3536 N1 - Corresponding author der OTH Regensburg: Simon Röhrl VL - 11 SP - 1 EP - 25 PB - Institute of Electrical and Electronics Engineers (IEEE) ER - TY - CHAP A1 - Bittner, Dominik A1 - Hauser, Florian A1 - Engl, Fabian A1 - Mottok, Jürgen ED - Mottok, Jürgen ED - Hagel, Georg T1 - Eye Movement Modelling Examples on Usability Heuristics T2 - Proceedings of the 6th European Conference on Software Engineering Education : ECSEE 2025, Seeon Germany, June 02-04, 2025 N2 - The user interface (UI) and user experience (UX) design is of crucial importance for human-computer interaction (HCI), particularly in the context of web applications. In light of the high expectations of users and the competitive nature of the market, it is imperative to employ usability measurement techniques to avoid losing users. Heuristic evaluation (HE) is a cost- and resource-efficient method for evaluating the usability of websites in which evaluators are guided by heuristics. However, the level of expertise of the evaluators has a significant impact on the results, with experts identifying up to 50% more usability issues than novices. To address this gap, this paper proposes Eye Movement Modeling Examples (EMMEs) to demonstrate Jakob Nielsen’s ten usability heuristics in an easy-to-understand format for all levels of experience while also incorporating expert knowledge. In particular, the eye movements and verbal feedback of a usability expert are recorded as the expert analyses the usability of a simple website application in terms of Jakob Nielsen’s ten usability heuristics. This reveals the strategies and cognitive processes of the expert when assessing the usability of a website and makes them more tangible for non-experts or novices. The findings of a questionnaire-based assessment indicate that EMMEs are perceived as beneficial and supportive during the learning process. Ultimately, this comprehensive analysis not only enables a deeper understanding of heuristics for usability novices, but could also lead to EMMEs being applied more efficiently in diverse domains. Y1 - 2025 SN - 9798400712821 U6 - https://doi.org/10.1145/3723010.3723035 SP - 106 EP - 114 PB - ACM ER - TY - CHAP A1 - Bugert, Flemming A1 - Nadimpalli, Vamsi Krishna A1 - Bittner, Dominik A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Maier, Robert A1 - Röhrl, Simon A1 - Staufer, Susanne A1 - Hauser, Florian A1 - Mottok, Jürgen ED - Mottok, Jürgen ED - Hagel, Georg T1 - ML based Evaluation Methodology for Learning Path Recommender Systems T2 - Proceedings of the 6th European Conference on Software Engineering Education : ECSEE 2025, Seeon Germany, June 02-04, 2025 N2 - In education, recommender systems can provide students with personalized learning materials based on their preferences. When comparing various recommendation algorithms, the main question is, which algorithm provides the most suitable recommendations for each student. Answering this question requires a quantitative evaluation methodology (i.e. a concrete metric) for ranking the results of (even non-deterministic) recommender systems. While there is already literature on this topic, the uniqueness of our approach lies in the application of machine learning: we deploy a likelihood based analysis via Hidden Markov Models named Aiakos. With this strategy, we aim to provide data-driven insights about accuracy and stability of recommendations towards a more reasonable selection of the appropriate recommender system. The training data for the Hidden Markov Models is collected from 80 students. Data from another 26 students is then used to discuss the behavior of our evaluation procedure considering a single recommendation as well as the results from 100 recommendations. Furthermore, the proposed concept allows to be applied to other domains as well. Y1 - 2025 SN - 9798400712821 U6 - https://doi.org/10.1145/3723010.3723022 SP - 40 EP - 48 PB - ACM ER - TY - CHAP A1 - Hammer, Pascal A1 - Mottok, Jürgen T1 - Prototyping for high-performance random number generators for critical systems T2 - 2025 International Conference on Applied Electronics (AE), 08-09. September 2025, Pilsen Czech Republic N2 - The security of modern cryptographic applications depends on the quality of their random number generators (RNGs). While physical true random number generators (PTRNGs) provide high-quality randomness, their performance is often insufficient for high-throughput applications. On the other hand, deterministic random number generators (DRNGs) offer better speed but lack true randomness. This paper presents an approach to developing a high-performance PTRNG. The research focuses on optimizing the digitization of analog noise signals. For this purpose, an ADC was selected that can digitize analog signals at a high clock rate. The functionality of the ADC could be verified by digitizing reference signals. Preliminary results by digitizing the analog noise signal demonstrates the feasibility of the proposed approach, but highlight challenges in achieving good results for Min-Entropy. Y1 - 2025 U6 - https://doi.org/10.1109/AE66163.2025.11197780 PB - IEEE ER - TY - CHAP A1 - Staufer, Susanne A1 - Ezer, Timur A1 - Röhrl, Simon A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Nadimpalli, Vamsi Krishna A1 - Antoni, Erika A1 - Mottok, Jürgen A1 - Schaffer, Josefa T1 - TYCHE ALGORITHM 2.0: Learning Paths from Questionnaire Responses and Learning Analytics T2 - ICERI2025 Proceedings N2 - The digitalization of learning processes has increased the need for adaptive learning paths tailored individually to learners. A novel algorithm for learning path generation is presented in this paper, namely Tyche 2.0. It extends the original Tyche approach after Staufer et al. – a Markov model for generating learning paths – by integrating additional learner data beyond learning styles (Index of Learning Styles (ILS)), including learning strategies (LIST-K questionnaire), personality traits (BFI-10 questionnaire), and learning analytics captured through screen recordings. In order to be able to use the screen recordings, a heuristic evaluates them. Furthermore, this enhanced algorithm employs Markov models to dynamically generate personalized learning paths. These are based on both questionnaire responses and real-time engagement data, the weights of which undergo dynamic adjustment over time. We made a small evaluation of Tyche 2.0 without the learning analytics influence, which shows that there is room for further improvements. Future research will focus on evaluating whole Tyche 2.0 in another university setting to further improve personalization and user engagement. KW - Markov model KW - Learning paths KW - Learning style KW - Learning strategy KW - Personality traits KW - Learning analytics Y1 - 2025 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-87846 SN - 978-84-09-78706-7 SP - 2562 EP - 2572 PB - IATED ER - TY - CHAP A1 - Hauser, Florian A1 - Staufer, Susanne A1 - Röhrl, Simon A1 - Nadimpalli, Vamsi Krishna A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Mottok, Jürgen A1 - Falter, Thomas ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - LEVERAGING FIVE QUESTIONNAIRES TO ANALYZE STUDENT LEARNING STRATEGIES AND GENERATE AI-POWERED INDIVIDUALIZED LEARNING PATHS T2 - ICERI2025 Proceedings N2 - Background: The COVID-19 pandemic has significantly accelerated the shift toward online and blended learning in higher education, placing renewed emphasis on the individualization of learning content to meet diverse student needs. Even high-quality learning materials may fail to engage learners if they do not align with students’ personal preferences and learning styles. Identifying these learner preferences, therefore, emerges as a critical challenge. Objectives: This paper presents ongoing work within a larger research project aimed at employing artificial intelligence to recommend optimal learning path for students in specific courses. Beyond mere optimization, the goal is to ensure the best possible fit between learning materials and individual learners. Sample & Methods: A total of 27 students from technical degree programs took part in this survey. All participation was voluntary, and data were handled in full compliance with GDPR regulations. Although our broader project integrates fine-grained learning analytics from Moodle, the present abstract focuses exclusively on the self-report questionnaire results. Participants completed five instruments: 1. Index of Learning Styles (ILS) 2. LIST-K (Learning and Study Strategies Inventory – Short version) 3. BFI-10 (Big Five Inventory – 10 items) 4. Custom Preferences Instrument, capturing preferences for specific learning elements (e.g. instructional videos, lecture notes, summaries) and basic demographic data 5. Motivational Value Systems Questionnaire (MVSQ), piloted last semester to assess value orientations and motivational drivers Results: Preliminary analyses of the questionnaire data reveal: - Learning Styles (ILS): The majority lean toward the visual learning type (M = 5.740, SD = 3.430). - Learning Strategies (LIST-K): High scores on metacognitive strategies (M = 3.000; SD = 0.520) and collaboration with peers (M = 3.190; SD = 0.540). - Preferred Learning Elements: Summaries, overviews, and self-checks are most favored. - Value Orientations (MVSQ): Students are primarily driven by the pursuit of personal achievement (M = 4.400; SD = 11.140). Conclusion & Significance: By integrating these five standardized questionnaires, we gain valuable insights into student learning preferences—insights that complement our Moodle analytics in the broader project. Observed trends suggest that learning materials should be concise and designed to facilitate peer interaction and knowledge deepening. These findings will guide the refinement of our AI-driven recommendation engine, enhancing its ability to deliver personalized learning paths that boost both engagement and effectiveness. KW - AI in higher education KW - learning management system KW - adaptive learning KW - personalized learning paths KW - online and blended learning Y1 - 2025 U6 - https://doi.org/10.21125/iceri.2025.0658 SP - 1775 EP - 1784 PB - IATED ER - TY - CHAP A1 - Schaffer, Josefa A1 - Ezer, Timur A1 - Röhrl, Simon A1 - Hauser, Florian A1 - Staufer, Susanne A1 - Nadimpalli, Vamsi Krishna A1 - Grabinger, Lisa A1 - Antoni, Erika A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - EYE TRACKING GLASSES IN EDUCATIONAL SETTINGS: GUIDELINES ON DATA QUALITY T2 - ICERI2025 Proceedings N2 - Eye movement modeling examples, so-called EMME videos, are a valuable tool in education, helping learners better understand instructional content. Like conventional educational videos, EMME videos combine text, images, and voiceovers. However, they also display the instructor’s or teacher’s gaze, guiding learners attention to key elements. Although various approaches exist for creating EMME videos, there is currently no standardised guideline for ensuring gaze data quality. Eye tracking technology is essential to capture gaze behaviour, and in educational settings without a fixed computer monitor – such as when using blackboards or conducting live experiments – the usage of mobile eye tracking glasses is beneficial. An accuracy study is conducted using mobile eye tracking glasses to provide empirical guidance for the development of high-quality educational EMME videos and ensure that the instructor’s or teacher’s gaze is captured with high precision. The study uses the Tobii Pro Glasses 3 and involves a static and a dynamic setup with 34 participants. To gain insight into the effects of visual impairments on accuracy, we also include participants who wear contact lenses. In the static setup, participants are seated at a desk with a headrest and focus on a poster with nine fixation points. In the dynamic setup, participants are walking in a controlled half-circle around the poster while maintaining focus on its centre. Each setup is performed multiple times under varying lighting levels (300 lux, 700 lux) and distances between participant and poster (80 cm, 120 cm, 180 cm). This enables the simulation of diverse educational environments, including the possibility of a teacher’s or instructor’s movement. The study results will be evaluated regarding lighting conditions, the distance between the person wearing eye tracking glasses and the object, and possible influences of contact lenses. Based on these findings, favourable conditions for creating EMME videos in educational settings are collected, especially when working without a fixed computer monitor. The results address the outlined research gap by providing instructors and teachers with guidelines enabling them to produce high-quality educational EMME videos. Y1 - 2025 U6 - https://doi.org/10.21125/iceri.2025.1419 SP - 5027 EP - 5038 PB - IATED ER - TY - CHAP A1 - Ezer, Timur A1 - Röhrl, Simon A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Towards accurate eye tracking: quantifying error in linear pixel-to-degree conversion T2 - ICERI2025 Proceedings N2 - Eye tracking has become a powerful tool for analyzing cognitive processes in educational research. Educators and researchers can utilize eye tracking to model learners by determining their gaze patterns. In addition, eye tracking can be used directly for teaching by extracting experts' gaze behavior in certain areas and learning from it. However, eye tracking data is captured in a variety of coordinate systems, which can differ across individual studies. Consequently, algorithms, such as eye movement classifiers, must frequently convert gaze data between different coordinate systems. In particular, the conversion from screen pixels into visual degrees is typically approximated by a linear conversion in current literature and standard practice. However, this approximation introduces inaccuracies, thus potentially obscuring eye movements relevant to educational research. This paper provides a detailed geometric and analytical examination of the commonly applied linear approximation, quantifying its error in comparison to the exact coordinate conversion from screen pixels to angular degrees. For this purpose, the exact conversion formulas are mathematically derived from geometric optics, enabling researchers and educators to use them in their work. Utilizing these derived transformations can improve the robustness of analyses, for example, when detecting subtle eye movements. The present work supports educational research using eye tracking to achieve more insightful findings that may have previously been obscured by measurement inaccuracies. Thereby, we provide an important contribution toward more reliable and valid research and educational practices in eye tracking. KW - Eye tracking KW - coordinate system KW - conversion KW - angular degree KW - pixel Y1 - 2025 U6 - https://doi.org/10.21125/iceri.2025.1841 SP - 6709 EP - 6717 PB - IATED ER - TY - CHAP A1 - Alhulaibi, Ayham A1 - Frauenschläger, Tobias A1 - Mottok, Jürgen T1 - Towards Post-Quantum-Ready Automated Certificate Lifecycle Management in Operational Technology T2 - SECURWARE 2025, The Nineteenth International Conference on Emerging Security Information, Systems and Technologies, 26.-30.10.2025, Barcelona N2 - Operational Technology (OT) systems increasingly depend on robust and automated certificate lifecycle management to maintain secure operations across long device lifespans and constrained environments. As quantum-capable adversaries emerge, these systems must also support cryptographic agility and prepare for a seamless transition to Post-Quantum Cryptography (PQC). This work presents a crypto-agile, post-quantum-ready testbed architecture that extends existing standards, such as Enrollment over Secure Transport (EST) and Bootstrapping Remote Secure Key Infrastructure (BRSKI), to support hybrid certificates, hardware-based key storage, and protocol flexibility for device bootstrapping and certificate management. A work-in-progress prototype implementation demonstrates support for both traditional and PQC algorithms across device types. Planned evaluations target performance on constrained devices, PQC readiness, and compatibility with alternative protocols. The system lays a foundation for secure and standards-compliant certificate management in future-proof OT deployments. KW - Automated Device Onboarding KW - BRSKI KW - Operational Technology Security. KW - Post-Quantum Cryptography KW - Public Key Infrastructure KW - Security Token Y1 - 2025 UR - https://www.thinkmind.org/library/SECURWARE/SECURWARE_2025 SN - 978-1-68558-306-4 SP - 112 EP - 116 PB - IARIA ER - TY - CHAP A1 - Nadimpalli, Vamsi Krishna A1 - Maier, Robert A1 - Staufer, Susanne A1 - Röhrl, Simon A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - EXPERT SURVEYS TO REAL TIME ADAPTATION OF LEARNING PATHS T2 - ICERI2025 Proceedings N2 - Learning management systems rely on adaptive algorithms that use learner preferences to personalize the instructional content in form of learning paths. However, these preferences are uncertain in nature, and change over time. The present solutions are either static or purely data-driven missing the dynamic adaption to changes in the preferences and infusion of pedagogical nuances respectively. This paper introduces an extended variant of Nestor, our Bayesian network engine that models personality traits, learning styles, and learning strategies. This extension overlays a lightweight rule-based mechanism whose “secret recipe’’ lies in the infusion of expert-derived weights adapting learning paths dynamically whenever a learner selects new material in Moodle. To parameterise these rules, we conducted a structured survey with 12 hand-picked professors and researchers in educational science. Each expert responded to 4 demographic items and 12 item that are distributed across algorithm-overview, scenario-based, and example-based categories, thereby supplying the nuanced weightings that result the personalised recommendations. This hybrid system (Nestor plus the expert-infused rule layer) operated during the winter term of 2025. 18 students completed an end-of-term questionnaire. Although their learning gains were not recorded, the majority of respondents reported positive or neutral experiences with the dynamically adapted learning paths. The {Future work} will compare three engines: (i) the present dynamic, expert-infused rule layer on top of the static Bayesian network, (ii) purely data-driven machine-learning models that neglect expert weighting, and (iii) the original static-adaptation Bayesian network without rules. Analyses of log files, intermediate satisfaction surveys, and pre/post term surveys will clarify whether this on-the-fly adaptation and pedagogical nuance lead to measurable learning benefits. Y1 - 2025 U6 - https://doi.org/10.21125/iceri.2025.1571 SP - 5677 EP - 5687 PB - IATED ER - TY - JOUR A1 - Maier, Robert A1 - Schlattl, Andreas A1 - Guess, Thomas A1 - Mottok, Jürgen T1 - CausalOps - Towards an industrial lifecycle for causal probabilistic graphical models JF - Information and Software Technology N2 - Context: Causal probabilistic graph-based models have gained widespread utility, enabling the modeling of cause-and-effect relationships across diverse domains. With their rising adoption in new areas, such as safety analysis of complex systems, software engineering, and machine learning, the need for an integrated lifecycle framework akin to DevOps and MLOps has emerged. Currently, such a reference for organizations interested in employing causal engineering is missing. This lack of guidance hinders the incorporation and maturation of causal methods in the context of real-life applications. Objective: This work contextualizes causal model usage across different stages and stakeholders and outlines a holistic view of creating and maintaining them within the process landscape of an organization. Method: A novel lifecycle framework for causal model development and application called CausalOps is proposed. By defining key entities, dependencies, and intermediate artifacts generated during causal engineering, a consistent vocabulary and workflow model to guide organizations in adopting causal methods are established. Results: Based on the early adoption of the discussed methodology to a real-life problem within the automotive domain, an experience report underlining the practicability and challenges of the proposed approach is discussed. Conclusion: It is concluded that besides current technical advancements in various aspects of causal engineering, an overarching lifecycle framework that integrates these methods into organizational practices is missing. Although diverse skills from adjacent disciplines are widely available, guidance on how to transfer these assets into causality-driven practices still need to be addressed in the published literature. CausalOps’ aim is to set a baseline for the adoption of causal methods in practical applications within interested organizations and the causality community. KW - Causal engineering KW - Model lifecycle KW - MLOps KW - Causal graphical models Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-73350 SN - 0950-5849 N1 - Corresponding author der OTH Regensburg: Robert Maier PB - Elsevier ER - TY - CHAP A1 - Staufer, Susanne A1 - Hauser, Florian A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Nadimpalli, Vamsi Krishna A1 - Röhrl, Simon A1 - Bugert, Flemming A1 - Bittner, Dominik A1 - Mottok, Jürgen T1 - EVALUATION OF THE LEARNING MANAGEMENT SYSTEM PYTHIA T2 - EDULEARN Proceedings: 16th International Conference on Education and New Learning Technologies, Palma, Spain. 1-3 July, 2024 N2 - Learning management systems gain importance due to the Corona pandemic. To personalize such a learning management system, a Moodle adaption named Pythia was created. Pythia is implemented as a Moodle plugin solution. The possibility of generating learning paths with various algorithms and the change of the graphical user interface is significant. Learning paths are generated with two different algorithms. Nestor algorithm generates learning paths with a Bayesian network, while Tyche algorithm uses a Markov model. The graphical user interface is adapted to the generated learning paths where learning element symbols are customized and the individual learning paths are depicted. This paper presents the results of a qualitative survey among German students with the aim of evaluating the first version of the learning management system Pythia. 25 students took the subject “Software Engineering for Safe and Secure Systems” in the winter term of 2023/24. The 68 asked questions focus on usage behavior, graphical user interface, usability, preferences, volume, and quality of learning elements, and learning paths. Our Moodle course for the lecture contains seven sections, each section has minimum one subsection on which the learning path is calculated. Last three sections are designed by presenting minimum one learning element of each learning element category except the collaboration tool. In a previous work, ten learning element categories were designed and evaluated comprising manuscript, brief overview, learning goal, quiz, exercise, summary, three types of additional material, and collaboration tool. The first sections are left as they are initially designed by the lecturer (normal section). The survey considers the difference between normal sections and diverse sections. Furthermore, the generated learning paths are evaluated. 13 students undertook Nestor learning paths, whereas 12 undertook Tyche learning paths. The results suggest that for the majority of students, the learning element symbols are well-chosen. Moreover, all students wish the elements relevant to the exam to be labelled. 23 students are overwhelmed by the number of learning elements in the last sections of the Moodle course. In the future, some suggestions will be implemented such as the labelling of exam relevant learning elements. To overcome the overload of learning elements, a strategy could be developed like hiding learning elements not preferred by the learning path algorithm. KW - Learning management system (LMS) KW - questionnaire (study) KW - learning elements KW - learning paths KW - usability KW - graphical user interface (GUI) KW - Moodle KW - higher education area (HEA) Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-73474 SN - 2340-1117 SP - 9089 EP - 9098 PB - IATED ER - TY - CHAP A1 - Grabinger, Lisa A1 - Mottok, Jürgen T1 - On selecting hypothesis tests for group differences T2 - ICERI2024 Proceedings: 17th Annual International Conference of Education, Research and Innovation, 11th-13th November 2024, Seville, Spain N2 - Deciding on the right method of analyzing empirical research data can be difficult – especially when it comes to choosing specific methods of inferential statistics, where there is often not one right way, but a variety of valid options (e.g., using an ANOVA or its non-parametric alternative for data that is not perfectly normally distributed). Novice researchers not only lack the experience to know when a particular hypothesis test is appropriate, but struggle to find suitable literature to familiarize themselves (i.e., literature that is not too superficial, yet comprehensible). With the present article we provide a remedy following the didactic method of scaffolding: We present a systematization of the most elementary inferential statistical methods, namely hypothesis tests for group differences. We start by explaining basic terms (e.g., independent variable) and then give step-by-step instructions for choosing a proper hypothesis test based on data properties, implementing it from scratch, and reporting or interpreting its results. With these practical cookbook-like guidelines, this article serves as a concise starting point for young researchers entering the field of empirical research, as a valuable resource for their instructors, and as a basis for automating statistical procedures in a software system. KW - empirical research KW - data analysis KW - inferential statistics KW - guidelines Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-78200 SP - 702 EP - 712 PB - IATED ER - TY - INPR A1 - Linz, Tilo A1 - Mottok, Jürgen T1 - Application of Causal Models in Scenario-based Testing N2 - This paper presents a new methodology for scenario-based testing of automated driving functions in the context of ISO 21448 (safety of the target function). By using structural causal models (SCMs), the evaluation process of highly automated vehicle systems is to be improved, thus increasing their safety and reliability. Using SCMs, the presented methodology systematically analyzes causal relationships between various risk factors of the investigated system and its operating environment and automatically identifies potential parameter combinations that influence system safety. This approach makes it possible to safeguard automated driving functions, such as an emergency brake assistant, by determining foreseeable risks and providing them as test parameters for relevant scenarios. The HolmeS3 approach combines expert knowledge with probabilistic data analysis to develop robust causal models that can be validated through both simulation and real-world testing. The use of causal inference enables the generation of critical test cases, known as "edge and corner cases", which are essential for testing vehicle systems under investigation. This focused testing approach helps to limit the test case explosion that occurs with conventional approaches by specifically identifying highly relevant parameter combinations that potentially (negatively) influence system performance. The methodology presented, which was developed as part of the HolmeS3 R&D project, offers transparency, comparability, explainability and traceability in the modeling and testing processes. It supports compliance with the ISO 21448 standard and lays the foundation for the causality-driven development of safe and reliable automotive technology. The project's tools and methods can be applied beyond the automotive sector to all cyber-physical systems that require rigorous safety validation. Y1 - 2024 U6 - https://doi.org/10.13140/RG.2.2.34160.06402 ER - TY - CHAP A1 - Frauenschläger, Tobias A1 - Mottok, Jürgen T1 - Problems and New Approaches for Crypto-Agility in Operational Technology T2 - 12th European Congress Embedded Real Time Systems (ERTS 2024), 11-12 June 2024, Toulouse, France N2 - In recent years, cybersecurity has also become relevant for Operational Technology (OT). Critical systems like industrial automation systems or transportation systems are faced with new threats, and therefore require the implementation of thorough security measures. Regulations further mandate the deployment and regular verification of these security measures. However, OT systems differ from well-known systems of classic Information Technology (IT), such as mission times spanning decades, infrequent updates only during on-site maintenance, or diverse devices with varying support for security measures. The growing field of crypto-agility examines approaches to integrate security measures in an agile and flexible way, making updates easier and, therefore, encouraging a more frequent deployment of them. This paper contributes to this research field in the context of secure communication in two ways. We first examine the current state of crypto-agility by providing an overview of existing measures for OT systems. Then, we propose a new architecture concept with different deployment approaches to integrate security measures in a crypto-agile way. Based on a security library with a generic interface and a flexible proxy application, our architecture is capable of securing both new OT systems and existing ones via retrofit. Y1 - 2024 UR - https://www.researchgate.net/publication/383709526_Problems_and_New_Approaches_for_Crypto-Agility_in_Operational_Technology ER - TY - CHAP A1 - Schwind, Philipp A1 - Frauenschläger, Tobias A1 - Mottok, Jürgen T1 - Implementation of a Bump-in-the-Wire Security Gateway T2 - Proceedings of the 12th Prague Embedded Systems Workshop, June 27 - 29, 2024, Horoměřice, Czech Republic N2 - In the face of escalating cyber threats, the integration of Operational Technology (OT) with Information Technology (IT) systems presents heightened vulnerabilities to critical infrastructures. This paper focuses on the need for cybersecurity, showcasing the design and implementation of a security gateway to achieve bump-in-the-wire security between two units to be protected (assets). For that, each asset is assigned one security module that safeguards its communication paths. To ease bump-in-the-wire capability, the communication between the asset and the security-gateway must be stateless and operate on OSI layer 2. This is necessary to safeguard the whole communication bandwidth, regardless of the used protocols. For this objective, Linux-based packet sockets are used. An encrypted tunnel is established between two security gateways using the Datagram Transport Layer Security (DTLS) protocol. The results show that the implemented solution is capable of securing the asset’s network traffic without the need of any modifications. Y1 - 2024 UR - https://pesw.fit.cvut.cz/2024/PESW_2024.pdf SN - 978-80-01-07303-2 SP - 26 EP - 35 ER - TY - CHAP A1 - Horn, Luca A1 - Frauenschläger, Tobias A1 - Mottok, Jürgen T1 - Integration and Evaluation of Different FPGA based Hardware Accelerators for the AES Algorithm in the TLS Protocol to be Used in Critical Automation Systems T2 - 4. Symposium Elektronik und Systemintegration, Tagungsband: Symposium am 17. April 2024 Hochschule Landshut N2 - This thesis addresses the challenges of hardware-assisted cryptography in the context of automation systems in critical infrastructures. While hardware accelerators enhance cryptographic calculations in both performance and security, their permanence poses issues in adapting to evolving security concerns. To overcome this problem, we integrated and evaluated a hardware accelerator for the AES algorithm on an FPGA within a TLS application, comparing its performance with other accelerators. Employing a hybrid FPGA-CPU processor system, this setup achieves over 800 Mbit/s data rates, showcasing a more than 27 times acceleration in TLS transmissions compared to purely software-based solutions. The FPGA's flexibility and upgradability therefore make it an ideal platform for critical infrastructure, ensuring longevity and superior acceleration in TLS data transfers. Y1 - 2024 UR - https://www.haw-landshut.de/static/ITZ/Bilder/Cluster_MST/ESI_Symposium/ESI_2024/Tagungsband/1B2_Frauenschlaeger_OTH-R_TB-ESI2024_s18-27.pdf SN - 978-3-9818439-9-6 SP - 18 EP - 27 PB - Hochschule Landshut CY - Landshut ER - TY - CHAP A1 - Füreder, Lukas A1 - Mottok, Jürgen T1 - Assessment of a MACsec-based Security System for Use in Critical Infrastructure Communication T2 - Proceedings of the 12th Prague Embedded Systems Workshop, June 27 - 29, 2024, Horoměřice, Czech Republic N2 - This paper investigates the integration of Media Access Control Security (MACsec) into the communication of critical infrastructure, specifically within power grid applications, such as Substation Automation Systems (SAS) using the IEC 61850 standard. Building on the principles of both standards, this study aims to determine if MACsec can meet the security and performance requirements set by IEC 62351 for power system communications. Furthermore, a test environment containing a number of Intelligent Electronic Devices (IEDs) supporting communication compliant to all IEC 61850 message types is established to evaluate this integration. The results of the measurements executed in this environment indicate that MACsec could secure all types of messages, such as Manufacturing Message Specification (MMS), Sampled-Value (SV) and Generic Object Oriented Substation Events (GOOSE), within the required time periods without significant delays. Even with additional encryption activated in the cipher suite, the resulting transmission times are well below the required times. This suggests that MACsec can enhance the security goals for industrial communication by providing confidentiality in addition to the already mandated assurance of authenticity and integrity to all messages without compromising performance. Only the requirement for end-to-end security cannot be met by MACsec in this configuration, as the security system re-encrypts with every hop of the transmission. For this reason, we propose a hybrid approach of Transport Layer Security (TLS) and MACsec as part of future work. KW - MACsec KW - IEC61850 KW - IEC62351 KW - GOOSE KW - Secure Communication Y1 - 2024 UR - https://pesw.fit.cvut.cz/2024/PESW_2024.pdf SN - 978-80-01-07303-2 SP - 51 EP - 59 ER - TY - CHAP A1 - Röhrl, Simon A1 - Staufer, Susanne A1 - Nadimpalli, Vamsi Krishna A1 - Bugert, Flemming A1 - Bugert, Flemming A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Ezer, Timur A1 - Mottok, Jürgen T1 - PYTHIA - AI SUGGESTED INDIVIDUAL LEARNING PATHS FOR EVERY STUDENT T2 - INTED2024 Proceedings: 18th International Technology, Education and Development Conference, Valencia, Spain. 4-6 March, 2024 N2 - During the COVID-19 pandemic, the importance of digital course rooms, where teachers provide their learning materials, increased dramatically. While these platforms are crucial for providing teaching materials, they often fall short in addressing individual student needs. A system within an academic setting, capable of creating and presenting individual learning paths for each student, can solve these issues. These paths are composed of various learning elements - defined in our previous work as units of educational content with which a learner works. Currently, there is no suitable system that enables the integration of learning path generating algorithms into a digital course room. Therefore we present an application that enables this integration into the Moodle Learning Management System (LMS). More precisely, this paper presents a Moodle plugin together with its framework. It describes the mechanism for effectively collecting data from Moodle, which AI algorithms then use to generate personalized learning paths. Subsequently these paths are visualized with the help of the Moodle plugin. We started with a set of requirements and use cases for the interface connecting Moodle to the AI system, which were established with a group of experts. Based on the requirements, various relevant technologies were assessed, and the best ones were chosen for implementation. Following that, the paper develops a strategy for software structuring as well as an architecture, focusing on performance, modularity, and ease of deployment for widespread use. Furthermore, the architecture ensures a simple method for integrating the algorithms. Afterwards, the framework's concrete implementation is described. A technique for enriching learning elements with metadata is presented, and additionally a concept for presenting these learning elements within a hierarchy. Moreover, it is shown how questionnaire responses and learning analytics are utilized for data collection. We cover in detail techniques for extracting and storing data from the Moodle database, as well as methods for customizing Moodle course rooms and a standard API for incorporating AI algorithms. Finally, the paper discusses the application of the proposed framework in an actual course and how student feedback is collected, which could enhance the framework. It concludes with an assessment of the outcomes obtained and prospects for the framework's future advancements. KW - Personalized Learning Paths KW - Learning Management System KW - Software Architecture KW - Moodle KW - Artificial Intelligence Y1 - 2024 SN - 978-84-09-59215-9 U6 - https://doi.org/10.21125/inted.2024.0783 SN - 2340-1079 SP - 2871 EP - 2880 ER - TY - CHAP A1 - Staufer, Susanne A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Nadimpalli, Vamsi Krishna A1 - Bugert, Flemming A1 - Ezer, Timur A1 - Röhrl, Simon A1 - Mottok, Jürgen T1 - Learning elements in LMS - a survey among students T2 - INTED2024 Proceedings: 18th International Technology, Education and Development Conference, Valencia, Spain. 4-6 March, 2024 N2 - In higher education, improving learning and learning success are goals of general improvement. Lecturers teaches content and students acquire that content in an efficient way. To structure content, learning element categories are evaluated from the student's point of view in higher education area. The aim is to validate given definitions of ten learning element categories within a Learning Management System (LMS). This paper evaluates a categorization of learning elements for organizing learning content in online education within LMSs. Therefore, ten categories of learning elements and corresponding definitions were defined in a previous work as base for this paper. The learning elements to examine are manuscript, exercise, quiz, brief overview, learning goal, summary, collaboration tool, auditory additional material, textual additional material, and visual additional material. To validate the definitions and to get improvements to each learning element a survey is processed. Beside the demographic data questions, the survey consists of two questions to the acceptance of the definitions and asks for improvements. 148 students between the ages 19 and 35 participate in the survey in summer term 2023. The education level of the participants ranges from undergraduates to Ph.D. students. The results of this paper are that more than 80% accept the given definitions. Some definitions of the learning elements are changed, but the changes are restricted to additions of maximal four words. This categorization of learning elements could lead to improvements in learning by giving the content more structure. With the structure students get the possibility to learn with preferred learning elements which could lead to more success in learning and to a decreasing dropout rate in universities. In the future, the learning elements allow to classify content within LMSs with the goal of generating individual learning paths. Furthermore, our project will integrate these learning elements, use them to generate learning paths, and could set a new standard in the way of personalized learning. KW - Learning elements KW - learning management system KW - learning objects KW - questionnaire KW - higher education area KW - content organization Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-71135 SN - 978-84-09-59215-9 SN - 2340-1079 SP - 4224 EP - 4231 PB - IATED ER - TY - CHAP A1 - Grabinger, Lisa A1 - Ezer, Timur A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - The impact of eyenalyzer T2 - ICERI2024 Proceedings: 17th Annual International Conference of Education, Research and Innovation, 11th-13th November 2024, Seville, Spain N2 - Empirical research poses numerous challenges for beginners. This is especially true for data analysis – a task that usually requires knowledge from two distinct areas: statistics and programming. To support prospective researchers with that task, we developed a web-based tool called eyenalyzer. It supports common activities in the data analysis phase of empirical studies in a way that is suitable for novices in both, statistics and programming. The present article describes a controlled experiment investigating the impact of this tool with a total of 20 participants. All of them are given a set of common data analysis tasks. Half of the participants complete the tasks using eyenalyzer, the other half can use anything except for eyenalyzer. For each task and participant, we record the time in minutes, the task score, and the perceived difficulty. The results confirm that our tool is a valuable support for novice researchers: With eyenalyzer, the participants are significantly faster, achieve higher scores, and perceive the tasks to be less difficult. KW - tool evaluation KW - data analysis KW - eye tracking KW - empirical research Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-78215 SN - 978-84-09-63010-3 SN - 2340-1095 SP - 695 EP - 701 PB - IATED ER - TY - CHAP A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Staufer, Susanne A1 - Mottok, Jürgen T1 - EYE TRACKING AS TECHNOLOGY IN EDUCATION: FURTHER INVESTIGATION OF DATA QUALITY AND IMPROVEMENTS T2 - INTED2024 Proceedings: 18th International Technology, Education and Development Conference, Valencia, Spain. 4-6 March, 2024 N2 - Eye tracking serves as a powerful tool across a variety of empirical research areas: From usability research over cognitive research to educational research and applications in classrooms. However, data noise in eye tracking data poses a challenge to researchers and educators, as it leads to gaze positions being measured imprecisely under unfavorable conditions. In our previous study, we systematically investigated factors that influence data quality and are easily controllable in a classroom or laboratory environment, such as illumination, sampling frequency, and head orientation. However, no recommendations regarding the light source and light orientation could be provided, as these influences could not be analyzed in sufficient detail. Yet, a further examination of these factors, eliminating human influences by using an artificial head, revealed significant differences between individual settings. Hence, in this empirical study of eye tracking as an educational technology, we delve deeper into examining the impact of both light source and light orientation on data quality. This is investigated with an artificial head together with the Tobii Pro Spectrum eye tracking device. To measure data quality, we use the metrics precision and standard deviation as indicators of data noise. The obtained results derive practical advice for educators and researchers, such as not to illuminate the subject from the rear, in order to gather useful data for research and future classroom applications. Thereby, this study serves as a complement to our previous research, answering open questions regarding best practices for researchers and educators when using eye trackers. It aims to provide valuable insights into producing data of the highest quality possible when using eye trackers, both in laboratory settings and in future classrooms applications. KW - Eye tracking KW - data quality KW - best practices KW - lighting conditions KW - standard deviation KW - precision Y1 - 2024 SN - 978-84-09-59215-9 U6 - https://doi.org/10.21125/inted.2024.0802 SN - 2340-1079 SP - 2955 EP - 2961 PB - IATED Academy ER - TY - CHAP A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Staufer, Susanne A1 - Mottok, Jürgen T1 - EYE TRACKING METRICS FOR DISTINGUISHING GLOBAL AND FOCAL GAZE PATTERNS: A SYSTEMATIC LITERATURE REVIEW T2 - INTED2024 Proceedings: 18th International Technology, Education and Development Conference, Valencia, Spain. 4-6 March, 2024 N2 - Global and focal eye tracking gaze patterns are distinguished in a variety of domains, such as radiology research, empirical software engineering, behavioral psychology, and cartography research. A global gaze pattern is present if a participant in an eye tracking study gains an overview of the stimulus, whereas a focal pattern emerges during a more detailed evaluation of a specific part of the stimulus. With this higher-level measure of global and focal gaze patterns, cognitive effort, expertise levels, and even neurological characteristics - such as autism - can be quantified. Furthermore, with this measure, cognitive efforts of students in certain tasks can be investigated and clues for targeted support can be provided. These properties in particular make this eye tracking measure valuable for the education domain. In the field of eye tracking research, many researchers have established distinct criteria for differentiating global and focal gaze patterns. Moreover, it is rarely quantitatively measured which of these patterns is present, but rather determined based on qualitative considerations. However, some studies explicitly use quantitative metrics like saccade-length or fixation-duration to distinguish between global and focal gaze patterns. This is the focus of the present systematic literature review: It searches for and compiles the eye tracking metrics used in the literature to distinguish global from focal gaze patterns in a quantitative way. In doing so, this study fills the yawning gap in quantitative metrics for determining global and focal gaze patterns. In the long run, this can be used to answer questions about cognitive load and problems in processing tasks during eye tracking studies and to provide further insights into the cognitive processes of students. The present paper first discusses definitions of global and focal gaze patterns and presents examples in which this metric has already been applied. Then, the research questions together with search strings and search engines used for the systematic literature review are described. Finally, the results are summarized, presenting a compilation of and connections between quantitative metrics utilized in the literature to distinguish between global and focal viewing patterns. KW - Eye tracking KW - cognitive load KW - expertise KW - global KW - focal KW - ambient KW - local KW - metrics Y1 - 2024 SN - 978-84-09-59215-9 U6 - https://doi.org/10.21125/inted.2024.0814 SN - 2340-1079 SP - 3005 EP - 3014 PB - IATED Academy ER - TY - CHAP A1 - Kristen, Meret A1 - Engl, Fabian A1 - Mottok, Jürgen T1 - Enhancing Phishing Detection: An Eye-Tracking Study on User Interaction and Oversights in Phishing Emails T2 - SECURWARE 2024 : The Eighteenth International Conference on Emerging Security Information, Systems and Technologies, November 03-07, 2024, Nice, France N2 - Phishing remains a significant threat to organizational security, necessitating effective countermeasures. This paper presents findings from an in-depth eye-tracking study with 103 participants, evaluating the effectiveness of phishing awareness tools and trainings. The study examines how a phishing awareness system influences user behavior, efficiency, and the ability to identify phishing attempts. By analyzing eye movements, the study reveals real-time interactions and oversights, providing insights into the decision-making process. Results indicate that while the system improves the efficiency of users already proficient in phishing detection, it does not universally enhance recognition rates. Notably, participants using the tool spent significantly less time looking at attachment-related phishing markers, indicating partial efficiency improvements. Since phishing attempts containing suspicious attachments were successful in 19% of cases, as compared to an overall phishing success rate of 15%, the phishing awareness tool is particularly useful here. A usability evaluation revealed that users reporting a higher perceived usability score profited more from the help of the tool. Additionally, no improvement in phishing detection rates was observed in users who had completed prior IT-security training, highlighting the necessity for a paradigm shift in phishing training to adequately prepare users for phishing attempts. Y1 - 2024 UR - https://www.thinkmind.org/library/SECURWARE/SECURWARE_2024/securware_2024_2_80_30041.html SN - 978-1-68558-206-7 SP - 71 EP - 80 PB - IARIA ER - TY - CHAP A1 - Staufer, Susanne A1 - Nadimpalli, Vamsi Krishna A1 - Hauser, Florian A1 - Bittner, Dominik A1 - Grabinger, Lisa A1 - Bugert, Flemming A1 - Ezer, Timur A1 - Röhrl, Simon A1 - Mottok, Jürgen T1 - Persistence of Questionnaire Data on Learning Styles, Learning Strategies AND Personality Traits T2 - ICERI2024 Proceedings: 17th Annual International Conference of Education, Research and Innovation, 11th-13th November 2024, Seville, Spain N2 - In the context of learning, questionnaires are carried out to gain information about learners. This learner profile has various benefits, like adapting the learning content, promoting of self-reflection, or increasing motivation in learning and therefore better learning results. Some researchers take the results of such questionnaires as ground truth or trust them blindly. Examining how persistent questionnaires are, asking the same questions twice, and comparing the results is a way to prove or falsify this statement. Our research procedure compares the results of three different questionnaires. The first questionnaire is the ILS (index of learning styles) according to the Felder-Silverman Learning Style Model (FSLSM) with about 44 questions. Learning strategies are examined with the LIST-K questionnaire consisting of 39 questions after Klingsieck. The third and last questionnaire is about personality traits. With only ten questions, Rammstedt et al. describe the BFI-10 questionnaire for personality traits. To compare results, the same study with the three named questionnaires is carried out twice with three to four months in between. The sample includes 35 students in their bachelor studies taking the course Software Engineering in a blended learning format. After collecting the questionnaire data from the students, a comparison is made in two different ways. First, we compare the data points based on the given answers. Second, a comparison is made based on the calculated questionnaire results because each of the three questionnaires has its own analysis method. For example, the analysis method of the ILS delivers as a result four integers representing the four characteristics of a learning style, while LIST-K makes a factor analysis. The results of the paper show that both the given answers and the calculated questionnaire results differ. Not one student has given the same answer inside each questionnaire with causes, like a change of learning style, learning strategy, and personality traits, or not filling in conscientiously. KW - learning style KW - learning strategy KW - personality traits KW - questionnaire study Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-78246 SN - 978-84-09-63010-3 SN - 2340-1095 SP - 6310 EP - 6319 PB - IATED ER - TY - CHAP A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Ezer, Timur A1 - Mottok, Jürgen A1 - Gruber, Hans ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Integrating deliberate practice in software engineering education T2 - ICERI 2024 Proceedings, 17th annual International Conference of Education, Research and Innovation,11-13 November, 2024, Seville, Spain Y1 - 2024 U6 - https://doi.org/10.21125/iceri.2024.1331 SP - 5457 EP - 5466 PB - IATED ER - TY - CHAP A1 - Bugert, Flemming A1 - Staufer, Susanne A1 - Bittner, Dominik A1 - Nadimpalli, Vamsi Krishna A1 - Ezer, Timur A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Mottok, Jürgen T1 - Ariadne's Thread for Unravelling Learning Paths: Identifying Learning Styles via Hidden Markov Models T2 - 2024 IEEE Global Engineering Education Conference (EDUCON), 08-11 May 2024, Kos Island, Greece N2 - Modern education through Learning Management Systems (LMSs) provides learners with personalized learning paths. This is achieved by first querying the learning style according to the theory of Felder and Silverman to recommend suitable learning content. However, a rigid learning style representation is lacking of adaptability to the learners' choices. Therefore, the present study evaluates the idea of providing adaption to the representation of learning styles by using Hidden Markov Models (HMMs). Thus, data is collected from participants out of the Higher Education Area. The Index of Learning Styles questionnaire is used to obtain the learning style based on the theory of Felder and Silverman. Also, a questionnaire that asks the respondents to create a preferred learning path with the sequence length of nine learning elements is provided. From the given data, we initially evaluate the probability relationships between learning styles and learning elements. Then, we use the Viterbi algorithm in HMMs to identify alterations in learning styles from the provided learning paths. The alignment is then quantified by introducing a metric called support value. The findings imply that our concept can be used to adapt the learning style based on the user's real choice of learning elements. Thus, the proposed model also offers a way to integrate a feedback loop within LMSs leading to an improvement of learning path recommendation algorithms. KW - Surveys KW - Knowledge engineering KW - Feedback loop KW - Learning management systems KW - Uncertainty KW - Viterbi algorithm Y1 - 2024 U6 - https://doi.org/10.1109/EDUCON60312.2024.10578825 SN - 2165-9567 SP - 1 EP - 7 PB - IEEE ER - TY - CHAP A1 - Ezer, Timur A1 - Plößl, Moritz A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Staufer, Susanne A1 - Nadimpalli, Vamsi Krishna A1 - Bugert, Flemming A1 - Hauser, Florian A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Deep learning for eye movement classification T2 - ICERI 2024 Proceedings, 17th annual International Conference of Education, Research and Innovation,11-13 November, 2024, Seville, Spain Y1 - 2024 U6 - https://doi.org/10.21125/iceri.2024.1028 SP - 4056 EP - 4065 PB - IATED ER - TY - INPR A1 - Gaube, Susanne A1 - Jussupow, Ekaterina A1 - Kokje, Eesha A1 - Khan, Jowaria A1 - Bondi-Kelly, Elizabeth A1 - Schicho, Andreas A1 - Kitamura, Felipe Campos A1 - Koch, Timo Kevin A1 - Ezer, Timur A1 - Mottok, Jürgen A1 - Lermer, Eva A1 - Ghassemi, Marzyeh A1 - Colak, Errol T1 - Underreliance Harms Human-AI Collaboration More Than Overreliance in Medical Imaging N2 - Importance: The use of artificial intelligence (AI) to support clinicians in diagnostic decision-making holds significant potential; however, evidence regarding its clinical utility remains mixed. In many cases, the interaction between healthcare professionals and AI systems does not improve collaborative performance compared to the standalone performance of humans or AI. Currently, the underlying mechanisms that limit human-AI collaboration are poorly understood. Objective: To examine the impact of AI advice on diagnostic decision-making among experts and novices, focusing on understanding the role of explainability (XAI) on users’ reliance on advice. Design, Setting, and Participants: A mixed-methods design combining a crossover experimental design with a think-aloud and an eye-tracking study arm was conducted in 2023. Participants were task experts (radiologists) and novices (non-radiologist physicians and medical trainees) from 10 countries, with the think-aloud and eye-tracking conducted in Germany. Intervention: Participants reviewed 50 patient cases containing head CT scans and patient information. Every case was reviewed in three time-separate sessions in randomized order. In each session, participants were exposed to a different experimental condition: (a) control, i.e., no AI prediction presented; (b) basic advice, i.e., AI prediction without annotations; and (c) XAI advice, i.e., AI prediction with annotations. For each case, participants had to determine if the patients had an intracranial hemorrhage (ICH), rate their confidence, and, if applicable, the usefulness of the AI advice. Main Outcome(s) and Measure(s): Diagnostic performance, confidence in the diagnosis, case reading time, and AI advice usefulness ratings. Results: The data analysis included 125 participants. The mean age was 28.5 years (SD = 6.72), and 55.2% identified as female. Underreliance on correct AI advice was associated with high uncertainty and had a more detrimental impact on diagnostic performance than overreliance on incorrect advice. XAI advice reduced underreliance and improved performance and confidence, particularly when reviewing more difficult cases with ICH. AI advice, particularly XAI, did not reduce reading time. XAI was perceived as more useful than basic AI advice, especially among novices. Conclusions and Relevance: Our findings indicate that underreliance on AI might be more harmful than overreliance, highlighting the need to develop efficient counterstrategies beyond current XAI methods. Y1 - 2024 U6 - https://doi.org/10.31219/osf.io/4wv8j PB - OSFPreprints ER - TY - CHAP A1 - Nadimpalli, Vamsi Krishna A1 - Bugert, Flemming A1 - Bittner, Dominik A1 - Staufer, Susanne A1 - Röhrl, Simon A1 - Hauser, Florian A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Maier, Robert A1 - Mottok, Jürgen T1 - Probabilistic Machine Learning for Simulating Complex Learner Profiles T2 - 2024 21st International Conference on Information Technology Based Higher Education and Training (ITHET), 06-08 November 2024, Paris, France N2 - Data is the foundation of all machine learning applications. In education science, especially for the learner characteristics that drive personalized learning, it is difficult to collect and often uncertain. It is challenging to model, train, evaluate, and analyze the underlying algorithms when developing AI-based systems and having small sample sizes. To address these problems, we present a synthetic data generator utilising probabilistic models. This generator can effectively model and simulate complex learner profiles. To achieve this, we collected extensive data on learning styles, learning strategies, personalities, and preferred learning paths from 593 students over several semesters at a higher education level. Then, Bayesian networks, Hidden Markov Models, and Markov Chains are used to model the relationships between learner profiles. Using the Bayesian information criterion, and cross-validation with log-likelihood scores, we compare various models to select the best fitting one for synthesizing the data. The synthetic data is then evaluated using statistical validation techniques. In addition, we developed a simulation module with the option to simulate learner profiles based on manual user-defined inputs. The data and code used in this work are available as open source1110.5281/zenodo.13768136 [Titel anhand dieser DOI in Citavi-Projekt übernehmen] contributing to open science and developers for customized simulated data. In the future, this data will refine the training, evaluation, analysis, and benchmarking of algorithms for personalized learning. KW - probabilistic models KW - synthetic data KW - learner characteristics KW - generative AI KW - higher education area Y1 - 2024 SN - 979-8-3315-1663-5 U6 - https://doi.org/10.1109/ITHET61869.2024.10837641 SN - 2473-2060 SP - 1 EP - 10 PB - IEEE ER - TY - CHAP A1 - Nadimpalli, Vamsi Krishna A1 - Staufer, Susanne A1 - Ezer, Timur A1 - Bugert, Flemming A1 - Bittner, Dominik A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Röhrl, Simon A1 - Maier, Robert A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Predicting learner characteristics using machine learning T2 - ICERI 2024 Proceedings, 17th annual International Conference of Education, Research and Innovation,11-13 November, 2024, Seville, Spain N2 - In education science research, data collection is challenging due to difficulty identifying students at the higher education level, privacy concerns, and varying levels of student engagement. Importantly, psychological questionnaires can be lengthy, leading to incomplete responses. We conducted repeated studies, and over time, the focus of the research adapted, introducing new materials and consequently leading to missing learner characteristics in some datasets. In this research, the issue of incomplete learner characteristics is addressed using data from three different studies: winter term 2022/2023 (n=297), summer term 2023 (n=274), and winter term 2023/2024 (n=25). These studies collected various learner characteristics, such as learning styles, personalities, learning strategies, and learning element preferences. However, learning element preferences and learning strategies were missing in the winter term of 2022, and the summer term of 2023 respectively. To analyze the data and predict these missing features, statistical analysis, and machine learning techniques were employed. Then, these models are rigorously evaluated using cross-validation and performance metrics like accuracy, precision, recall, and F1-score. Our findings provide insights into the relationships between learners' learning styles, personalities, learning strategies, and learning element preferences. This offers valuable implications for the design and implementation of educational interventions, like learning path recommendations. The results imply that machine learning models can predict missing learner characteristics, thus addressing the problem of incomplete data in educational research Y1 - 2024 U6 - https://doi.org/10.21125/iceri.2024.1454 SP - 6005 EP - 6014 PB - IATED ER - TY - CHAP A1 - Staufer, Susanne A1 - Bugert, Flemming A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Ezer, Timur A1 - Nadimpalli, Vamsi Krishna A1 - Bittner, Dominik A1 - Röhrl, Simon A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Tyche algorithm: Markov models for generating learning paths in learning management systems T2 - INTED2024 Proceedings: 18th International Technology, Education and Development Conference, Valencia, Spain. 4-6 March, 2024 N2 - In the intricate tapestry of the cosmos, where celestial threads weave stories of destiny, an enigmatic deity stands at the intersection of chance and fate — Tyche, the goddess of fortune. In science and probability, coincidence plays a distinctive role in Bayesian Networks (BNs) and Markov Models (MMs). This paper introduces the Tyche algorithm named after the goddess of fortune. The Tyche algorithm is a Markov model designed to generate learning paths in Learning Management Systems (LMSs). A learning path is a type of individualization that personalises the order of learning elements within an LMS course. Learning elements are fundamental components within an LMS course, depicting the learning content in diverse ways. In our case, the learning path tailoring is based on the learner’s learning style according to Felder-Silverman Learning Style Model (FSLSM) – an indicator for the ideal pathway and learning element for the learner’s optimum learning. The Tyche algorithm offers the advantage to provide students the most suitable learning path. Tyche is a MM structure with various matrices containing transition probabilities depending on the learning style. Nine categories of learning elements defined in a previous survey form the basis of the node structure of the MM. For a generic approach, a survey was designed to obtain the transition probabilities depending on the individual learning style. The survey with more than 100 German students participated is processed with the tool LimeSurvey. Students are asked about their learning style using the Index of Learning Styles (ILS) questionnaire according to Felder-Silverman and about the percentage probabilities of learning elements to get their individual sequence as learning path. The percentages are queried in two different ways. Firstly, the students were asked to provide a sequence of learning elements within each position of the sequence filled with probabilities for all learning elements. Secondly, a learning element is given and the students are asked to indicate which learning element they would work on next. The first way of asking for the probabilities is used to find the start node in the MM, whereas the second approach forms the probability matrices between the nodes within the MM. As result of the survey, the Tyche algorithm presents generic transition probabilities. It improves the learning process of individuals only by asking for their learning style: it generates individual learning paths through the learning elements within an LMS based on the MM explained above by solely getting the answers of the ILS questionnaire as input. In the future, other questionnaires such as BFI-10 for personality traits or LIST-K for learning strategies may offer a more comprehensive input. However, the next step is to evaluate Tyche with about 25 students in a software engineering lecture. This is planned for the year 2024. KW - Markov model KW - learning style KW - learning elements KW - learning management system KW - higher education area Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-71148 SN - 978-84-09-59215-9 SN - 2340-1079 SP - 4195 EP - 4205 PB - IATED Academy ER - TY - JOUR A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Wolff, Christian A1 - Mottok, Jürgen T1 - On Eye Tracking in Software Engineering JF - SN Computer Science N2 - Eye tracking is becoming more and more important as a research method within the field of software engineering (SE). Existing meta-analyses focus on the design or conduct of SE eye tracking studies rather than the analysis phase. This article attempts to fill this gap; it presents a systematic literature review of eye tracking studies in the field of SE—focusing mainly on the data analysis methods used. From the IEEE Xplore and ACM digital libraries we gather 125 papers up to the first quarter of 2024. Detailed evaluation provides information on the number of papers that use specific methods of analysis (i.e., descriptive or inferential statistics, and gaze visualization) or settings (e.g., sample size, technical setup, and selected aspects of research design). With the data obtained we can infer the popularity of specific analysis methods in the field. Those results enable efficient work on data analysis tools or education of aspiring researchers and can serve as basis for standardization or guidelines within the community—providing for methods to include as well as current inconsistencies. KW - Eye tracking KW - Software engineering KW - Empirical KW - Systematic literature review Y1 - 2024 U6 - https://doi.org/10.1007/s42979-024-03045-3 SN - 2661-8907 N1 - Zugehöriges Datenset: doi:10.5281/zenodo.11279180 VL - 5 IS - 6 PB - Springer CY - Singapore ER - TY - CHAP A1 - Hammer, Pascal A1 - Mottok, Jürgen A1 - Krause, Veronika A1 - Probst, Tobias T1 - Approach for High-Performance Random Number Generators for Critical Systems T2 - Proceeding of the 12th European Congress on Embedded Real Time Software and Systems (ERTS2024) , Toulouse, 11-12 June 2024 N2 - In times of digitalization, the encryption and signing of sensitive data is becoming increasingly important. These cryptographic processes require large quantities of high-quality random numbers. Which is why a high-performance random number generator (RNG) is to be developed. For this purpose, existing concepts of RNGs and application standards are first analyzed. The proposed approach is to design a physical true random number generator (PTRNG) with a high output of random numbers. Based on this, the development begins with the analog part of the RNG, the noise signal source and a suitable amplifier for the analog noise signal. Therefore, a special noise diode from Noisecom and an amplifier from NXP were chosen and analyzed in different measurements. From the results of the measurements, it can be concluded that both components are suitable for use in the RNG. Y1 - 2024 U6 - https://doi.org/10.5281/zenodo.14848832 N1 - Identifier: hal-04678880 , version 1 ER - TY - JOUR A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - On the perception of graph layouts JF - Journal of Software: Evolution and Process N2 - In the field of software engineering, graph-based models are used for a variety of applications. Usually, the layout of those graphs is determined at the discretion of the user. This article empirically investigates whether different layouts affect the comprehensibility or popularity of a graph and whether one can predict the perception of certain aspects in the graph using basic graphical laws from psychology (i.e., Gestalt principles). Data on three distinct layouts of one causal graph is collected from 29 subjects using eye tracking and a print questionnaire. The evaluation of the collected data suggests that the layout of a graph does matter and that the Gestalt principles are a valuable tool for assessing partial aspects of a layout. KW - causal graphs KW - eye tracking KW - gestalt principles KW - graph layouts KW - modeling languages Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-62973 N1 - Corresponding author: Lisa Grabinger PB - Wiley ER - TY - CHAP A1 - De, Sangita A1 - Mottok, Jürgen A1 - Brada, Premek ED - Miraz, M.H. ED - Southall, G. ED - Ali, Maaruf ED - Ware, A. T1 - Evaluation of Semantic Interoperability of Automotive Service API Models Based on Metamodels Similarity Metrics Using a Semi-automated Approach T2 - iCETiC 2022 : 5th International Conference on Emerging Technologies in Computing 2022: Aug 15, 2022 - Aug 16, 2022, Chester, UK N2 - In recent years, mapping of application software components’ ontologies semantically emerged as a big research challenge in automotive application domain that manipulates several cross-enterprise synergy knowledge application frameworks. The same knowledge formalized by different experts in different vehicle application frameworks leads to heterogeneous representations of components’ interface data. Consequently, this causes the most daunting impediment in semantic interoperability between the service components in cooperative automotive systems. From a modeling perspective, in the absence of standardized domain-based unified modeling techniques, the orchestration and resolution of semantic data interoperability between various vehicle application frameworks’ components’ interface models remain a challenge. However, this challenge could be addressed using ontological metamodeling by specifying semantic associations between components’ interface model concepts based on the domain knowledge. Apart from the semantic mapping of interface ontological metamodels, this work also defines quality metrics to determine the degree of semantic alignment achieved between the various interface ontologies. Additionally, to reduce development time and cost towards semantic interoperability, this work proposes a semi-automated plugin tool for the applicability of the evaluated quality metrics to semantic mapping of real-world components’ interface models. KW - Framework KW - Interface KW - Metamodel KW - Metrics KW - Ontology KW - Semantic Y1 - 2023 U6 - https://doi.org/10.1007/978-3-031-25161-0_2 SP - 14 EP - 28 PB - Springer CY - Cham ER - TY - CHAP A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - Evaluating Graph-based Modeling Languages T2 - Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - As humans, we tend to use models to describe reality. Modeling languages provide the formal frameworks for creating such models. Usually, the graphical design of individual model elements is based on subjective decisions; their suitability is determined at most by the prevalence of the modeling language. With other words: there is no objective way to compare different designs of model elements. The present paper addresses this issue: it introduces a systematic approach for evaluating the elements of graph-based modeling languages comprising 14 criteria – derived from standards, usability analyses, or the design theories ‘Physics of Notations’ and ‘Cognitive Dimensions of Notations’. The criteria come with measurement procedures and evaluation schemes based on reasoning, eye tracking, and questioning. The developed approach is demonstrated with a specific use case: three distinct sets of node elements for causal graphs are evaluated in an eye tracking study with 41 subjects. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593664 SP - 120 EP - 129 PB - ACM ER - TY - CHAP A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Mottok, Jürgen T1 - Something Short Gets Even Shorter: Adapting the LIST-K for the Use in an Online Learning Management System T2 - Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - This study examines how Klingsieck’s LIST-K questionnaire [22] can be shortened and adapted to the requirements of an online learning management system. In a study with 213 participants, the questionnaire is subjected to an exploitative factor analysis. In a next step, the results are evaluated in terms of their reliability. This process creates a modified factor structure for the LIST-K, comprising a total of eight factors. The reliability of the modified questionnaire is at an α of .770. The shortened version of the LIST-K questionnaire is currently being used on an experimental basis in different courses. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593684 SP - 65 EP - 72 PB - ACM ER - TY - JOUR A1 - De, Sangita A1 - Premek, Brada A1 - Mottok, Jürgen T1 - Derivation of Optimized Threshold of Semantic Alignment Metrics for Intepretation of Interoperability and Reusability of Cross-enterprise Vehicle Service Interface Models JF - Informatica N2 - Over the past decade, cars have turned gradually into real cyber physical systems. The collaboration of services between the service-oriented, cross-enterprise vehicle application frameworks has increased to generate novel, smart and complicated vehicle services. Consequently, from an interoperability perspective, semantically mapping of vehicle service component’s interface ontological models emerged as a big research interest in automotive application domain that manipulates several cross-enterprise synergy knowledge applications frameworks. The ontological metamodeling lays the foundation for building semantic bridge and exploring semantic associations between service components’ interface models based on the domain knowledge for semantic interoperability. Also, several semantic quality metrics has been defined over time for the vehicle service interface ontological metamodels. The empirically evaluated values of these metrics can be used to assess progress in cross-enterprise interoperability between the service and the clients’ APIs ontological models in vehicle domain. Despite potential benefits of semantic alignment quality metrics, the effective use of these metrics for vehicle service interface ontologies have proven elusive. Yes, such metrics can be used successfully for quantification, but then they mostly fail to provide adequate annotations in subsequent decision-making in the direction of semantic interoperability and reusability. The effective use of ontology semantic alignment quality metrics is basically hindered in the absence of the meaningful thresholds. In fact, the absence of an effective and meaningful threshold for the semantic similarity measure between various vehicle service interface ontological metamodels, motivates this research work which not only proposes a design approach to an optimized threshold for the semantic similarity metrics but also applies this threshold on few defined semantic alignment quality metrics. This paper also uses a real-world vehicle domain industrial case study to illustrate the design approach. KW - interface KW - automotive services KW - semantic KW - metrics KW - optimized threshold KW - framework KW - metamodels KW - ontologies Y1 - 2023 U6 - https://doi.org/10.31449/inf.v47i7.4739 SN - 0350-5596 VL - 47 IS - 7 PB - Slovenian Society Informatika ER - TY - CHAP A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Mottok, Jürgen A1 - Gruber, Hans T1 - Visual Expertise in Code Reviews: Using Holistic Models of Image Perception to Analyze and Interpret Eye Movements T2 - ETRA '23: 2023 Symposium on Eye Tracking Research and Applications, Tubingen Germany 30 May 2023- 2 June 2023 N2 - This study uses holistic models of image perception to analyze and interpret eye movements during a code review. 23 participants (15 novices and 8 experts) take part in the experiment. The subjects’ task is to review six short code examples in C programming language and identify possible errors. During the experiment, their eye movements are recorded by an SMI 250 REDmobile. Additional data is collected through questionnaires and retrospective interviews. The results implicate that holistic models of image perception provide a suitable theoretical background for the analysis and interpretation of eye movements during code reviews. The assumptions of these models are particularly evident for expert programmers. Their approach can be divided into different phases with characteristic eye movement patterns. It is best described as switching between scans of the code example (global viewing) and the detailed examination of errors (focal viewing). Y1 - 2023 U6 - https://doi.org/10.1145/3588015.3589189 SP - 1 EP - 7 PB - ACM ER - TY - JOUR A1 - Pozzobon, Enrico A1 - Weiß, Nils A1 - Mottok, Jürgen A1 - Matoušek, Václav T1 - An evolutionary fault injection settings search algorithm for attacks on safe and secure embedded systems JF - Neural Network World (NNW) Y1 - 2023 U6 - https://doi.org/10.14311/NNW.2023.33.020 VL - 33 IS - 5 SP - 357 EP - 374 PB - Czech Technical University in Prague ER - TY - CHAP A1 - Bittner, Dominik A1 - Hendricks, Ricky-Ricardo A1 - Horn, Luca A1 - Mottok, Jürgen T1 - In-depth Benchmarking of Transfer Learning Techniques for Improved Bottle Recognition T2 - 2023 IEEE 13th International Conference on Pattern Recognition Systems (ICPRS), Guayaquil, Ecuador, 04-07 July 2023 N2 - An immense diversity in bottle types requires high accuracy during sorting for recycling purposes by breweries. This extremely complex and time-consuming procedure can result in enormous additional costs for them. This paper presents transfer learning-based algorithms for classifying beer bottle brands using camera images, applicable in individual sorting solutions for different use cases. The problem is tackled using customised EfficientNet, InceptionResNet and VGG models along with an augmented dataset. In addition, a detailed analysis of different model and parameter combinations is performed, enabling tailor-made technologies for specific conditions and resource limitations. In accompanying validations and subsequent tests, a test accuracy of 100% in the recognition of beer brands could be achieved, proving the proposed method fully contributes to the solution of the problem. KW - Analytical models KW - Costs KW - Transfer learning KW - Benchmark testing KW - Cameras KW - Pattern recognition KW - Recycling Y1 - 2023 SN - 979-8-3503-3337-4 U6 - https://doi.org/10.1109/ICPRS58416.2023.10178995 SP - 1 EP - 6 PB - IEEE ER - TY - CHAP A1 - Ezer, Timur A1 - Greiner, Matthias A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Eye tracking al technology in education; data quality analysis and improvements T2 - Proceedings of the 16th annual International Conference of Education, Research and Innovation (ICERI 2023), Seville, Spain, 11/13/2023 - 11/14/2023 N2 - Eye tracking has proven to be a powerful tool in a variety of empirical research areas; hence, it is steadily gaining attention. Driven by the expanding frontiers of Artificial Intelligence and its potential for data analysis, eye tracking technology offers promising applications in diverse fields, from usability research to cognitive research. The education sector in particular can benefit from the increased use of eye tracking technology - both indirectly, for example by studying the differences in gaze patterns between experts and novices to identify promising strategies, and directly by using the technology itself to teach in future classrooms. As with any empirical method, the results depend directly on the quality of the data collected. That raises the question of which parameters educators or researchers can influence to maximize the data quality of an eye tracker. This is the starting point of the present work: In an empirical study of eye tracking as an (educational) technology, we systematically examine factors that influence the data quality, such as illumination, sampling frequency, and head orientation - parameters that can be varied without much additional effort in everyday classroom or research use - using two human subjects, an artificial face, and the Tobii Pro Spectrum. We rely on metrics derived from the raw gaze data, such as accuracy or precision, to measure data quality. The obtained results derive practical advice for educators and researchers, such as using the lowest sampling frequency appropriate for a certain purpose. Thereby, this research fills a gap in the current understanding of eye tracker performance and, by offering best practices, enables researchers or teachers to produce data of the highest quality possible and therefore best results when using eye trackers in laboratories or future classrooms. Y1 - 2023 U6 - https://doi.org/10.21125/iceri.2023.1127 SP - 4500 EP - 4509 PB - IATED ER - TY - CHAP A1 - Homann, Alexander A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - An Eye Tracking Study on MISRA C Coding Guidelines T2 - ECSEE '23: Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - C is one of the most widely used programming languages - MISRA C is one of the most known sets of coding guidelines for C. This paper examines the usefulness and comprehensibility of the MISRA C:2012 guidelines in an eye tracking study. There, subjects encounter non-compliant code in four different code review settings: with no additional reference, with an actual MISRA C guideline, with a case-specific interpretation of a MISRA C guideline, and with a compliant version of the code. The data collected was analyzed not only in terms of the four presentation styles, but also by dividing the subjects into experience levels based on their semesters of study or years of work experience. Regarding the difference between actual and interpreted guidelines, we found that for interpreted guidelines the error detection rate is higher whereas the duration and frequency of visits to the guideline itself are mainly lower. This suggest that the actual guidelines are less useful and more difficult to understand. The former is contradicted by the subjects’ opinions: when surveyed, they rated the usefulness of the actual guidelines higher. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593671 SP - 130 EP - 137 PB - ACM ER - TY - JOUR A1 - Maier, Robert A1 - Grabinger, Lisa A1 - Urlhart, David A1 - Mottok, Jürgen T1 - Causal Models to Support Scenario-Based Testing of ADAS JF - IEEE Transactions on Intelligent Transportation Systems N2 - In modern vehicles, system complexity and technical capabilities are constantly growing. As a result, manufacturers and regulators are both increasingly challenged to ensure the reliability, safety, and intended behavior of these systems. With current methodologies, it is difficult to address the various interactions between vehicle components and environmental factors. However, model-based engineering offers a solution by allowing to abstract reality and enhancing communication among engineers and stakeholders. Applying this method requires a model format that is machine-processable, human-understandable, and mathematically sound. In addition, the model format needs to support probabilistic reasoning to account for incomplete data and knowledge about a problem domain. We propose structural causal models as a suitable framework for addressing these demands. In this article, we show how to combine data from different sources into an inferable causal model for an advanced driver-assistance system. We then consider the developed causal model for scenario-based testing to illustrate how a model-based approach can improve industrial system development processes. We conclude this paper by discussing the ongoing challenges to our approach and provide pointers for future work. KW - automated driving systems KW - Automation KW - Bayesian networks KW - Causal inference KW - Data models KW - ISO Standards KW - model-based testing KW - Safety KW - Task analysis KW - Testing KW - Vehicles Y1 - 2023 U6 - https://doi.org/10.1109/TITS.2023.3317475 SN - 1524-9050 SP - 1 EP - 17 PB - IEEE ER - TY - CHAP A1 - Staufer, Susanne A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Nadimpalli, Vamsi Krishna A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Learning elements in online learning management systems T2 - Proceedings of the 16th annual International Conference of Education, Research and Innovation (ICERI 2023), Seville, Spain, 11/13/2023 - 11/14/2023 Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-67725 SP - 3121 EP - 3130 PB - IATED ER - TY - CHAP A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Mottok, Jürgen A1 - Jahn, Sabrina A1 - Nadimpalli, Vamsi Krishna T1 - The Expert’s View: Eye Movement Modeling Examples in Software Engineering Education T2 - Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - This study investigates the impact of eye movement modeling examples in Software Engineering education. Software Engineering is a highly visual domain. The daily tasks of a software engineer (e.g., formulating requirements, creating UML diagrams, or conducting a code review) require in many cases the use of certain visual strategies. Although these strategies can be found for experts, it has been observed in different eye tracking studies that students have difficulties in learning and applying them. To familiarize students with these visual strategies and to provide them with a better understanding for the cognitive processes involved, a total of seven eye movement modeling examples was created. The seven eye movement modeling examples cover relevant parts of an introductory Software Engineering lecture; they are focused on typical situations in which visual strategies are applied. The results of a questionnaire-based evaluation shows that students consider the eye movement modeling examples as useful, feel supported in their learning process, and would like to see more use of them in the Software Engineering lecture. Furthermore, the students suggested that eye movement modeling examples should also be used in other lectures. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593683 SP - 148 EP - 152 PB - ACM ER - TY - CHAP A1 - Bugert, Flemming A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Hauser, Florian A1 - Nadimpalli, Vamsi Krishna A1 - Staufer, Susanne A1 - Mottok, Jürgen T1 - Towards Learning Style Prediction based on Personality T2 - Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - This paper assesses the relation between personality, demographics, and learning style. Hence, data is collected from 200 participants using 1) the BFI-10 to obtain the participant’s expression of personality traits according to the five-factor model, 2) the ILS to determine the participant’s learning style according to Felder and Silverman, and 3) a demographic questionnaire. From the obtained data, we train and evaluate a Bayesian network. Using Bayesian statistics, we show that age and gender slightly influence personality and that demographics as well as personality have at least a minor effect on learning styles. We also discuss the limitations and future work of the presented approach. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593682 SP - 48 EP - 55 PB - ACM ER - TY - CHAP A1 - Bittner, Dominik A1 - Hauser, Florian A1 - Nadimpalli, Vamsi Krishna A1 - Grabinger, Lisa A1 - Staufer, Susanne A1 - Mottok, Jürgen T1 - Towards Eye Tracking based Learning Style Identification T2 - Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - The dropout rate at universities has been very high for years. Thereby, the inexperience and lack of knowledge of students in dealing with individual learning paths in various courses of study plays a decisive role. Adaptive learning management systems are suitable countermeasures, in which learners’ learning styles are classified using questionnaires or computationally intensive algorithms before a learning path is suggested accordingly. In this paper, a study design for student learning style classification using eye tracking is presented. Furthermore, qualitative and quantitative analyses clarify certain relationships between students’ eye movements and learning styles. With the help of classification based on eye tracking, the filling out of questionnaires or the integration of computationally or cost-intensive algorithms can be made redundant in the future. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593680 SP - 138 EP - 147 PB - ACM ER - TY - CHAP A1 - Nadimpalli, Vamsi Krishna A1 - Bugert, Flemming A1 - Bittner, Dominik A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Staufer, Susanne A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Towards personalized learning paths in adaptive learning management systems: bayesian modelling of psychological theories T2 - Proceedings of the 16th annual International Conference of Education, Research and Innovation (ICERI 2023), Seville, Spain, 11/13/2023 - 11/14/2023 N2 - In educational research, non-personalized learning content increases learners' cognitive load, causing them to lower their performance and sometimes drop out of the course. Personalizing learning content with learners’ unique characteristics, like learning styles, personality traits, and learning strategies, is being suggested to improve learners’ success. Several theories exist for assessing learners’ unique characteristics. By the end of 2020, 71 learning style theories have been formulated, and research has shown that combining multiple learning style theories to recommend learning paths yields better results. As of the end of 2022, there is no single research that demonstrates a relationship between the Index of Learning Styles (ILS) based Felder-Silverman learning style model (FSLSM) dimensions, Big Five (BFI-10) based personality traits, and the Learning strategies in studying (LIST-K) based learning strategies factors for personalizing learning content. In this paper, an innovative approach is proposed to estimate the relationship between these theories and map the corresponding learning elements to create personalized learning paths. Respective questionnaires were distributed to 297 higher education students for data collection. A three-step approach was formulated to estimate the relationship between the models. First, a literature search was conducted to find existing studies. Then, an expert interview was carried out with a group of one software engineering education research professor, three doctoral students, and two master’s students. Finally, the correlations between the students' questionnaire responses were calculated. To achieve this, a Bayesian Network was built with expert knowledge from the three-step approach, and the weights were learned from collected data. The probability of individual FSLSM learning style dimensions was estimated for a new test sample. Based on the literature, the learning elements were mapped to the respective FSLSM learning style dimensions and were initiated as learning paths to the learners. The next steps are proposed to extend this framework and dynamically recommend learning paths in real time. In addition, the individual levels of learning style dimensions, personality traits, and learning strategies can be considered to improve the recommendations. Further, using probabilities for mapping learning elements to learning styles can increase the chance of initiating multiple learning paths for an individual learner. Y1 - 2023 U6 - https://doi.org/10.21125/iceri.2023.1144 SP - 4593 EP - 4603 PB - IATED ER - TY - CHAP A1 - Hauser, Florian A1 - Staufer, Susanne A1 - Grabinger, Lisa A1 - Röhrl, Simon A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - On the analysis of student learning strategies: using the LIST-K questionnaire ro generate ai-based individualized learning paths T2 - Proceedings of the 16th annual International Conference of Education, Research and Innovation (ICERI 2023), Seville, Spain, 11/13/2023 - 11/14/2023 N2 - This paper presents the results of a data collection with the LIST-K questionnaire. This questionnaire measures students’ learning strategies and shows which strategies are particularly dominant or rather weak. Learning strategies have long been a major area of research in educational science and psychology. In these disciplines, learning strategies are understood as intentional behaviors and cognitive skills that learners employ to effectively complete learning tasks, by selecting, acquiring, organizing, and integrating information into their existing knowledge for long-term retention. The LIST-K, developed by Klingsieck in 2018, was chosen for accessing learning strategies due to its thematic suitability, widespread use, and test economy. It covers a total of four main categories (i.e., cognitive strategies, metacognitive strategies, management of internal resources, and management of external resources), each of which are subdivided into further subscales. With a total of 39 items answered via a 5-step Likert scale, the LIST-K can cover the topic relatively comprehensively and at the same time be completed in a reasonable amount of time of approximately 10 minutes. The LIST-K was used as part of a combined data collection along with other questionnaires on their personal data, their preferences regarding certain learning elements, their learning style (i.e. the ILS), and personality (i.e. the BFI-10). A total of 207 students from different study programs participated via an online survey created using the survey tool "LimeSurvey". Participation in the study was voluntary, anonymously, and in compliance with the GDPR. Overall, the results of the LIST-K show that students are willing to work intensively on relevant topics intensively and to perform beyond the requirements of the course seeking additional learning material. At the same time, however, it is apparent that the organization of their own learning process could still be improved. For example, students start repeating content too late (mean=2.70; SD=0.92) and do not set goals for themselves and do not create a learning plan (mean=3.19; SD=0.90). They also learn without a schedule (mean=2.23; SD=0.97) and miss opportunities to learn together with other students (mean=3.17; SD=0.94). The findings of the data collection will be used to create an AI-based adaptive learning management system that will create individualized learning paths for students in their respective courses. From the results of the LIST-K, it appears that the adaptive learning management system should primarily support organizational aspects of student learning. Even small impulses (an individual schedule of when to learn what or a hierarchical structuring of the learning material) could help students to complete their courses more successfully and improve their learning. Y1 - 2023 U6 - https://doi.org/10.21125/iceri.2023.1147 SP - 4611 EP - 4620 PB - IATED ER - TY - CHAP A1 - Nadimpalli, Vamsi Krishna A1 - Hauser, Florian A1 - Bittner, Dominik A1 - Grabinger, Lisa A1 - Staufer, Susanne A1 - Mottok, Jürgen ED - Mottok, Jürgen T1 - Systematic Literature Review for the Use of AI Based Techniques in Adaptive Learning Management Systems T2 - Proceedings of the 5th European Conference on Software Engineering Education, Seeon/Germany, June 19 - 21, 2023 N2 - Nowadays, learning management systems are widely employed in all educational institutions to instruct students as a result of the increasing in online usage. Today’s learning management systems provide learning paths without personalizing them to the characteristics of the learner. Therefore, research these days is concentrated on employing AI-based strategies to personalize the systems. However, there are many different AI algorithms, making it challenging to determine which ones are most suited for taking into account the many different features of learner data and learning contents. This paper conducts a systematic literature review in order to discuss the AI-based methods that are frequently used to identify learner characteristics, organize the learning contents, recommend learning paths, and highlight their advantages and disadvantages. Y1 - 2023 SN - 978-1-4503-9956-2 U6 - https://doi.org/10.1145/3593663.3593681 SP - 83 EP - 92 PB - Association for Computing Machinery CY - New York ER - TY - CHAP A1 - Bittner, Dominik A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - González Martínez, Chelo ED - Lees, Joanna T1 - Unveiling the secrets of learning styles: decoding eye movements via machine learning T2 - Proceedings of the 16th annual International Conference of Education, Research and Innovation (ICERI 2023), Seville, Spain, 11/13/2023 - 11/14/2023 N2 - Universities are faced with a rising number of dropouts in recent years. This is largely due to students' limited capability of finding individual learning paths through various course materials. However, a possible solution to this problem is the introduction of adaptive learning management systems, which recommend tailored learning paths to students – based on their individual learning styles. For the classification of learning styles, the most commonly used methods are questionnaires and learning analytics. Nevertheless, both methods are prone to errors: questionnaires may give superficial answers due to lack of time or motivation, while learning analytics do not reflect offline learning behavior. This paper proposes an alternative approach to classify students' learning styles by integrating eye tracking in combination with Machine Learning (ML) algorithms. Incorporating eye tracking technology into the classification process eliminates the potential problems arising from questionnaires or learning analytics by providing a more objective and detailed analysis of the subject's behavior. Moreover, this approach allows for a deeper understanding of subconscious processes and provides valuable insights into the individualized learning preferences of students. In order to demonstrate this approach, an eye tracking study is conducted with 117 participants using the Tobii Pro Fusion. Using qualitative and quantitative analyses, certain patterns in the subjects' gaze behavior are assigned to their learning styles given by the validated Index of Learning Styles (ILS) questionnaire. In short, this paper presents an innovative solution to the challenges associated with classifying students' learning styles. By combining eye tracking data with ML algorithms, an accurate and insightful understanding of students' individual learning paths can be achieved, ultimately leading to improved educational outcomes and reduced dropout rates. Y1 - 2023 SN - 978-84-09-55942-8 U6 - https://doi.org/10.21125/iceri.2023.1291 N1 - Zugehöriges Datenset: https://doi.org/10.5281/zenodo.8349468 SP - 5153 EP - 5162 PB - IATED ER - TY - GEN A1 - Bittner, Dominik A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - Eye Tracking based Learning Style Identification for Learning Management Systems [Data set] N2 - In recent years, universities have been faced with increasing numbers of students dropping out. This is partly due to the fact that students are limited in their ability to explore individual learning paths through different course materials. However, a promising remedy to this issue is the implementation of adaptive learning management systems. These systems recommend customised learning paths to students - based on their individual learning styles. Learning styles are commonly classified using questionnaires and learning analytics, but both methods are prone to error. Questionnaires may yield superficial responses due to time constraints or lack of motivation, while learning analytics ignore offline learning behaviour. To address these limitations, this study aims to integrating Eye Tracking for a more accurate classification of students' learning styles. Ultimately, this comprehensive approach could not only open up a deeper understanding of subconscious processes, but also provide valuable insights into students' unique learning preferences. Y1 - 2023 U6 - https://doi.org/10.5281/zenodo.8349468 N1 - Related works: Is new version of publication: 10.1145/3593663.3593680 (DOI) Is published in publication: 10.21125/iceri.2023.1291 (DOI) ER - TY - GEN A1 - Grabinger, Lisa A1 - Homann, Alexander A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - Study: MISRA C coding guidelines [Data set] N2 - This repository contains the material and obtained data of an eye tracking study on the topic "MISRA C coding guidelines". Y1 - 2023 U6 - https://doi.org/10.5281/zenodo.7898606 ER - TY - CHAP A1 - Pozzobon, Enrico A1 - Weiß, Nils A1 - Mottok, Jürgen A1 - Matoušek, Václav T1 - Fuzzy fault injection attacks against secure automotive bootloaders T2 - 21th escar Europe : The World's Leading Automotive Cyber Security Conference (Hamburg, 15. - 16.11.2023) N2 - Secure embedded bootloaders are the trust anchors for modern vehicles’ software. The secure software update process of ECUs is well-defined across the entire automotive industry. Every OEM has his own implementation, but follows the general software update process. This paper demonstrates code execution attacks by combining software and hardware weaknesses in secure automotive bootloaders. The attack can be performed entirely automated, no static code analysisis required. Random fault injection parameters were sufficient to obtain code execution in a reasonable time. All experiments were conducted with electromagnetic fault injection and without any hardware modifications of the targets. We successfully performed our attack on two entirely different gateway Electronic Control Units (ECUs) used in current vehicles (at the time of this research) from Volkswagen and BMW. As a result of this attack, consisting of a combination of a hardware and asoftware attack, the general secure software update process used in the automotive industry needs to be revised. Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:hbz:294-103817 PB - Ruhr-Universität Bochum ER - TY - CHAP A1 - Münch, Andreas A1 - Frauenschläger, Tobias A1 - Mottok, Jürgen T1 - Integration of a Security Gateway for Critical Infrastructure into Existing PKI Systems T2 - 3. Symposium Elektronik und Systemintegration (ESI 2022), Tagungsband: 06. April 2022, Hochschule Landshut, Deutschland Y1 - 2022 SN - 978-3-9818439-7-2 SP - 88 EP - 97 PB - Hochschule Landshut CY - Landshut ER - TY - CHAP A1 - Jahn, Sabrina A1 - Kaul, Nicolas A1 - Mottok, Jürgen T1 - Using or Misusing? Introducing Misuse Cases in a Software Engineering Course for Undergraduate Engineering Students T2 - ITiCSE '22 : Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education, Vol 1: July 8 - 13, 2022, Dublin Ireland N2 - Today's cyberphysical systems are increasingly prone to misuse. To secure existing and future software systems, introducing concepts of IT-Security and Secure Software Engineering (SecSE) in Software Engineering (SE) courses is essential for academic education of future software engineers. This is not only important for computer science students, but also for engineering students studying topics of computing and SE. However, only little research exists on integrating these topics into traditional SE courses, especially for engineering students in non-computer science majors. To narrow this gap, this paper contributes with the design and evaluation of an exercise on modeling misuse cases alongside use cases, based on the inductive teaching method problem-based learning (PBL). The exercise is part of an educational design research investigating which learning content and teaching methods are suitable for integrating IT-Security and SecSE topics into traditional SE education of engineering students to convey factual knowledge as well as raise awareness and interest for both topics during software development. We present the integration of the exercise design into a traditional SE course for engineering students and its evaluation to examine its suitability. We evaluated the exercise design regarding the suitability of the design components, the learning content of misuse cases and the intended learning goals as well as its impact on students' motivation, and their interest in IT-security. The paper then presents indications on the feasibility and success of the exercise design for teaching misuse cases to engineering students and sparking their interest in IT-Security. KW - educational design research KW - mis-use case KW - problem-based learning KW - inductive teaching KW - engineering students KW - higher education KW - secure software engineering KW - IT-Security Y1 - 2022 U6 - https://doi.org/10.1145/3502718.3524823 SP - 491 EP - 497 PB - Association for Computing Machinery CY - New York, NY ER - TY - JOUR A1 - Schmid, Michael A1 - Fritz, Florian A1 - Mottok, Jürgen T1 - Fine-grained parallelism framework with predictable work-stealing for real-time multiprocessor systems JF - Journal of Systems Architecture N2 - Lately, parallel task models have received much attention in the development of real-time multiprocessor systems, as they allow highly compute-intensive tasks to have shorter deadlines which is very much required in modern reactive systems. However, missing modularity and portability can make parallel programming a cumbersome endeavor. As a consequence, compute-intensive sectors in the desktop and server segment have relied on parallelism frameworks such as Intel Threading Building Blocks, Cilk and OpenMP. These parallelism frameworks, however, are optimized for decent average case performance and consequently, do not meet the strict requirements imposed by real-time systems. In this paper, we present a proof-of-concept parallelism framework which was implemented in particular for soft real-time systems and having tight timing and safety requirements of such critical systems in mind. The proposed runtime system implements static memory allocation in a work-stealing environment that conforms to the strict space and tight probabilistic time bounds of work-stealing schedulers. Furthermore, we evaluate the performance of this framework by conducting multiprogrammed benchmarks on a real-time embedded multicore architecture. Y1 - 2022 U6 - https://doi.org/10.1016/j.sysarc.2022.102393 N1 - Corrigendum: https://www.sciencedirect.com/science/article/pii/S1383762123000528?via%3Dihub VL - 124 IS - March PB - Elsevier ER - TY - CHAP A1 - Pozzobon, Enrico A1 - Renner, Sebastian A1 - Mottok, Jürgen A1 - Matoušek, Václav T1 - An optimized Bitsliced Masked Adder for ARM Thumb-2 Controllers T2 - 27th International Conference on Applied Electronics (AE): Sep 6, 2022 - Sep 7, 2022, Pilsen, Czech Republic N2 - The modular addition is used as a non-linear operation in ARX ciphers because it achieves the requirement of introducing non-linearity in a cryptographic primitive while only taking one clock cycle to execute on most modern architectures. This makes ARX ciphers especially fast in software implementations, but comes at the cost of making it harder to protect against side-channel information leakages using Boolean masking: the best known 2-shares masked adder for ARM Thumb micro-controllers takes 83 instructions to add two 32-bit numbers together. Our approach is to operate in bitsliced mode, performing 32 additions in parallel on a 32-bit microcontroller. We show that, even after taking into account the cost of bitslicing before and after the encryption, it is possible to achieve a higher throughput on the tested ciphers (CRAX and ChaCha20) when operating in bitsliced mode. Furthermore, we prove that no first-order information leakage is happening in either simulated power traces and power traces acquired from real hardware, after sufficient countermeasures are put into place to guard against pipeline leakages. KW - ARM Thumb KW - bitsliced KW - side-channel KW - Boolean masking Y1 - 2022 U6 - https://doi.org/10.1109/AE54730.2022.9919884 PB - IEEE ER - TY - CHAP A1 - Lalo, Erjola A1 - Sailer, Andreas A1 - Mottok, Jürgen A1 - Siemers, Christian T1 - Overhead-Aware Schedule Synthesis for Logical Execution Time (LET) in Automotive Systems T2 - 2022 IEEE 35th International System-on-Chip Conference (SOCC): 05-08 September 2022, Belfast, United Kingdom N2 - The Logical Execution Time (LET) has recently been integrated in multi-core automotive systems to ensure timing and dataflow determinism. Although buffering mechanisms are introduced to incorporate LET semantics, they do not guarantee that tasks are executed within their LET frames. In fact, LET and buffering semantics are violated if scheduling is not designed to execute all tasks within their LET frames and in a specific order. In this paper, we describe a scheduling synthesis technique for Fixed-Priority Scheduling (FPS) to achieve resource-efficient execution of LET systems. The proposed approach considers LET semantics, scheduling overheads, and delays caused by operating system operations and provides the possibility to optimize the schedule with respect to aspects like scheduling overheads. Our performance and feasibility evaluation shows that the proposed algorithm provides results in a reasonable amount of time for models of complex industrial applications. Thus, the integration of the proposed algorithm into an automated process is of high benefit to accelerate the development of vehicle applications. Y1 - 2022 SN - 978-1-6654-5985-3 U6 - https://doi.org/10.1109/SOCC56010.2022.9908103 SP - 1 EP - 6 PB - IEEE ER - TY - CHAP A1 - Frauenschläger, Tobias A1 - Mottok, Jürgen T1 - Security-Gateway for SCADA-Systems in Critical Infrastructures T2 - 27th International Conference on Applied Electronics (AE): 06-07 September 2022, Pilsen, CZ N2 - Supervisory Control and Data Acquisition (SCADA) systems are used to control and monitor components within the energy grid, playing a significant role in the stability of the system. As a part of critical infrastructures, components in these systems have to fulfill a variety of different requirements regarding their dependability and must also undergo strict audit procedures in order to comply with all relevant standards. This results in a slow adoption of new functionalities. Due to the emerged threat of cyberattacks against critical infrastructures, extensive security measures are needed within these systems to protect them from adversaries and ensure a stable operation. In this work, a solution is proposed to integrate extensive security measures into current systems. By deploying additional security-gateways into the communication path between two nodes, security features can be integrated transparently for the existing components. The developed security-gateway is compliant to all regulatory requirements and features an internal architecture based on the separation-of-concerns principle to increase its security and longevity. The viability of the proposed solution has been verified in different scenarios, consisting of realistic field tests, security penetration tests and various performance evaluations. KW - Critical Infrastructure KW - Certification KW - Supervisory Control and Data Acquisition KW - Security KW - Dependability Y1 - 2022 U6 - https://doi.org/10.1109/AE54730.2022.9920070 PB - IEEE ER - TY - CHAP A1 - Schmid, Michael A1 - Mottok, Jürgen T1 - Investigation of Scheduling Algorithms for DAG. Tasks through Simulations T2 - ERTS 2022, 11th European Congress Embedded Real Time Systems: 1-2 June, Toulouse, France N2 - In the real-time systems sector, various task models and corresponding tests exist to model and verify the schedulability of task sets on the system at hand. While those models and schedulability tests have intensively been studied from a theoretical point of view, it is hard to ma e use of them to compare the actual execution behavior of scheduling algorithms on a real system. In contrast to schedulability tests, simulators can help to investigate the performance of specific scheduling algorithms. One of the most generalized task models to describe parallel tasks is the Directed Acyclic Graph model that allows to represent tasks as a series of subtasks that depict the potentially parallel computations and precedence constraints that denote the order in which the subtasks are allowed to execute. In this paper, we investigate various scheduling algorithms for the Directed Acyclic Graph model. For that, we first recapitulate the examined scheduling algorithms in detail and point out relevant differences. Subsequently, we present the evaluation of different global and federated scheduling algorithms using fine-grained parallel tasks. To this end, we generate random Directed Acyclic Graph tasks and simulate their execution on multiprocessor systems using scheduling algorithms such as global rate-monotonic and semi-federated scheduling as well as global scheduling policies using the thread pool model. KW - real-time KW - scheduling KW - task models KW - simulation Y1 - 2022 UR - https://hal.archives-ouvertes.fr/hal-03700472/document ER - TY - CHAP A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - Accessing the Presentation of Causal Graphs and an Application of Gestalt Principles with Eye Tracking T2 - 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2022), 1st Workshop on Advances in Human-Centric Experiments in Software Engineering (HUMAN 2022): 15-18 March 2022, Honolulu, HI, USA N2 - The discipline of causal inference uses so-called causal graphs to model cause and effect relations of random variables. As those graphs only encode a relation structure there is no hard rule concerning their alignment. The present paper presents a study with the aim of working out the optimal alignment of causal graphs with respect to comprehensibility and interestingness. In addition, the study examines whether the central gestalt principles of psychology apply for causal graphs. Data from 29 participants is acquired by triangulating eye tracking with a questionnaire. The results of the study suggest that causal graphs should be aligned downwards. Moreover, the gestalt principles proximity, similarity and closure are shown to hold true for causal graphs. KW - causal graphs KW - gestalt principles KW - eye tracking Y1 - 2022 U6 - https://doi.org/10.1109/SANER53432.2022.00153 SP - 1278 EP - 1285 PB - IEEE ER - TY - GEN A1 - Renner, Sebastian A1 - Pozzobon, Enrico A1 - Mottok, Jürgen T1 - 3rd Round Ciphers Evaluation on Microcontrollers T2 - Lightweight Cryptography Workshop (virtual): May 9-11 2022 Y1 - 2022 UR - https://www.nist.gov/video/day-1-part-2-lightweight-cryptography-workshop-2022 PB - National Institute of Standards and Technology (NIST) CY - Gaithersburg ER - TY - CHAP A1 - Renner, Sebastian A1 - Pozzobon, Enrico A1 - Mottok, Jürgen ED - Li, Wenjuan ED - Furnell, Steven ED - Meng, Weizhi T1 - The Final Round: Benchmarking NIST LWC Ciphers on Microcontrollers T2 - Attacks and Defenses for the Internet-of-Things, 5th International Workshop, ADIoT 2022: Copenhagen, Denmark, September 30, 2022, Revised Selected Papers N2 - In this work, we present our benchmarking results for the ten finalist ciphers of the Lightweight Cryptography (LWC) project initiated by National Institute of Standards and Technology (NIST). We evaluate the speed and code size of various software implementations on five different platforms featuring four different architectures. Moreover, we benchmark the dynamic memory utilization of the remaining NIST LWC algorithms on one 32-bit ARM controller. We describe our test cases and methodology and provide some information regarding the design and properties of the finalists before showing and discussing our results. Altogether, we evaluated almost 300 implementations of the 3rd round candidates and pick the most appropriate and best (primary) implementation of each cipher for our comparisons. We include a variant of AES-GCM in our benchmarking in order to be able to compare the state-of-the-art to the novel LWC ciphers. Our research gives an overview over the performance of the latest software implementations of the NIST LWC finalists and shows under which circumstances which candidate is performing the best in our individual test cases. Additionally, we make all benchmarking results, the code for our test framework and every tested implementation available to the public to ensure a transparent testing process. Y1 - 2022 SN - 978-3-031-21311-3 U6 - https://doi.org/10.1007/978-3-031-21311-3_1 SP - 1 EP - 20 PB - Springer Nature CY - Cham ER - TY - CHAP A1 - Renner, Sebastian A1 - Pozzobon, Enrico A1 - Mottok, Jürgen ED - Li, Wenjuan ED - Furnell, Steven ED - Meng, Weizhi T1 - Evolving a Boolean Masked Adder Using Neuroevolution T2 - Attacks and Defenses for the Internet-of-Things, 5th International Workshop, ADIoT 2022: Copenhagen, Denmark, September 30, 2022, Revised Selected Papers N2 - The modular addition is a popular building block when designing lightweight ciphers. While algorithms mainly based on the addition can reach very high performance, masking their implementations results in a huge penalty. Since efficient protection against side-channel attacks is a requirement in lots of use cases, we focus on optimizing the Boolean masking of the modular addition. Contrary to recent related work, we target evolving a masked full adder instead of parts of a parallel prefix adder. We study how techniques typically found in neural network evolution and genetic algorithms can be adapted in order to help in evolving an efficiently masked adder. We customize a well-known neuroevolution algorithm, develop an optimized masked adder with our new approach and implement the ChaCha20 cipher on an ARM Cortex-M3 controller. We compare the performance of the protected neuroevolved implementation to solutions found by traditional search methods. Moreover, the leakage of our new solution is validated by a t-test conducted with a leakage simulator. We present under which circumstances our masked implementation outperforms related work and prove the feasibility of successfully using neuroevolution when searching for complex Boolean networks. Y1 - 2022 SN - 978-3-031-21310-6 U6 - https://doi.org/10.1007/978-3-031-21311-3_2 SP - 21 EP - 40 PB - Springer Nature CY - Cham ER - TY - JOUR A1 - Fuxen, Philipp A1 - Schönhärl, Stefan A1 - Schmidt, Jonas A1 - Gerstner, Mathias A1 - Jahn, Sabrina A1 - Graf, Julian A1 - Hackenberg, Rudolf A1 - Mottok, Jürgen T1 - A Cybersecurity Education Platform for Automotive Penetration Testing JF - International Journal On Advances in Security N2 - The paper presents a penetration testing framework for automotive IT security education and evaluates its realization. The automotive sector is changing due to automated driving functions, connected vehicles, and electric vehicles. This development also creates new and more critical vulnerabilities. This paper addresses a possible countermeasure, automotive IT security education. Some existing solutions are evaluated and compared with the created Automotive Penetration Testing Education Platform (APTEP) framework. In addition, the APTEP architecture is described. It consists of three layers representing different attack points of a vehicle. The realization of the APTEP is a hardware case and a virtual platform referred to as the Automotive Network Security Case (ANSKo). The hardware case contains emulated control units and different communication protocols. The virtual platform uses Docker containers to provide a similar experience over the internet. Both offer two kinds of challenges. The first introduces users to a specific interface, while the second combines multiple interfaces, to a complex and realistic challenge. This concept is based on modern didactic theories, such as constructivism and problem-based/challenge-based learning. Computer Science students from the Ostbayerische Technische Hochschule (OTH) Regensburg experienced the challenges as part of a elective subject. In an online survey evaluated in this paper, they gave positive feedback. Also, a part of the evaluation is the mapping of the ANSKo and the maturity levels in the Software Assurance Maturity Model (SAMM) practice Education & Guidance as well as the SAMM practice Security Testing. The scientific contribution of this paper is to present an APTEP, a corresponding learning concept and an evaluation method. KW - Challenge-based Learning KW - Education Framework KW - Penetration Testing KW - Automotive KW - IT-Security Education Y1 - 2022 UR - http://www.iariajournals.org/security/sec_v15_n34_2022_paged.pdf SN - 1942-2636 VL - 15 IS - 3&4 SP - 106 EP - 118 PB - IARIA ER - TY - CHAP A1 - Maier, Robert A1 - Mottok, Jürgen ED - Trapp, Mario ED - Saglietti, Francesca ED - Spisländer, Marc ED - Bitsch, Friedemann T1 - BayesianSafety - an Open-Source Package for Causality-Guided, Multi-Model Safety Analysis T2 - Computer Safety, Reliability, and Security, 41st International Conference (SAFECOMP 2022): Munich, Germany, September 6–9, 2022, Proceedings T2 - Lecture notes in computer science ; 13414 N2 - Development and verification of modern, dependable automotive systems require appropriate modelling approaches. Classic automotive safety is described by the normative regulations ISO 26262, its relative ISO/PAS 21448, and their respective methodologies. In recent publications, an emerging demand to combine environmental influences, machine learning, or reasoning under uncertainty with standard-compliant analysis techniques can be noticed. Therefore, adapting established methods like FTA and proper tool support is necessary. We argue that Bayesian Networks (BNs) can be used as a central component to address and merge these demands. In this paper, we present our Open-Source Python package BayesianSafety. First, we review how BNs relate to data-driven methods, model-to-model transformations, and causal reasoning. Together with FTA and ETA, these models form the core functionality of our software. After describing currently implemented features and possibilities of combining individual modelling approaches, we provide an informal view of the tool’s architecture and of the resulting software ecosystem. By comparing selected publicly available safety and reliability analysis libraries, we outline that many relevant methodologies yield specialized implementations. Finally, we show that there is a demand for a flexible, unifying analysis tool that allows researching system safety by using multi-model and multi-domain approaches. KW - Package BayesianSafety KW - Causality KW - Bayesian Networks KW - Event Tree Analysis KW - Fault Tree Analysis Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-14835-4_2 SP - 17 EP - 30 PB - Springer Nature CY - Cham ER - TY - CHAP A1 - Maier, Robert A1 - Grabinger, Lisa A1 - Urlhart, David A1 - Mottok, Jürgen ED - Seguin, Christel ED - Zeller, Marc ED - Prosvirnova, Tatiana T1 - Towards Causal Model-Based Engineering in Automotive System Safety T2 - Model-Based Safety and Assessment, 8th International Symposium, IMBSA 2022: Munich, Germany, September 5–7, 2022, Proceedings N2 - Engineering is based on the understanding of causes and effects. Thus, causality should also guide the safety assessment of complex systems such as autonomous driving cars. To ensure the safety of the intended functionality of these systems, normative regulations like ISO 21448 recommend scenario-based testing. An important task here is to identify critical scenarios, so-called edge and corner cases. Data-driven approaches to this task (e.g. based on machine learning) cannot adequately address a constantly changing operational design domain. Model-based approaches offer a remedy – they allow including different sources of knowledge (e.g. data, human experts) into safety considerations. With this paper, we outline a novel approach for ensuring automotive system safety. We propose to use structural causal models as a probabilistic modelling language to combine knowledge about an open-context environment from different sources. Based on these models, we investigate parameter configurations that are candidates for critical scenarios. In this paper, we first discuss some aspects of scenario-based testing. We then provide an informal introduction to causal models and relate their development lifecycle to the established V-model. Finally, we outline a generic workflow for using causal models to identify critical scenarios and highlight some challenges that arise in the process. Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-15842-1_9 SP - 116 EP - 129 PB - Springer Nature CY - Cham ER - TY - CHAP A1 - Maier, Robert A1 - Mottok, Jürgen T1 - Causality and Functional Safety - How Causal Models Relate to the Automotive Standards ISO 26262, ISO/PAS 21448, and UL 4600 T2 - 27th International Conference on Applied Electronics (AE): 06-07 September 2022, Pilsen, CZ N2 - With autonomous driving, the system complexity of vehicles will increase drastically. This requires new approaches to ensure system safety. Looking at standards like ISO 26262 or ISO/PAS 21448 and their suggested methodologies, an increasing trend in the recent literature can be noticed to incorporate uncertainty. Often this is done by using Bayesian Networks as a framework to enable probabilistic reasoning. These models can also be used to represent causal relationships. Many publications claim to model cause-effect relations, yet rarely give a formal introduction of the implications and resulting possibilities such an approach may have. This paper aims to link the domains of causal reasoning and automotive system safety by investigating relations between causal models and approaches like FMEA, FTA, or GSN. First, the famous “Ladder of Causation” and its implications on causality are reviewed. Next, we give an informal overview of common hazard and reliability analysis techniques and associate them with probabilistic models. Finally, we analyse a mixed-model methodology called Hybrid Causal Logic, extend its idea, and build the concept of a causal shell model of automotive system safety. KW - Causality KW - Reliability KW - Functional Safety Y1 - 2022 U6 - https://doi.org/10.1109/AE54730.2022.9920053 PB - IEEE ER - TY - GEN A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - Study: Notation of Causal Graphs [Data set] N2 - This repository contains the material and obtained data of an eye tracking study on the topic "Notation of Causal Graphs". Y1 - 2022 U6 - https://doi.org/10.5281/zenodo.7241158 ER - TY - GEN A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - Study: Layout of Causal Graphs [Data set] N2 - This repository contains the material and obtained data of an eye tracking study on the topic "Layout of Causal Graphs". Y1 - 2022 U6 - https://doi.org/10.5281/zenodo.7241097 ER - TY - CHAP A1 - Weiss, Nils A1 - Renner, Sebastian A1 - Mottok, Jürgen A1 - Matoušek, Václav T1 - Automated Threat Evaluation of Automotive Diagnostic Protocols T2 - ESCAR USA, 2021, Virtual N2 - Diagnostic protocols in automotive systems can offer a huge attack surface with devastating impacts if vulnerabilities are present. This paper shows the application of active automata learning techniques for reverse engineering system state machines of automotive systems. The developed black-box testing strategy is based on diagnostic protocol communication. Through this approach, it is possible to automatically investigate a highly increased attack surface. Based on a new metric, introduced in this paper, we are able to rate the possible attack surface of an entire vehicle or a single Electronic Control Unit (ECU). A novel attack surface metric allows comparisons of different ECUs from different Original Equipment Manufacturers (OEMs), even between different diagnostic protocols. Additionally, we demonstrate the analysis capabilities of our graph-based model to evaluate an ECUs possible attack surface over a lifetime. KW - Automotive Diagnostic Protocols KW - Security Metrics KW - Automated Network Scan Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-29882 ER - TY - CHAP A1 - De, Sangita A1 - Mottok, Jürgen A1 - Brada, Premek ED - Pinker, Jiří T1 - Design Approach to Platform Agnostic Service API Modeling for Interoperability of Cross-enterprise Vehicle Applications T2 - 26th 2021 International Conference on Applied Electronics (AE): 7-8 September 2021, University of West Bohemia, Pilsen, Czech Republik N2 - In the last few years, the collaboration of services between the service-oriented, cross-enterprise vehicle application frameworks has gradually increased to generate novel and more complicated vehicle services for the automotive industry. In these service collaboration scenarios, where heterogeneous application frameworks participate to realize complex vehicle services, a source of discord that emerges is that the service providers must always check, before the service deployment, whether the clients or service consumers on the other side of the communication link are compatible with a given service's API (Application Program Interface). While using standardized templates like ontologies for API's semantic specifications are crucial for a service discovery and semantic interoperability, nevertheless, accessing these service APIs' semantic data using a standardized and understandable syntactical specification template is also equally substantial to ease services interoperability. In fact, such complex service collaboration scenarios motivate this research work which proposes a design approach towards standardized, domain-specific, platform-agnostic semantic and syntactic specification of vehicle services API models. This paper also uses a typical vehicle domain case study to illustrate the design approach and a reference mapping between the platform-agnostic semantics specifications of a vehicle service API ontological model and its corresponding language-neutral, syntactic representation using the OpenAPI standard. KW - interoperability KW - Semantic Web KW - API KW - RESTful KW - ontology Y1 - 2021 SN - 978-80-261-0973-0 U6 - https://doi.org/10.23919/AE51540.2021.9542890 SP - 1 EP - 6 PB - IEEE ER - TY - JOUR A1 - Schmid, Michael A1 - Fritz, Florian A1 - Mottok, Jürgen T1 - Fine-Grained Parallel Applications in Real-Time Multiprocessor Systems JF - Journal of Systems Architecture N2 - Lately, parallel task models have received much attention in the development of real-time multiprocessor systems, as they allow highly compute-intensive tasks to have shorter deadlines which is very much required in modern reactive systems. However, missing modularity and portability can make parallel programming a cumbersome endeavor. As a consequence, compute-intensive sectors in the desktop and server segment have relied on parallelism frameworks such as Intel Threading Building Blocks, Cilk and OpenMP. These parallelism frameworks, however, are optimized for decent average case performance and consequently, do not meet the strict requirements imposed by real-time systems. In this paper, we present a proof-of-concept parallelism framework which was implemented in particular for soft real-time systems and having tight timing and safety requirements of such critical systems in mind. The proposed runtime system implements static memory allocation in a work-stealing environment that conforms to the strict space and tight probabilistic time bounds of work-stealing schedulers. Furthermore, we evaluate the performance of this framework by conducting multiprogrammed benchmarks on a real-time embedded multicore architecture. KW - Real-time KW - Work-stealing KW - Thread pool KW - Task model KW - Parallel programming Y1 - 2021 U6 - https://doi.org/10.1016/j.sysarc.2022.102393 VL - 124 PB - Elsevier ER - TY - JOUR A1 - Weiss, Nils A1 - Pozzobon, Enrico A1 - Mottok, Jürgen A1 - Matoušek, Václav T1 - Automated Reverse Engineering of CAN Protocols JF - Neural Network World N2 - Car manufacturers define proprietary protocols to be used inside their vehicular networks, which are kept an industrial secret, therefore impeding independent researchers from extracting information from these networks. This article describes a statistical and a neural network approach that allows reverse engineering proprietary controller area network (CAN)-protocols assuming they were designed using the data base CAN (DBC) file format. The proposed algorithms are tested with CAN traces taken from a real car. We show that our approaches can correctly reverse engineer CAN messages in an automated manner. Y1 - 2021 U6 - https://doi.org/10.14311/NNW.2021.31.015 SN - 1210-0552 VL - 31 IS - 4 SP - 279 EP - 295 ER - TY - CHAP A1 - Schmid, Michael A1 - Mottok, Jürgen ED - Queudet, Audrey T1 - Response Time Analysis of Parallel Real-Time DAG Tasks Scheduled by Thread Pools T2 - 29th International Conference on Real-Time Networks and Systems (RTNS 2021): 07.04. - 09 04 2021, Nantes, France N2 - Modern high-end embedded systems nowadays have to process enormous amounts of data. In order to speed up the computations and fully exploit the resources of the underlying hardware architectures, software developers can avail parallelism frameworks such as Intel Threading Building Blocks or compiler extensions as OpenMP. They ease the development of parallel applications by providing interfaces for common parallel design patterns and by internally distributing the work among the workers of a thread pool. However, such frameworks and compiler extensions do not yet support the stringent timing requirements of real-time systems and therefore, an adaption of their computation model to the sector of real-time systems needs to be conducted. In this paper, we address the problem of scheduling parallel real-time directed acyclic graphs tasks on multiprocessor architectures where the subtasks are dispatched among and executed by the workers of a thread pool. In contrast to existing work in the state-of-the-art, we limit the maximum parallelism of real-time tasks not by the number of processors in the system, but by the number of worker threads used in the thread pool of each real-time application. For this model, we derive a worst-case response time analysis for task sets scheduled by a preemptive global fixed-priority scheduler. In order to evaluate the performance of our response time analysis, we further perform schedulability tests on generated task sets and compare the results to existing feasibility analyses in the current state-of-the-art. KW - directed acyclic graph KW - parallel task KW - Real-time systems KW - real-time, scheduling KW - response time analysis KW - thread pool Y1 - 2021 SN - 9781450390019 U6 - https://doi.org/10.1145/3453417.3453419 SP - 173 EP - 183 PB - Association for Computing Machinery CY - New York ER - TY - JOUR A1 - De, Sangita A1 - Brada, Premek A1 - Mottok, Jürgen A1 - Niklas, Michael T1 - The Empirical Evaluation of Semantic Alignment Quality Metrics for Vehicle Domain Component Frameworks Interface Ontologies JF - FLAIRS 2021 : The 34th International FLAIRS Conference. Proceedings N2 - Semantic alignment of application software components’ ontologies represents a great interest in vehicle application domains that manipulate heterogeneous overlapping knowledge application frameworks. In the past few years, with the growth in the novel vehicle service requirements such as autonomous driving, V2X (Vehicle-to-Vehicle communication) and many others, automotive application software component models are becoming increasingly collaborative with other qualified cross-enterprise industrial partners to accomplish these complex service requirements. The most daunting impediment to this cross-enterprise collaboration is semantic interoperability. For efficient services collaboration through cross-enterprise semantic interoperability between the vehicle application frameworks’ software components, aligning the interface ontologies of these components by identifying the depth of semantic alignment relationships between the concepts of the interface ontologies is the major focus of this paper. In contrast to several existing ontology structural metrics, this work defines, evaluates and validates ontology metrics to measure the depth of semantic alignment between the vehicle domain software component frameworks’ interface ontological models. To emphasize the substantial role of semantic alignment of software component frameworks’ interface ontologies in semantic interoperability, a typical vehicle domain case study involving vehicle applications is considered for demonstration. Y1 - 2021 U6 - https://doi.org/10.32473/flairs.v34i1.128512 VL - 34 IS - 1 PB - LibraryPress@UF ER - TY - CHAP A1 - Jahn, Sabrina A1 - Weiss, Nils A1 - Akcakoca, Ugur A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - López Martínez, A. ED - Candel Torres, I. T1 - Under The Hood - A Concept for Virtualized Automotive Security Education T2 - EDULEARN21: Proceedings, 13th International Conference on Education and New Learning Technologies, Online Conference. 5-6 July, 2021 N2 - In recent years, our society faced a massive interconnection of computer-based everyday objects, which opens these items for cyber-attacks. Dependent on the physical capabilities, successful attacks can vary from data exposure or a loss of functionality to a threat to life and limb. Connected- and autonomous vehicles are extremely safety-critical systems with a huge damage potential. This global trend, together with existing and upcoming regulations (ISO 270xx, ISO 21434, UNECE WP.29, UNECE R155), and the lack of qualified professionals create a tension field for the entire automotive industry. Hence, new education concepts for engineers of safety-critical and connected systems are necessary to secure our daily and future systems against cyber-attacks and raise awareness and knowledge of the topic of IT-Security. Existing automotive security education systems have one common problem: All systems are hardware-based and therefore have very steep learning curves for beginners. Hardware-based systems, in general, are expensive in their initial costs, require regular maintenance, and add diverse operational difficulties independent of the aspired education goal. Additionally, the global pandemic increased the necessity of virtual education concepts for security training in cyber-physical systems. Therefore, we present a novel concept for the education of cyber-security professionals for automotive systems based on discovery and problem-based learning in a virtual learning environment (VLE). Our concept contains individual exercises focusing on the topics of vulnerabilities and attacks in automotive networks and systems. Each exercise relates those topics to the corresponding security goals and countermeasures for mitigation. The learners work collaboratively in a self-contained manner within the VLE to acquire the necessary information to answer questions or find a solution to the given problem. To consider the heterogeneous background (e.g. knowledge, experience, preconceptions) of the learners, the topics can be presented in different difficulties, enabling an adaptable learning environment and different learning trajectories within the exercises. The concept is based on a VLE, consisting of automotive networks and components, which simulate the behavior of a vehicle. This environment provides a hands-on, "real-life" scenario, which allows discovery and problem-based learning in a realistic, but cheap and scalable education environment. Furthermore, virtualization removes common difficulties, always present in training on real hardware. This aims to decrease complexity, prevent learning obstacles related to hardware handling, and enables a location-independent learning environment. The target group of our education concept is Bachelor and Master students of computer science, engineering (e.g. electrical engineering, mechatronics), or similar studies, and (experienced) engineers from the industry. In summary, our publication contains two contributions. We present an adaptable virtual learning environment for automotive security education, combined with an educational concept based on discovery and problem-based learning techniques. The goals of our concept are the education of cyber-security professionals for safety-critical, connected automotive systems and the support of life-long learning reaching from academic education to training in the industry. KW - automotive systems KW - discovery learning KW - higher education KW - inductive teaching KW - problem-based learning KW - security education KW - virtual learning environment Y1 - 2021 SN - 978-84-09-31267-2 U6 - https://doi.org/10.21125/edulearn.2021.1231 SN - 2340-1117 SP - 6109 EP - 6118 ER - TY - GEN A1 - Stark, T. A1 - Schreistetter, Stefan A1 - Reuter, Rebecca A1 - Hauser, Florian A1 - Holmqvist, Kenneth A1 - Mottok, Jürgen A1 - Gruber, Hans T1 - Learning from Gaze: Eye Movement Modeling Examples in Software Engineering Education T2 - Earli Book of Abstracts Y1 - 2021 UR - https://earli.org/assets/files/BOA-2021.pdf SP - 291 PB - Earli ER - TY - GEN A1 - Renner, Sebastian A1 - Pozzobon, Enrico A1 - Mottok, Jürgen T1 - Current and Future Efforts in Benchmarking NIST LWC Ciphers T2 - 4th Lightweight Cryptography Workshop 2020 at NIST, Gaithersburg, USA Y1 - 2020 UR - https://csrc.nist.gov/CSRC/media/Presentations/efforts-in-benchmarking-lwc-ciphers/images-media/session-4-renner-current-future-benchmarking.pdf ER - TY - CHAP A1 - Frauenschläger, Tobias A1 - Dentgen, Manuel A1 - Mottok, Jürgen T1 - Systemarchitektur eines Sicherheitsmoduls im Energiesektor T2 - Tagungsband 2. Symposium Elektronik und Systemintegration ESI 2020: "Intelligente Systeme und ihre Komponenten: Forschung und industrielle Anwendung" N2 - Aufgrund der immer weiter anwachsenden Vernetzung der Stromnetze wird die Kommunikation zwischen der Leitstelle des Energieversorgers und den Infrastrukturkomponenten innerhalb eines Umspannwerks immer bedeutsamer. Dabei werden sowohl Steuerbefehle als auch Daten für Überwachungsfunktionen übertragen. In den aktuellen Netzwerkarchitekturen findet diese Kommunikation ohne eine kryptografische Absicherung statt, was einen Angriffspunkt für gezielte Attacken und damit eine potenzielle Gefährdung der Energieversorgung darstellt. Um solchen Angriffen in Zukunft entgegenzuwirken, wird das ES³M-Sicherheitsmodul entwickelt. Dieses soll in das Netzwerk zwischen den beiden Kommunikationspartnern eingesetzt werden und so den Datenverkehr absichern. Mithilfe einer Bedrohungsanalyse wurden Anforderungen abgeleitet, die neben kryptografischen Maßnahmen auch Themen wie funktionale Sicherheit und Langlebigkeit umfassen. Um diese zu erfüllen, wurde eine spezielle Systemarchitektur auf Basis einer Aufgabenteilung entworfen. Diese Architektur und korrespondierende Designentscheidungen werden präsentiert. Y1 - 2020 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:860-opus4-2092 N1 - Die Konferenzveröffentlichung erschien im Band "Fachbeiträge 2. Symposium Elektronik und Systemintegration ESI 2020" mit dem Titel „Intelligente Systeme und ihre Komponenten: Forschung und industrielle Anwendung“. Die Fachtagung, geplant für den 01. April 2020 an der Hochschule Landshut, wurde aufgrund der Corona-Pandemie abgesagt, die eingereichten Fachbeiträge im Band veröffentlicht. Hrsg.: Artem Ivanov, Marc Bicker und Peter Patzelt. Hochschule Landshut, 2020, ISBN 978-3-9818439-4-1 SP - 29 EP - 38 CY - Landshut ER - TY - CHAP A1 - Fritz, Florian A1 - Schmid, Michael A1 - Mottok, Jürgen ED - Brinkmann, André T1 - Accelerating Real-Time Applications with Predictable Work-Stealing T2 - Architecture of computing systems - ARCS 2020: 33rd international conference, Aachen, Germany, May 25-28, 2020, proceedings N2 - Modern compute architectures often consist of multiple CPU cores to achieve their performance, as physical properties put a limit on the execution speed of a single processor. This trend is also visible in the embedded and real-time domain, where programmers are forced to parallelize their software to keep deadlines. Additionally, embedded systems rely increasingly on modular applications, that can easily be adapted to different system loads and hardware configurations. To parallelize applications under these dynamic conditions, often dispatching frameworks like Threading Building Blocks (TBB) are used in the desktop and server segment. More recently, Embedded Multicore Building Blocks (EMB2) was developed as a task-based programming solution designed with the constraints of embedded systems in mind. In this paper, we discuss how task-based programming fits such systems by analyzing scheduler implementation variants, with a focus on classic work-stealing and the libraries TBB and EMB2. Based on the state of the art we introduce a novel resource-trading concept that allows static memory allocation in a work-stealing runtime holding strict space and time bounds. We conduct benchmarks between an early prototype of the concept, TBB and EMB2, showing that resource-trading does not introduce additional runtime overheads, while unfortunately also not improving on execution time variances. KW - Real-time KW - Parallel programming KW - Work-stealing Y1 - 2020 U6 - https://doi.org/10.1007/978-3-030-52794-5_18 SP - 241 EP - 255 ER - TY - CHAP A1 - Seebauer, Stefan A1 - Jahn, Sabrina A1 - Mottok, Jürgen T1 - Learning from Escape Rooms? A Study Design Concept Measuring the Effect of a Cryptography Educational Escape Room T2 - 2020 IEEE Global Engineering Education Conference (EDUCON): 27-30 April 2020, Porto, Portugal N2 - Experts predict that more IT-Security specialists will be needed in the coming years, but in current higher education in engineering disciplines, this topic is hardly addressed. Newer learning methods such as game-based learning (GBL) are enjoying an increasing popularity as their improvement in the education of subject specific topics can be proven by a variety of studies. We chose Educational Escape Rooms (EduER) as a GBL-tool to impart IT-Security in higher education of engineers. In our Escape Room (ER), the students try to solve puzzles and riddles with learned knowledge on the emphasis of cryptography. This paper first deals with a brief introduction to GBL and EduERs, followed by the design of our ER concept, containing different tasks with focus on the topic of cryptography. The tasks cover different cryptographic methods and hash algorithms, e.g. AES, RSA, SHA3. Afterwards the experimental study is presented. The study of the EduER was carried out with students from the bachelor's program in Electrical Engineering and Information Technology at the OTH Regensburg. The participants were divided into three groups of 5 to 8 persons each. They received a briefing with important information, followed by the ER execution, a debriefing afterwards and an exam-like evaluation sheet to test their learned knowledge. Finally, first basic results are presented. Y1 - 2020 U6 - https://doi.org/10.1109/EDUCON45650.2020.9125333 SP - 1684 EP - 1685 ER - TY - CHAP A1 - Frauenschläger, Tobias A1 - Renner, Sebastian A1 - Mottok, Jürgen T1 - Security Improvements by Separating the Cryptographic Protocol from the Network Stack onto a Multi-MCU Architecture T2 - Architecture of Computing Systems - ARCS 2020: 33rd international conference, Aachen, Germany, May 25-28, 2020, proceedings N2 - The number of IoT devices in SCADA and ICS systems is rising quickly, especially in the domain of critical infrastructures. But these kinds of systems are performing mission critical tasks like controlling devices in industrial facilities or substations in the smart grid. Therefore, they are subject to a lot of regulatory standards. Yet, to provide remote access over the internet, special architectures are developed to integrate a network interface into these devices without inferring with the actual functionality. However, these architectures either lack security measures against cyber-attacks or do not offer the necessary performance for time-critical communication interfaces. To solve that, an architecture consisting of three units is introduced in this paper to provide a network interface with extensive security measures and a high performance. The main feature is the isolation of the cryptographic functionality onto an additional MCU. After proposing the basic concept, the paper presents many implementation details. Based on the current state of implementation, a concept validation of the realized architecture is described. KW - Cyber-security KW - Functional safety KW - Network security KW - Industrial Internet of Things KW - Industrial Control System KW - Supervisory Control and Data Acquisition System Multi microcontroller setup Dos prevention Critical infrastructures KW - Multi microcontroller setup Dos prevention Critical infrastructures KW - Dos prevention KW - Critical infrastructures Y1 - 2020 U6 - https://doi.org/10.1007/978-3-030-52794-5_14 SP - 185 EP - 199 PB - Springer International Publishing ER - TY - CHAP A1 - Klopp, Marco A1 - Gold-Veerkamp, Carolin A1 - Abke, Jörg A1 - Borgeest, Kai A1 - Reuter, Rebecca A1 - Jahn, Sabrina A1 - Mottok, Jürgen A1 - Sedelmaier, Yvonne A1 - Lehmann, Alexander A1 - Landes, Dieter T1 - Totally Different and yet so Alike: Three Concepts to Use Scrum in Higher Education T2 - Proceedings of the 4th European Conference on Software Engineering Education (ECSEE '20): June 2020, Seeon/Bavaria, Germany N2 - Software process models are important in software projects in order to give the work of a project guidelines or a framework. However, teaching process models in higher education seems to be quite challenging. This has to do with the fact that undergraduates have no experience with projects in which process models are used. The theoretical mediation of process models is initially on a very abstract level. For this reason, we chose to combine two didactic approaches, namely problem-based learning and project work. Various traditional plan-driven process models have been expanded in courses in Software Engineering with agile process models. The Scrum Framework is the focus of consideration of this paper. Three Universities of Applied Sciences which cooperate in the EVELIN project focused on Scrum as a process model and integrated it into their teaching. Since the respective concepts of implementation differ, they should be presented and compared in this article to presents some practice approaches. The goal of this presentation of is a uniform evaluation in order to obtain insights from different perspectives. This comparison can draw conclusions for possible necessary improvements of the respective concepts. Y1 - 2020 U6 - https://doi.org/10.1145/3396802.3396817 SP - 12 EP - 21 ER - TY - CHAP A1 - Dentgen, Manuel A1 - Renner, Sebastian A1 - Mottok, Jürgen ED - Brinkmann, André ED - Karl, Wolfgang ED - Lankes, Stefan ED - Tomforde, Sven ED - Pionteck, Thilo ED - Trinitis, Carsten T1 - Equally Distributed Bus-Communication Access Rights for Inter MCU Communication Using Multimaster SPI T2 - Architecture of Computing Systems - ARCS 2020: 33rd international conference, Aachen, Germany, May 25-28, 2020, proceedings T2 - Lecture notes in computer science ; Bd. 12155 N2 - With the rising complexity and processing power of modern computer systems, the amount of MCU on a single PCB also rises. These microcontrollers often need to communicate with each other to exchange payload and control information in a bidirectional manner. Today’s well-established communication protocols in MCUs either do not fit modern transmission speed requirements or do have an inappropriate master-slave attribute, which does not allow the communication partners to have equal bus access rights. Therefore, this paper introduces an extension of the Serial Peripheral Interface (SPI) to allow an equally distributed access right for the communication interface between two microcontrollers. It simultaneously does fit modern transmission speed requirements of a common network interface, so that the message transmission does not constitute a bottleneck in data processing. Besides the protocol design, we do also provide a first prototype implementation, which constitutes a proof of concept. Y1 - 2020 U6 - https://doi.org/10.1007/978-3-030-52794-5_15 SP - 200 EP - 212 ER - TY - CHAP A1 - Jahn, Sabrina A1 - Mottok, Jürgen T1 - Work in Progress: Towards an Academic Secure Software Engineering Curriculum for Engineers T2 - 2020 IEEE Global Engineering Education Conference (EDUCON): 27-30 April 2020, Porto, Portugal N2 - In the age of the Internet of Things, it is becoming increasingly important to integrate knowledge about the development of secure systems (Secure Software Engineering) into academic teaching. However, teaching IT Security and Secure Software Engineering to non-computer scientists is rare. Therefore, we focus our research on the integration of IT Security into software engineering education of non-computer scientists, particularly electrical engineers, by means of inductive teaching- and learning-arrangements. After collecting students' preconceptions of IT Security and Secure Software Engineering in prior work, this paper now contributes with a first mapping of these preconceptions with corresponding learning content as well as suitable inductive teaching methods to be able to create new lecture and exercise units and improve academic learning and teaching in both areas. Y1 - 2020 U6 - https://doi.org/10.1109/EDUCON45650.2020.9125210 SP - 1713 EP - 1717 ER - TY - CHAP A1 - Weiss, Nils A1 - Renner, Sebastian A1 - Mottok, Jürgen A1 - Matoušek, Václav T1 - Transport Layer Scanning for Attack Surface Detection in Vehicular Networks T2 - CSCS '20: Computer Science in Cars Symposium N2 - In the beginning of every security analysis or penetration test of a system, information about the target has to be gathered. On IT-Systems a port scan is usually performed as a first step of an investigation. Since the communication protocols differ in automotive systems, generic port scanning tools can’t be used for a security analysis of CANs. More complex protocols have a higher likelihood of implementation errors and bugs. On CAN networks, such payloads are transferred through International Standard Transport Protocol (ISO-TP) communication. We designed a new methodology to identify ISO-TP endpoints in automotive networks. Every of these endpoints can provide exploitable application layer protocols and therefor has to be considered during penetration testing and security analysis. We contribute a new scan approach for the automated evaluation of possible attack surfaces in automotive CAN networks which has a higher coverage and multiple advantages than state of the art approaches. KW - automotive networks KW - network scan KW - attack surface detection KW - automation Y1 - 2020 U6 - https://doi.org/10.1145/3385958.3430476 IS - 7 SP - 1 EP - 8 CY - Feldkirchen ER - TY - CHAP A1 - Renner, Sebastian A1 - Pozzobon, Enrico A1 - Mottok, Jürgen ED - Meng, Weizhi T1 - A Hardware in the Loop Benchmark Suite to Evaluate NIST LWC Ciphers on Microcontrollers T2 - Information and Communications Security: 22nd International Conference, ICICS 2020, Copenhagen, Denmark, August 24-26, 2020, Proceedings N2 - The National Institute of Standards and Technology (NIST) started the standardization process for lightweight cryptography algorithms in 2018. By the end of the first round, 32 submissions have been selected as 2nd round candidates. NIST allowed designers of 2nd round submissions to provide small updates on both their specifications and implementation packages. In this work, we introduce a benchmarking framework for evaluating the performance of NIST Lightweight Cryptography (LWC) candidates on embedded platforms. We show the features and application of the framework and explain its design rationale. Moreover, we provide information on how we aim to present up-to-date performance figures throughout the NIST LWC competition. In this paper, we present an excerpt of our software benchmarking results regarding speed and memory requirements of selected ciphers. All up-to-date results, including benchmarking different test cases for multiple variants of each 2nd round algorithm on five different microcontrollers, are periodically published to a public website. While initially only the reference implementations were available, the ability of automatically testing the performance of the candidate algorithms on multiple platforms becomes especially relevant as more optimized implementations are developed. Finally, we show how the framework can be extended in different directions: support for more target platforms can be easily added, different kinds of algorithms can be tested, and other test metrics can be acquired. The focus of this paper should rather lay on the framework design and testing methodology than on the current results, especially for reference code. KW - Lightweight cryptography KW - Benchmarking KW - Embedded systems KW - RISC-V Y1 - 2020 U6 - https://doi.org/10.1007/978-3-030-61078-4_28 SP - 495 EP - 509 PB - Springer CY - Cham ER - TY - CHAP A1 - Reuter, Rebecca A1 - Stark, Theresa A1 - Sedelmaier, Yvonne A1 - Landes, Dieter A1 - Mottok, Jürgen A1 - Wolff, Christian T1 - Insights in Students’ Problems during UML Modeling T2 - 2020 IEEE Global Engineering Education Conference (EDUCON): Proceedings N2 - UML (Unified Modeling Language) is the current de facto as well as de jure standard (ISO/IEC 19505:2012) notation to visualize models in software development. UML provides essential guidelines and rules to visualize and understand complex software systems. This is the reason why it has become part of curricula for software engineering courses at many universities worldwide. It is well known, however, that UML is hard to grasp for novices, mainly due to its complexity. In order to tackle the problem of teaching UML to novice students appropriately, it is inevitable to understand their needs and problems much better than we do now. This paper presents empirical insights into students' problems when developing common UML diagrams. Identified problems are generalized, giving rise to a problem catalogue that is derived from our empirical findings, thus establishing a basis for addressing these problems through focused learning arrangements. KW - UML KW - UML problems KW - software engineering KW - higher education KW - visual notation Y1 - 2020 U6 - https://doi.org/10.1109/EDUCON45650.2020.9125110 SP - 592 EP - 600 ER - TY - CHAP A1 - Gruber, Hans A1 - Wolff, Christian A1 - Mottok, Jürgen A1 - Bazo, Alexander A1 - Hauser, Florian A1 - Schreistetter, Stefan T1 - Tutorial on Software Engineering Education in Co-Located Multi-User Eye-Tracking-Environments T2 - Proceedings of the 32nd IEEE Conference on Software Engineering Education and Training: Munich, November 2020 N2 - We briefly describe a tutorial on the application of Eye-Tracking technology for Software Engineering Education. We will showcase our setup of a large-scale Eye-Tracking-Classroom and its usage for real-time improvement of traditional learning scenarios in Software Engineering Education. We will focus on the integration of gaze data into modern integrated development environments (IDEs) and demonstrate a complete workflow for its usage in co-located multi-user Eye-Tracking-Environments. KW - eye-tracking KW - software engineering education KW - multi-user eye tracking KW - real-time learning scenarios Y1 - 2020 U6 - https://doi.org/10.1109/CSEET49119.2020.9206170 ER - TY - CHAP A1 - Inderwies, Tom A1 - Mottok, Jürgen T1 - Secure Software Update of a Secure Module in the Power Grid T2 - Proceedings of the Regensburg Applied Research Conference 2020 (RARC 2020), July 31st Y1 - 2020 UR - https://doi.org/10.35096/othr/pub-641 SP - 25 EP - 31 ER - TY - CHAP A1 - Hauser, Florian A1 - Schreistetter, Stefan A1 - Reuter, Rebecca A1 - Mottok, Jürgen A1 - Gruber, Hans A1 - Holmqvist, Kenneth A1 - Schorr, Nick T1 - Code reviews in C++: Preliminary results from an eye tracking study T2 - ETRA '20 Short Papers: ACM Symposium on Eye Tracking Research and ApplicationsJune 2020 N2 - Code reviews are an essential part of quality assurance in modern software projects. But despite their great importance, they are still carried out in a way that relies on human skills and decisions. During the last decade, there have been several publications on code reviews using eye tracking as a method, but only a few studies have focused on the performance differences between experts and novices. To get a deeper understanding of these differences, the following experiment was developed: This study surveys expertise-related differences in experts’, advanced programmers’, and novices’ eye movements during the review of eight short C++ code examples, including correct and erroneous codes. A sample of 35 participants (21 novices, 14 advanced and expert programmers) were recruited. A Tobii Spectrum 600 was used for the data collection. Measures included participants’ eye movements during the code review, demographic background data, and cued retrospective verbal comments on replays of their own eye movement recordings. Preliminary results give proof for experience-related differences between participants. Advanced and expert programmers performed significantly better in case of error detection and the eye tracking data implies a more efficient reviewing strategy. Y1 - 2020 SN - ISBN 9781450371346 U6 - https://doi.org/10.1145/3379156.3391980 SP - 1 EP - 5 ER - TY - CHAP A1 - Hauser, Florian A1 - Stark, Theresa A1 - Mottok, Jürgen A1 - Gruber, Hans A1 - Reuter, Rebecca T1 - Deliberate Practice in Programming: How is it carried out by programmers? T2 - ECSEE '20: Proceedings of the 4th European Conference on Software Engineering Education, Seeon, Germany, June 2020 N2 - This work in progress study examines through which activities programmers perform deliberate practice to improve their own skills in coding and programming. For this reason, a qualitative questionnaire was developed and conducted with a sample of 22 participants. The results indicate that programmers perform formal and informal forms of training and learning. Typically, a classical programming training in the context of a university course or for work-related reasons is a first step in the acquisition of expertise. Building on these basic skills, non-formal and informal learning activities are carried out by the learners. Especially the social interaction and the collaborative work with other programmers is of great importance in this context. The activities mentioned by the test persons fulfil the characteristics of deliberate practice and will be examined more closely in a further study. Y1 - 2020 SN - ISBN 9781450377522 U6 - https://doi.org/10.1145/3396802.3396815 SP - 42 EP - 46 ER - TY - JOUR A1 - De, Sangita A1 - Niklas, Michael A1 - Brian, Rooney A1 - Mottok, Jürgen A1 - Brada, Premek T1 - Semantic Mapping of Component Framework Interface Ontologies for Interoperability of Vehicle Applications JF - Procedia Computer Science N2 - Over the past few years, ontology merging, and ontology semantic alignment has gained significant interest as research topics in automotive application domain for finding solutions to semantic data heterogeneity. To accomplish the complex and novel vehicle service requirements such as autonomous driving, V2X (Vehicle-to-Vehicle communication), etc. the automotive applications involve collaborations of several platform-specific data from heterogeneous enterprises component frameworks and consequently there has been increase in data interoperability issues. At the application component level, data interoperability relies on the semantic alignment or mapping between the various component framework interfaces data models represented as XML schemas (XSD). With the XML schemas being the preferred standard for the interface description exchange between most of the automotive application domain components, however, the data interoperability between the semantically equivalent but structurally different data constructs of multiple heterogeneous XSDs stands as a challenge in the absence of an ontology-based approach. To confront this crucial requirement for data interoperability and to increase in effect the reuse of existing components through their interfaces, we propose an approach to semantically map the various component framework interface data models when expressed as ontology schemas, based on the exploration of semantic synergies. The transformation between XSD and RDF (Resource Description Framework) schema representations and the use of queries over the ontology schemas for semantic mapping are demonstrated including a real-world case study. KW - component KW - interface KW - mapping KW - ontology KW - semantic Y1 - 2020 U6 - https://doi.org/10.1016/j.procs.2020.03.151 VL - 170 IS - 2 SP - 813 EP - 818 PB - Elsevier ER - TY - RPRT A1 - Taiber, Joachim A1 - Chowdury, M. A1 - Hammond, G. A1 - Hipp, V. A1 - Huttner, B. A1 - Lonien, J. A1 - Mottok, Jürgen A1 - Neukart, Florian A1 - Stengel, T. T1 - Unsettled Topics Concerning the Impact of Quantum Technologies on Automotive Cybersecurity N2 - Quantum computing is considered the “next big thing” when it comes to solving computational problems impossible to tackle using conventional computers. However, a major concern is that quantum computers could be used to crack current cryptographic schemes designed to withstand traditional cyberattacks. This threat also impacts future automated vehicles as they become embedded in a vehicle-to-everything (V2X) ecosystem. In this scenario, encrypted data is transmitted between a complex network of cloud-based data servers, vehicle-based data servers, and vehicle sensors and controllers. While the vehicle hardware ages, the software enabling V2X interactions will be updated multiple times. It is essential to make the V2X ecosystem quantum-safe through use of “post-quantum cryptography” as well other applicable quantum technologies. This SAE EDGE™ Research Report considers the following three areas to be unsettled questions in the V2X ecosystem: How soon will quantum computing pose a threat to connected and automated vehicle technologies? What steps and measures are needed to make a V2X ecosystem “quantum-safe?” What standardization is needed to ensure that quantum technologies do not pose an unacceptable risk from an automotive cybersecurity perspective? Y1 - 2020 U6 - https://doi.org/10.4271/EPR2020026 SN - 2640-3536 CY - Warrendale, Pennsylvania, USA ER - TY - GEN A1 - Hauser, Florian A1 - Reuter, Rebecca A1 - Gegenfurtner, Andreas A1 - Gruber, Hans A1 - Mottok, Jürgen A1 - Hutzler, Ivonne T1 - Heuristics in Software Modelling: An Eyetracking Study T2 - Earli Book of Abstracts N2 - To investigate the role of heuristics in the domain of software engineering, an eye tracking study was conducted in which experts and novices were compared. The study focused on one of the most challenging parts in this domain: the generation of an object model for a software product based on a requirements specification. During their training, software engineers are taught different techniques to solve this task. One of these techniques is the noun/verb analysis. However, it is still unclear to what extent novice and expert programmers are making use of it. Ideally, the noun/verb analysis works as a heuristic and helps programmers to make fast and accurate decisions. Participants in the study were 40 software programmers at four levels of expertise (novices, intermediates, experienced rogrammers, experts). They were presented with ten decision tasks. In each task, participants read a requirement specification and then had to choose one out of three presented class diagrams that they considered the best solution. During the task, their eye movements were recorded. Results show that all participants used the noun/verb analysis as a heuristic. Programmers with higher levels of expertise, however, outperformed programmers with lower levels of expertise. Interestingly, the more experienced programmers were not following the noun/verb analysis in a blindfolded way. They realised that the noun/verb analysis would produce diagrams, but a skilled software architect would not model them in this way. Instead they created their models in a way that they perceived as more logical and realistic Y1 - 2019 UR - https://earli.org/sites/default/files/2019-09/BOA-2019.pdf PB - RWTH Aachen ER - TY - CHAP A1 - Schmid, Michael A1 - Fritz, Florian A1 - Mottok, Jürgen T1 - Parallel Programming in Real-Time Systems T2 - Architecture of computing systems - ARCS 2019, 32nd international conference, Copenhagen, Denmark, May 20-21, 2019, proceedings N2 - The enormous amounts of data modern real-time systems have to process lead to expensive, long-lasting calculations. In order to manage those computations in a timely manner, parallel task models have gained a lot of popularity lately. However, parallel programming can be very cumbersome and verbose. Other computationally intensive sectors have dealt with parallel computing for decades and have accumulated their experience in the development of parallel frameworks. Examples of well known parallel runtime systems are OpenMP, Intel Threading Building Blocks (TBB) and Microsoft Parallel Pattern Library (PPL). These runtime systems allow developers to enhance parallelism in their applications in a straightforward fashion. However, those parallel frameworks and the patternbased interfaces they provide might not be easily applicable in real-time systems. In this paper, we investigate the use of parallel programming frameworks in time-critical systems. On that account, we discuss considerations for the design of real-time applications that make use of such parallel runtime systems. Furthermore, we evaluate three library-based frameworks from different computing sectors, namely Intel Threading Building Blocks, Embedded Multicore Building Blocks (EMBB) and High Performance ParalleX (HPX), by conducting benchmarks of various parallel algorithms on an embedded multicore architecture. Y1 - 2019 UR - https://ieeexplore.ieee.org/abstract/document/8836206 PB - VDE-Verlag CY - Berlin ER -