TY - JOUR A1 - Pozzobon, Enrico A1 - Weiß, Nils A1 - Mottok, Jürgen A1 - Matoušek, Václav T1 - An evolutionary fault injection settings search algorithm for attacks on safe and secure embedded systems JF - Neural Network World (NNW) Y1 - 2023 U6 - https://doi.org/10.14311/NNW.2023.33.020 VL - 33 IS - 5 SP - 357 EP - 374 PB - Czech Technical University in Prague ER - TY - CHAP A1 - Füreder, Lukas A1 - Mottok, Jürgen T1 - Assessment of a MACsec-based Security System for Use in Critical Infrastructure Communication T2 - Proceedings of the 12th Prague Embedded Systems Workshop, June 27 - 29, 2024, Horoměřice, Czech Republic N2 - This paper investigates the integration of Media Access Control Security (MACsec) into the communication of critical infrastructure, specifically within power grid applications, such as Substation Automation Systems (SAS) using the IEC 61850 standard. Building on the principles of both standards, this study aims to determine if MACsec can meet the security and performance requirements set by IEC 62351 for power system communications. Furthermore, a test environment containing a number of Intelligent Electronic Devices (IEDs) supporting communication compliant to all IEC 61850 message types is established to evaluate this integration. The results of the measurements executed in this environment indicate that MACsec could secure all types of messages, such as Manufacturing Message Specification (MMS), Sampled-Value (SV) and Generic Object Oriented Substation Events (GOOSE), within the required time periods without significant delays. Even with additional encryption activated in the cipher suite, the resulting transmission times are well below the required times. This suggests that MACsec can enhance the security goals for industrial communication by providing confidentiality in addition to the already mandated assurance of authenticity and integrity to all messages without compromising performance. Only the requirement for end-to-end security cannot be met by MACsec in this configuration, as the security system re-encrypts with every hop of the transmission. For this reason, we propose a hybrid approach of Transport Layer Security (TLS) and MACsec as part of future work. KW - MACsec KW - IEC61850 KW - IEC62351 KW - GOOSE KW - Secure Communication Y1 - 2024 UR - https://pesw.fit.cvut.cz/2024/PESW_2024.pdf SN - 978-80-01-07303-2 SP - 51 EP - 59 ER - TY - CHAP A1 - Bittner, Dominik A1 - Hendricks, Ricky-Ricardo A1 - Horn, Luca A1 - Mottok, Jürgen T1 - In-depth Benchmarking of Transfer Learning Techniques for Improved Bottle Recognition T2 - 2023 IEEE 13th International Conference on Pattern Recognition Systems (ICPRS), Guayaquil, Ecuador, 04-07 July 2023 N2 - An immense diversity in bottle types requires high accuracy during sorting for recycling purposes by breweries. This extremely complex and time-consuming procedure can result in enormous additional costs for them. This paper presents transfer learning-based algorithms for classifying beer bottle brands using camera images, applicable in individual sorting solutions for different use cases. The problem is tackled using customised EfficientNet, InceptionResNet and VGG models along with an augmented dataset. In addition, a detailed analysis of different model and parameter combinations is performed, enabling tailor-made technologies for specific conditions and resource limitations. In accompanying validations and subsequent tests, a test accuracy of 100% in the recognition of beer brands could be achieved, proving the proposed method fully contributes to the solution of the problem. KW - Analytical models KW - Costs KW - Transfer learning KW - Benchmark testing KW - Cameras KW - Pattern recognition KW - Recycling Y1 - 2023 SN - 979-8-3503-3337-4 U6 - https://doi.org/10.1109/ICPRS58416.2023.10178995 SP - 1 EP - 6 PB - IEEE ER - TY - CHAP A1 - Röhrl, Simon A1 - Staufer, Susanne A1 - Nadimpalli, Vamsi Krishna A1 - Bugert, Flemming A1 - Bugert, Flemming A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Ezer, Timur A1 - Mottok, Jürgen T1 - PYTHIA - AI SUGGESTED INDIVIDUAL LEARNING PATHS FOR EVERY STUDENT T2 - INTED2024 Proceedings: 18th International Technology, Education and Development Conference, Valencia, Spain. 4-6 March, 2024 N2 - During the COVID-19 pandemic, the importance of digital course rooms, where teachers provide their learning materials, increased dramatically. While these platforms are crucial for providing teaching materials, they often fall short in addressing individual student needs. A system within an academic setting, capable of creating and presenting individual learning paths for each student, can solve these issues. These paths are composed of various learning elements - defined in our previous work as units of educational content with which a learner works. Currently, there is no suitable system that enables the integration of learning path generating algorithms into a digital course room. Therefore we present an application that enables this integration into the Moodle Learning Management System (LMS). More precisely, this paper presents a Moodle plugin together with its framework. It describes the mechanism for effectively collecting data from Moodle, which AI algorithms then use to generate personalized learning paths. Subsequently these paths are visualized with the help of the Moodle plugin. We started with a set of requirements and use cases for the interface connecting Moodle to the AI system, which were established with a group of experts. Based on the requirements, various relevant technologies were assessed, and the best ones were chosen for implementation. Following that, the paper develops a strategy for software structuring as well as an architecture, focusing on performance, modularity, and ease of deployment for widespread use. Furthermore, the architecture ensures a simple method for integrating the algorithms. Afterwards, the framework's concrete implementation is described. A technique for enriching learning elements with metadata is presented, and additionally a concept for presenting these learning elements within a hierarchy. Moreover, it is shown how questionnaire responses and learning analytics are utilized for data collection. We cover in detail techniques for extracting and storing data from the Moodle database, as well as methods for customizing Moodle course rooms and a standard API for incorporating AI algorithms. Finally, the paper discusses the application of the proposed framework in an actual course and how student feedback is collected, which could enhance the framework. It concludes with an assessment of the outcomes obtained and prospects for the framework's future advancements. KW - Personalized Learning Paths KW - Learning Management System KW - Software Architecture KW - Moodle KW - Artificial Intelligence Y1 - 2024 SN - 978-84-09-59215-9 U6 - https://doi.org/10.21125/inted.2024.0783 SN - 2340-1079 SP - 2871 EP - 2880 ER - TY - JOUR A1 - Fuxen, Philipp A1 - Schönhärl, Stefan A1 - Schmidt, Jonas A1 - Gerstner, Mathias A1 - Jahn, Sabrina A1 - Graf, Julian A1 - Hackenberg, Rudolf A1 - Mottok, Jürgen T1 - A Cybersecurity Education Platform for Automotive Penetration Testing JF - International Journal On Advances in Security N2 - The paper presents a penetration testing framework for automotive IT security education and evaluates its realization. The automotive sector is changing due to automated driving functions, connected vehicles, and electric vehicles. This development also creates new and more critical vulnerabilities. This paper addresses a possible countermeasure, automotive IT security education. Some existing solutions are evaluated and compared with the created Automotive Penetration Testing Education Platform (APTEP) framework. In addition, the APTEP architecture is described. It consists of three layers representing different attack points of a vehicle. The realization of the APTEP is a hardware case and a virtual platform referred to as the Automotive Network Security Case (ANSKo). The hardware case contains emulated control units and different communication protocols. The virtual platform uses Docker containers to provide a similar experience over the internet. Both offer two kinds of challenges. The first introduces users to a specific interface, while the second combines multiple interfaces, to a complex and realistic challenge. This concept is based on modern didactic theories, such as constructivism and problem-based/challenge-based learning. Computer Science students from the Ostbayerische Technische Hochschule (OTH) Regensburg experienced the challenges as part of a elective subject. In an online survey evaluated in this paper, they gave positive feedback. Also, a part of the evaluation is the mapping of the ANSKo and the maturity levels in the Software Assurance Maturity Model (SAMM) practice Education & Guidance as well as the SAMM practice Security Testing. The scientific contribution of this paper is to present an APTEP, a corresponding learning concept and an evaluation method. KW - Challenge-based Learning KW - Education Framework KW - Penetration Testing KW - Automotive KW - IT-Security Education Y1 - 2022 UR - http://www.iariajournals.org/security/sec_v15_n34_2022_paged.pdf SN - 1942-2636 VL - 15 IS - 3&4 SP - 106 EP - 118 PB - IARIA ER - TY - CHAP A1 - Staufer, Susanne A1 - Hauser, Florian A1 - Grabinger, Lisa A1 - Bittner, Dominik A1 - Nadimpalli, Vamsi Krishna A1 - Bugert, Flemming A1 - Ezer, Timur A1 - Röhrl, Simon A1 - Mottok, Jürgen T1 - Learning elements in LMS - a survey among students T2 - INTED2024 Proceedings: 18th International Technology, Education and Development Conference, Valencia, Spain. 4-6 March, 2024 N2 - In higher education, improving learning and learning success are goals of general improvement. Lecturers teaches content and students acquire that content in an efficient way. To structure content, learning element categories are evaluated from the student's point of view in higher education area. The aim is to validate given definitions of ten learning element categories within a Learning Management System (LMS). This paper evaluates a categorization of learning elements for organizing learning content in online education within LMSs. Therefore, ten categories of learning elements and corresponding definitions were defined in a previous work as base for this paper. The learning elements to examine are manuscript, exercise, quiz, brief overview, learning goal, summary, collaboration tool, auditory additional material, textual additional material, and visual additional material. To validate the definitions and to get improvements to each learning element a survey is processed. Beside the demographic data questions, the survey consists of two questions to the acceptance of the definitions and asks for improvements. 148 students between the ages 19 and 35 participate in the survey in summer term 2023. The education level of the participants ranges from undergraduates to Ph.D. students. The results of this paper are that more than 80% accept the given definitions. Some definitions of the learning elements are changed, but the changes are restricted to additions of maximal four words. This categorization of learning elements could lead to improvements in learning by giving the content more structure. With the structure students get the possibility to learn with preferred learning elements which could lead to more success in learning and to a decreasing dropout rate in universities. In the future, the learning elements allow to classify content within LMSs with the goal of generating individual learning paths. Furthermore, our project will integrate these learning elements, use them to generate learning paths, and could set a new standard in the way of personalized learning. KW - Learning elements KW - learning management system KW - learning objects KW - questionnaire KW - higher education area KW - content organization Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-71135 SN - 978-84-09-59215-9 SN - 2340-1079 SP - 4224 EP - 4231 PB - IATED ER - TY - CHAP A1 - Grabinger, Lisa A1 - Ezer, Timur A1 - Hauser, Florian A1 - Mottok, Jürgen T1 - The impact of eyenalyzer T2 - ICERI2024 Proceedings: 17th Annual International Conference of Education, Research and Innovation, 11th-13th November 2024, Seville, Spain N2 - Empirical research poses numerous challenges for beginners. This is especially true for data analysis – a task that usually requires knowledge from two distinct areas: statistics and programming. To support prospective researchers with that task, we developed a web-based tool called eyenalyzer. It supports common activities in the data analysis phase of empirical studies in a way that is suitable for novices in both, statistics and programming. The present article describes a controlled experiment investigating the impact of this tool with a total of 20 participants. All of them are given a set of common data analysis tasks. Half of the participants complete the tasks using eyenalyzer, the other half can use anything except for eyenalyzer. For each task and participant, we record the time in minutes, the task score, and the perceived difficulty. The results confirm that our tool is a valuable support for novice researchers: With eyenalyzer, the participants are significantly faster, achieve higher scores, and perceive the tasks to be less difficult. KW - tool evaluation KW - data analysis KW - eye tracking KW - empirical research Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-78215 SN - 978-84-09-63010-3 SN - 2340-1095 SP - 695 EP - 701 PB - IATED ER - TY - CHAP A1 - Jahn, Sabrina A1 - Weiss, Nils A1 - Akcakoca, Ugur A1 - Mottok, Jürgen ED - Gómez Chova, Luis ED - López Martínez, A. ED - Candel Torres, I. T1 - Under The Hood - A Concept for Virtualized Automotive Security Education T2 - EDULEARN21: Proceedings, 13th International Conference on Education and New Learning Technologies, Online Conference. 5-6 July, 2021 N2 - In recent years, our society faced a massive interconnection of computer-based everyday objects, which opens these items for cyber-attacks. Dependent on the physical capabilities, successful attacks can vary from data exposure or a loss of functionality to a threat to life and limb. Connected- and autonomous vehicles are extremely safety-critical systems with a huge damage potential. This global trend, together with existing and upcoming regulations (ISO 270xx, ISO 21434, UNECE WP.29, UNECE R155), and the lack of qualified professionals create a tension field for the entire automotive industry. Hence, new education concepts for engineers of safety-critical and connected systems are necessary to secure our daily and future systems against cyber-attacks and raise awareness and knowledge of the topic of IT-Security. Existing automotive security education systems have one common problem: All systems are hardware-based and therefore have very steep learning curves for beginners. Hardware-based systems, in general, are expensive in their initial costs, require regular maintenance, and add diverse operational difficulties independent of the aspired education goal. Additionally, the global pandemic increased the necessity of virtual education concepts for security training in cyber-physical systems. Therefore, we present a novel concept for the education of cyber-security professionals for automotive systems based on discovery and problem-based learning in a virtual learning environment (VLE). Our concept contains individual exercises focusing on the topics of vulnerabilities and attacks in automotive networks and systems. Each exercise relates those topics to the corresponding security goals and countermeasures for mitigation. The learners work collaboratively in a self-contained manner within the VLE to acquire the necessary information to answer questions or find a solution to the given problem. To consider the heterogeneous background (e.g. knowledge, experience, preconceptions) of the learners, the topics can be presented in different difficulties, enabling an adaptable learning environment and different learning trajectories within the exercises. The concept is based on a VLE, consisting of automotive networks and components, which simulate the behavior of a vehicle. This environment provides a hands-on, "real-life" scenario, which allows discovery and problem-based learning in a realistic, but cheap and scalable education environment. Furthermore, virtualization removes common difficulties, always present in training on real hardware. This aims to decrease complexity, prevent learning obstacles related to hardware handling, and enables a location-independent learning environment. The target group of our education concept is Bachelor and Master students of computer science, engineering (e.g. electrical engineering, mechatronics), or similar studies, and (experienced) engineers from the industry. In summary, our publication contains two contributions. We present an adaptable virtual learning environment for automotive security education, combined with an educational concept based on discovery and problem-based learning techniques. The goals of our concept are the education of cyber-security professionals for safety-critical, connected automotive systems and the support of life-long learning reaching from academic education to training in the industry. KW - automotive systems KW - discovery learning KW - higher education KW - inductive teaching KW - problem-based learning KW - security education KW - virtual learning environment Y1 - 2021 SN - 978-84-09-31267-2 U6 - https://doi.org/10.21125/edulearn.2021.1231 SN - 2340-1117 SP - 6109 EP - 6118 ER - TY - CHAP A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Staufer, Susanne A1 - Mottok, Jürgen T1 - EYE TRACKING AS TECHNOLOGY IN EDUCATION: FURTHER INVESTIGATION OF DATA QUALITY AND IMPROVEMENTS T2 - INTED2024 Proceedings: 18th International Technology, Education and Development Conference, Valencia, Spain. 4-6 March, 2024 N2 - Eye tracking serves as a powerful tool across a variety of empirical research areas: From usability research over cognitive research to educational research and applications in classrooms. However, data noise in eye tracking data poses a challenge to researchers and educators, as it leads to gaze positions being measured imprecisely under unfavorable conditions. In our previous study, we systematically investigated factors that influence data quality and are easily controllable in a classroom or laboratory environment, such as illumination, sampling frequency, and head orientation. However, no recommendations regarding the light source and light orientation could be provided, as these influences could not be analyzed in sufficient detail. Yet, a further examination of these factors, eliminating human influences by using an artificial head, revealed significant differences between individual settings. Hence, in this empirical study of eye tracking as an educational technology, we delve deeper into examining the impact of both light source and light orientation on data quality. This is investigated with an artificial head together with the Tobii Pro Spectrum eye tracking device. To measure data quality, we use the metrics precision and standard deviation as indicators of data noise. The obtained results derive practical advice for educators and researchers, such as not to illuminate the subject from the rear, in order to gather useful data for research and future classroom applications. Thereby, this study serves as a complement to our previous research, answering open questions regarding best practices for researchers and educators when using eye trackers. It aims to provide valuable insights into producing data of the highest quality possible when using eye trackers, both in laboratory settings and in future classrooms applications. KW - Eye tracking KW - data quality KW - best practices KW - lighting conditions KW - standard deviation KW - precision Y1 - 2024 SN - 978-84-09-59215-9 U6 - https://doi.org/10.21125/inted.2024.0802 SN - 2340-1079 SP - 2955 EP - 2961 PB - IATED Academy ER - TY - CHAP A1 - Ezer, Timur A1 - Grabinger, Lisa A1 - Hauser, Florian A1 - Staufer, Susanne A1 - Mottok, Jürgen T1 - EYE TRACKING METRICS FOR DISTINGUISHING GLOBAL AND FOCAL GAZE PATTERNS: A SYSTEMATIC LITERATURE REVIEW T2 - INTED2024 Proceedings: 18th International Technology, Education and Development Conference, Valencia, Spain. 4-6 March, 2024 N2 - Global and focal eye tracking gaze patterns are distinguished in a variety of domains, such as radiology research, empirical software engineering, behavioral psychology, and cartography research. A global gaze pattern is present if a participant in an eye tracking study gains an overview of the stimulus, whereas a focal pattern emerges during a more detailed evaluation of a specific part of the stimulus. With this higher-level measure of global and focal gaze patterns, cognitive effort, expertise levels, and even neurological characteristics - such as autism - can be quantified. Furthermore, with this measure, cognitive efforts of students in certain tasks can be investigated and clues for targeted support can be provided. These properties in particular make this eye tracking measure valuable for the education domain. In the field of eye tracking research, many researchers have established distinct criteria for differentiating global and focal gaze patterns. Moreover, it is rarely quantitatively measured which of these patterns is present, but rather determined based on qualitative considerations. However, some studies explicitly use quantitative metrics like saccade-length or fixation-duration to distinguish between global and focal gaze patterns. This is the focus of the present systematic literature review: It searches for and compiles the eye tracking metrics used in the literature to distinguish global from focal gaze patterns in a quantitative way. In doing so, this study fills the yawning gap in quantitative metrics for determining global and focal gaze patterns. In the long run, this can be used to answer questions about cognitive load and problems in processing tasks during eye tracking studies and to provide further insights into the cognitive processes of students. The present paper first discusses definitions of global and focal gaze patterns and presents examples in which this metric has already been applied. Then, the research questions together with search strings and search engines used for the systematic literature review are described. Finally, the results are summarized, presenting a compilation of and connections between quantitative metrics utilized in the literature to distinguish between global and focal viewing patterns. KW - Eye tracking KW - cognitive load KW - expertise KW - global KW - focal KW - ambient KW - local KW - metrics Y1 - 2024 SN - 978-84-09-59215-9 U6 - https://doi.org/10.21125/inted.2024.0814 SN - 2340-1079 SP - 3005 EP - 3014 PB - IATED Academy ER -