Using Node-RED as a Low-Code Approach to Model Interaction Logic of Machine-Learning-Supported eHMIs for the Virtual Driving Simulator Carla

  • External Human-Machine Interfaces (eHMI) enable interaction between vehicles and Vulnerable Road Users (VRU), for example, to warn VRUs of the car’s presence. Warning systems should warn of the situation’s urgency, which can be achieved using Machine Learning (ML)-based VRU detection models. ML models and eHMI interaction concepts are usually developed by different teams and tested separately, often resulting in integration problems. This work contributes to a low-code approach to model interaction concepts involving ML models to enable end-to-end prototypes for early integration and User eXperience (UX) testing. We use flow-based modeling with Node-RED, the virtual driving simulator CARLA and YOLOv5 as state-of-the-art deep learning techniques for VRU detection. We show two scenarios (cornering lights and context-aware VRU warning) in an interactive demonstrator, meaning a manual live control of pedestrian and car. We consider our approach to model and evaluate interaction concepts without writing code feasible for non-computerExternal Human-Machine Interfaces (eHMI) enable interaction between vehicles and Vulnerable Road Users (VRU), for example, to warn VRUs of the car’s presence. Warning systems should warn of the situation’s urgency, which can be achieved using Machine Learning (ML)-based VRU detection models. ML models and eHMI interaction concepts are usually developed by different teams and tested separately, often resulting in integration problems. This work contributes to a low-code approach to model interaction concepts involving ML models to enable end-to-end prototypes for early integration and User eXperience (UX) testing. We use flow-based modeling with Node-RED, the virtual driving simulator CARLA and YOLOv5 as state-of-the-art deep learning techniques for VRU detection. We show two scenarios (cornering lights and context-aware VRU warning) in an interactive demonstrator, meaning a manual live control of pedestrian and car. We consider our approach to model and evaluate interaction concepts without writing code feasible for non-computer scientists.show moreshow less

Export metadata

Additional Services

Search Google Scholar
Metadaten
Author:Sven Winkelmann, Max Büttner, Dharani Deivasihamani,, Alexander von HoffmannORCiD, Fabian Flohr
DOI:https://doi.org/10.1145/3581961.3609844
Parent Title (English):AutomotiveUI '23 Adjunct: Adjunct Proceedings of the 15th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
Publisher:ACM
Document Type:conference proceeding (article)
Language:English
Date of first Publication:2023/09/18
Reviewed:Begutachtet/Reviewed
Release Date:2025/01/20
First Page:323
Last Page:326
institutes:Fakultät für Elektrotechnik Feinwerktechnik Informationstechnik
Ohm User Experience Center (Ohm-UX)
Research Themes:Mobilität, Verkehr, Logistik
Digitalisierung & Künstliche Intelligenz
Verstanden ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.