TY - CHAP A1 - Goldhammer, Michael A1 - Gerhard, Matthias A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Brunsmann, Ulrich T1 - Early Prediction of a Pedestrian's Trajectory at Intersections T2 - 16th International IEEE Conference on Intelligent Transportation Systems - (ITSC 2013), The Hague, The Netherlands KW - Fahrerassistenzsystem KW - Fußgänger Y1 - 2013 SN - 978-1-4799-2914-6 U6 - https://doi.org/10.1109/ITSC.2013.6728239 SP - 237 EP - 242 PB - IEEE ER - TY - CHAP A1 - Kreß, Viktor A1 - Jung, Janis A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Human Pose Estimation in Real Traffic Scenes T2 - 2018 IEEE Symposium Series on Computational Intelligence (SSCI) KW - Autonomes Fahrzeug KW - Fahrerassistenzsystem KW - Fußgänger KW - Radfahrer Y1 - 2018 U6 - https://doi.org/10.1109/SSCI.2018.8628660 SP - 518 EP - 523 PB - IEEE CY - Bangalore, India ER - TY - CHAP A1 - Zernetsch, Stefan A1 - Kreß, Viktor A1 - Sick, Bernhard A1 - Doll, Konrad T1 - Early Start Intention Detection of Cyclists Using Motion History Images and a Deep Residual Network T2 - 2018 IEEE Intelligent Vehicles Symposium (IV) N2 - In this article, we present a novel approach to detect starting motions of cyclists in real world traffic scenarios based on Motion History Images (MHIs). The method uses a deep Convolutional Neural Network (CNN) with a residual network architecture (ResNet), which is commonly used in image classification and detection tasks. By combining MHIs with a ResNet classifier and performing a frame by frame classification of the MHIs, we are able to detect starting motions in image sequences. The detection is performed using a wide angle stereo camera system at an urban intersection. We compare our algorithm to an existing method to detect movement transitions of pedestrians that uses MHIs in combination with a Histograms of Oriented Gradients (HOG) like descriptor and a Support Vector Machine (SVM), which we adapted to cyclists. To train and evaluate the methods a dataset containing MHIs of 394 cyclist starting motions was created. The results show that both methods can be used to detect starting motions of cyclists. Using the SVM approach, we were able to safely detect starting motions 0.506 s on average after the bicycle starts moving with an F 1 -score of 97.7%. The ResNet approach achieved an F 1- score of 100% at an average detection time of 0.144 s. The ResNet approach outperformed the SVM approach in both robustness against false positive detections and detection time. KW - Fahrerassistenzsystem KW - Radfahrer KW - Fußgänger Y1 - 2018 U6 - https://doi.org/10.1109/IVS.2018.8500428 PB - IEEE CY - Changshu, China ER - TY - CHAP A1 - Zernetsch, Stefan A1 - Reichert, Hannes A1 - Kreß, Viktor A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Trajectory Forecasts with Uncertainties of Vulnerable Road Users by Means of Neural Networks T2 - 2019 IEEE Intelligent Vehicles Symposium (IV) N2 - In this article, we present an approach to forecast trajectories of vulnerable road users (VRUs) including a numerical quantification of the uncertainty of the forecast. The uncertainty estimates are modeled as normal distributions by means of neural networks. Additionally, we present a method to evaluate the reliability of the forecasted uncertainty estimates, where we utilize quantile-quantile (Q-Q) plots, a graphical method to compare two distributions widely used in statistics. The positional accuracy is evaluated using Euclidean distances, in specific we use the average Euclidean error (AEE) and the average specific AEE (ASAEE). The model is trained and tested using a large dataset of 1311 cyclist trajectories, recorded at an urban intersection in real world traffic. Using this method, we achieve a similar positional accuracy compared to our previous work, where only positions are forecasted. The method is able to produce reliable uncertainty estimates for the motion types start, stop, turn left, and turn rightand produces underconfident uncertainty estimates for the motion types waitand move straight. Since uncertainties are not underestimated, the method can be used as a basis for trajectory planing in automated vehicles. KW - Fahrerassistenzsystem KW - Fahrrad KW - Autonomes Fahrzeug Y1 - 2019 U6 - https://doi.org/10.1109/IVS.2019.8814258 PB - IEEE CY - Paris, France ER - TY - JOUR A1 - Bieshaar, Maarten A1 - Zernetsch, Stefan A1 - Hubert, Andreas A1 - Sick, Bernhard A1 - Doll, Konrad T1 - Cooperative Starting Movement Detection of Cyclists Using Convolutional Neural Networks and a Boosted Stacking Ensemble JF - IEEE Transactions on Intelligent Vehicles N2 - In the future, vehicles and other traffic participants will be interconnected and equipped with various types of sensors, allowing for cooperation on different levels, such as situation prediction or intention detection. In this paper, we present a cooperative approach for starting movement detection of cyclists using a boosted stacking ensemble approach realizing feature- and decision-level cooperation. We introduce a novel method based on a three-dimensional convolutional neural network (CNN) to detect starting motions on image sequences by learning spatio-temporal features. The CNN is complemented by a smart device based starting movement detection originating from smart devices carried by the cyclist. Both model outputs are combined in a stacking ensemble approach using an extreme gradient boosting classifier resulting in a fast and yet robust cooperative starting movement detector. We evaluate our cooperative approach on real-world data originating from experiments with 49 test subjects consisting of 84 starting motions. KW - Fahrerassistenzsystem KW - Fahrrad KW - Sensortechnik Y1 - 2018 VL - 3 IS - 4 SP - 534 EP - 544 ER - TY - CHAP A1 - Eilbrecht, Jan A1 - Bieshaar, Maarten A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard A1 - Stursberg, Olaf T1 - Model-predictive planning for autonomous vehicles anticipating intentions of vulnerable road users by artificial neural networks T2 - 2017 IEEE Symposium Series on Computational Intelligence (SSCI) KW - Fahrerassistenzsystem KW - Fußgänger KW - Radfahrer KW - Autonomes Fahrzeug Y1 - 2017 U6 - https://doi.org/10.1109/SSCI.2017.8285249 SP - 1 EP - 8 PB - IEEE CY - Honolulu, HI, USA ER - TY - JOUR A1 - Goldhammer, Michael A1 - Köhler, Sebastian A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard A1 - Dietmayer, Klaus T1 - Intentions of Vulnerable Road Users – Detection and Forecasting by Means of Machine Learning JF - IEEE Transactions on Intelligent Transportation Systems KW - Fahrerassistenzsystem KW - Fußgänger KW - Radfahrer Y1 - 2019 UR - https://doi.org/10.1109/TITS.2019.2923319 U6 - https://doi.org/10.1109/TITS.2019.2923319 VL - 2020 IS - 21 / 7 SP - 3035 EP - 3045 ER - TY - CHAP A1 - Bieshaar, Maarten A1 - Zernetsch, Stefan A1 - Depping, Malte A1 - Sick, Bernhard A1 - Doll, Konrad T1 - Cooperative Starting Intention Detection of Cyclists based on Smart Devices and Infrastructure T2 - 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC) KW - Fahrerassistenzsystem KW - Radfahrer Y1 - 2017 U6 - https://doi.org/10.1109/ITSC.2017.8317691 SP - 1 EP - 8 PB - IEEE CY - Yokohama, Japan ER - TY - CHAP A1 - Bieshaar, Maarten A1 - Reitberger, Günther A1 - Kreß, Viktor A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Fuchs, Erich A1 - Sick, Bernhard T1 - Highly Automated Learning for Improved Active Safety of Vulnerable Road Users T2 - ACM Chapters Computer Science in Cars Symposium (CSCS-17) KW - Fahrerassistenzsystem Y1 - 2017 VL - 2017 CY - München ER - TY - CHAP A1 - Kress, Viktor A1 - Schreck, Steven A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Pose Based Action Recognition of Vulnerable Road Users Using Recurrent Neural Networks T2 - 2020 IEEE Symposium Series on Computational Intelligence (SSCI) N2 - This work investigates the use of knowledge about three dimensional (3D) poses and Recurrent Neural Networks (RNNs) for detection of basic movements, such as wait, start, move, stop, turn left, turn right, and no turn, of pedestrians and cyclists in road traffic. The 3D poses model the posture of individual body parts of these vulnerable road users (VRUs). Fields of application for this technology are, for example, driver assistance systems or autonomous driving functions of vehicles. In road traffic, VRUs are often occluded and only become visible in the immediate vicinity of the vehicle. Hence, our proposed approach is able to classify basic movements after different and especially short observation periods. The classification will then be successively improved in case of a longer observation. This allows countermeasures, such as emergency braking, to be initiated early if necessary. The benefits of using 3D poses are evaluated by a comparison with a method based solely on the head trajectory. We also investigate the effects of different observation periods. Overall, knowledge about 3D poses improves the basic movement detection, in particular for short observation periods. The greatest improvements are achieved for the basic movements start, stop, turn left, and turn right. KW - Fahrerassistenzsystem KW - Autonomes Fahrzeug KW - Fußgänger KW - Fahrrad Y1 - 2020 SN - 978-1-7281-2548-0 U6 - https://doi.org/10.1109/SSCI47803.2020.9308462 SP - 2723 EP - 2730 PB - IEEE CY - Canberra, Australia ER - TY - CHAP A1 - Zernetsch, Stefan A1 - Schreck, Steven A1 - Kress, Viktor A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Image Sequence Based Cyclist Action Recognition Using Multi-Stream 3D Convolution T2 - 2020 25th International Conference on Pattern Recognition (ICPR) N2 - In this article, we present an approach to detect basic movements of cyclists in real world traffic situations based on image sequences, optical flow (OF) sequences, and past positions using a multi-stream 3D convolutional neural network (3D-ConvNet) architecture. To resolve occlusions of cyclists by other traffic participants or road structures, we use a wide angle stereo camera system mounted at a heavily frequented public intersection. We created a large dataset consisting of 1,639 video sequences containing cyclists, recorded in real world traffic, resulting in over 1.1 million samples. Through modeling the cyclists' behavior by a state machine of basic cyclist movements, our approach takes every situation into account and is not limited to certain scenarios. We compare our method to an approach solely based on position sequences. Both methods are evaluated taking into account frame wise and scene wise classification results of basic movements, and detection times of basic movement transitions, where our approach outperforms the position based approach by producing more reliable detections with shorter detection times. Our code and parts of our dataset are made publicly available. KW - Fahrerassistenzsystem KW - Radfahrer Y1 - 2020 UR - https://ieeexplore.ieee.org/document/9413233 ER - TY - CHAP A1 - Kreß, Viktor A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Pose Based Trajectory Forecast of Vulnerable Road Users Using Recurrent Neural Networks T2 - ICPR 2021: Pattern Recognition. ICPR International Workshops and Challenges N2 - In this work, we use Recurrent Neural Networks (RNNs) in form of Gated Recurrent Unit (GRU) networks to forecast trajectories of vulnerable road users (VRUs), such as pedestrians and cyclists, in road traffic utilizing the past trajectory and 3D poses as input. The 3D poses represent the postures and movements of limbs and torso and contain early indicators for the transition between motion types, e.g. wait, start, move, and stop. VRUs often only become visible from the perspective of an approaching vehicle shortly before dangerous situations occur. Therefore, a network architecture is required which is able to forecast trajectories after short time periods and is able to improve the forecasts in case of longer observations. This motivates us to use GRU networks, which are able to use time series of varying duration as inputs, and to investigate the effects of different observation periods on the forecasting results. Our approach is able to make reasonable forecasts even for short observation periods. The use of poses improves the forecasting accuracy, especially for short observation periods compared to a solely head trajectory based approach. Different motion types benefit to different extent from the use of poses and longer observation periods. KW - 3D human trajectory forecast KW - Vulnerable road users KW - 3D body pose KW - Fahrerassistenzsystem KW - Fußgänger KW - Radfahrer Y1 - 2020 SN - 978-3-030-68763-2 U6 - https://doi.org/https://doi.org/10.1007/978-3-030-68763-2_5 SP - 57 EP - 71 PB - Springer International Publishing CY - Cham ER - TY - GEN A1 - Doll, Konrad A1 - Köhler, Sebastian A1 - Goldhammer, Michael A1 - Brunsmann, Ulrich T1 - Pedestrian Movement Modelling and Trajectory Prediction at Urban Intersections T2 - International IEEE Conference on Intelligent Transportation Systems (ITSC 2015) N2 - Vortrag KW - Fahrerassistenzsystem KW - Fußgänger Y1 - 2015 CY - Las Palmas de Gran Canaria, Spain ER - TY - CHAP A1 - Hubert, Andreas A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Cyclists starting behavior at intersections T2 - 2017 IEEE Intelligent Vehicles Symposium (IV) KW - Fahrerassistenzsystem KW - Radfahrer Y1 - 2017 U6 - https://doi.org/10.1109/IVS.2017.7995856 SP - 1071 EP - 1077 PB - IEEE CY - Los Angeles, CA, USA ER - TY - JOUR A1 - Kröhn, Michael A1 - Reuter, Norbert A1 - Hahnle, Michael A1 - Prochus, Tobias A1 - Doll, Konrad T1 - Gestengesteuerte Prozessanalyse JF - atp edition - Automatisierungstechnische Praxis KW - Prozessanalyse Y1 - 2016 VL - 58 IS - 12 SP - 26 EP - 33 ER - TY - CHAP A1 - Zernetsch, Stefan A1 - Reichert, Hannes A1 - Kress, Viktor A1 - Doll, Konrad A1 - Sick, Bernhard T1 - A Holistic View on Probabilistic Trajectory Forecasting – Case Study. Cyclist Intention Detection T2 - 2022 IEEE Intelligent Vehicles Symposium (IV) KW - Autonomes Fahrzeug KW - Radfahrer Y1 - 2022 U6 - https://doi.org/https://doi.org/10.1109/IV51971.2022.9827220 SP - 265 EP - 272 PB - IEEE ER - TY - CHAP A1 - Bieshaar, Maarten A1 - Zernetsch, Stefan A1 - Riepe, Katharina A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Cyclist Motion State Forecasting - Going beyond Detection T2 - 2021 IEEE Symposium Series on Computational Intelligence (SSCI) KW - Autonomes Fahrzeug KW - Radfahrer Y1 - 2021 U6 - https://doi.org/10.1109/SSCI50451.2021.9660151 SP - 1 EP - 8 PB - IEEE ER - TY - CHAP A1 - Schneegans, Jan A1 - Eilbrecht, Jan A1 - Zernetsch, Stefan A1 - Bieshaar, Maarten A1 - Doll, Konrad A1 - Stursberg, Olaf A1 - Sick, Bernhard T1 - Probabilistic VRU Trajectory Forecasting for Model-Predictive Planning A Case Study: Overtaking Cyclists T2 - 2021 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops) KW - Fahrerassistenzsystem KW - Radfahrer KW - Autonomes Fahrzeug Y1 - 2021 U6 - https://doi.org/10.1109/IVWorkshops54471.2021.9669208 SP - 272 EP - 279 PB - IEEE ER - TY - JOUR A1 - Kress, Viktor A1 - Jeske, Fabian A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Pose and Semantic Map Based Probabilistic Forecast of Vulnerable Road Users’ Trajectories JF - IEEE Transactions on Intelligent Vehicles KW - Fahrerassistenzsystem KW - Autonomes Fahrzeug Y1 - 2023 U6 - https://doi.org/10.1109/TIV.2022.3149624 SN - 2379-8904 VL - 8 IS - 3 SP - 2592 EP - 2603 PB - Institute of Electrical and Electronics Engineers (IEEE) ER - TY - CHAP A1 - Zernetsch, Stefan A1 - Trupp, Oliver A1 - Kress, Viktor A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Cyclist Trajectory Forecasts by Incorporation of Multi-View Video Information T2 - 2021 IEEE International Smart Cities Conference (ISC2) KW - Autonomes Fahrzeug KW - Radfahrer Y1 - 2021 U6 - https://doi.org/10.1109/ISC253183.2021.9562857 SP - 1 EP - 7 PB - IEEE ER - TY - CHAP A1 - Jung, Janis A1 - Hubert, Andreas A1 - Doll, Konrad A1 - Kröhn, Michael A1 - Stadler, Jochen T1 - Prozessinnovation T2 - Wissenstransfer im Spannungsfeld von Autonomisierung und Fachkräftemangel, Tagungsband, 18. AALE-Konferenz, Pforzheim, 09.03.-11.03.2022 N2 - Manuelle Montageprozesse sind nach wie vor unverzichtbar in vielen Bereichen der produzierenden Industrie. Vor allem die Qualitätskontrolle, sowie das Einlernen neuer Mitarbeitenden stellen Betriebe durch die voranschreitende Digitalisierung vor neue Herausforderungen. Assistenzsysteme können hier helfen, die Lücke zwischen Anforderungen und Qualifikation zu überbrücken. Wir stellen einen Ansatz zur intelligenten Assistenz vor, welcher auf einer kamerabasierten Erkennung von Arbeitsabläufen mit Hilfe von Methoden des maschinellen Lernens beruht. Das Assistenzsystem erzeugt automatisiert Hilfsmaterial zur Unterstützung der Werkenden. Zusätzlich zur Darstellung der technischen Aspekte, werden psychologische Aspekte, wie Akzeptanz und Motivation untersucht. KW - Assistenzsystem KW - Montage KW - Maschinelles Lernen Y1 - 2022 U6 - https://doi.org/10.33968/2022.20 PB - Hochschule für Technik, Wirtschaft und Kultur Leipzig ER - TY - CHAP A1 - Serfling, Benjamin A1 - Reichert, Hannes A1 - Bayerlein, Lorenzo A1 - Doll, Konrad A1 - Radkhah-Lens, Kati T1 - LiDAR Based Semantic Perception for Forklifts in Outdoor Environments T2 - 2025 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI) KW - Gabelstapler KW - Autonomes Fahrzeug Y1 - 2025 U6 - https://doi.org/https://doi.org/10.1109/SOLI66289.2025.11396313 SP - 40 EP - 45 PB - IEEE ER - TY - CHAP A1 - Hubert, Andreas A1 - Guo, Chenxi A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Improving Fast 6D Pose Estimation with Adaptive Model Fusion T2 - 2025 5th International Conference on Machine Learning and Intelligent Systems Engineering (MLISE) KW - Maschinelles Lernen KW - Deep Learning KW - Montagezelle Y1 - 2025 U6 - https://doi.org/https://doi.org/10.1109/MLISE66443.2025.11100239 SP - 58 EP - 63 PB - IEEE ER - TY - CHAP A1 - Hubert, Andreas A1 - Guo, C. A1 - Doll, Konrad A1 - Kuhn, F. A1 - Kröhn, M. T1 - Multimodales hochautomatisiert lernendes Assistenzsystem für manuelle Montageprozesse T2 - Automation 2025 KW - Maschinelles Lernen KW - Künstliche Intelligenz KW - Montage Y1 - 2025 SN - 9783181024577 U6 - https://doi.org/https://doi.org/10.51202/9783181024577-575 SP - 575 EP - 590 PB - VDI Verlag ER -