TY - CHAP A1 - Reichert, Hannes A1 - Hetzel, Manuel A1 - Schreck, Steven A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Sensor Equivariance by LiDAR Projection Images T2 - 2023 IEEE Intelligent Vehicles Symposium (IV) KW - Bildverarbeitung KW - Sensor Y1 - 2023 U6 - https://doi.org/https://doi.org/10.1109/IV55152.2023.10186817 SP - 1 EP - 6 PB - IEEE ER - TY - CHAP A1 - Hubert, Andreas A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Influence of Background Color on 6D Pose Tracking Accuracy T2 - 2024 International Conference on Engineering and Emerging Technologies (ICEET), 27-28 December 2024 KW - Maschinelles Lernen KW - Deep Learning Y1 - 2024 U6 - https://doi.org/10.1109/ICEET65156.2024.10913824 SP - 1 EP - 6 PB - IEEE ER - TY - CHAP A1 - Hetzel, Manuel A1 - Reichert, Hannes A1 - Reitberger, Günther A1 - Fuchs, Erich A1 - Doll, Konrad A1 - Sick, Bernhard T1 - The IMPTC Dataset: An Infrastructural Multi-Person Trajectory and Context Dataset T2 - 2023 IEEE Intelligent Vehicles Symposium (IV) KW - Autonomes Fahrzeug KW - Sensortechnik Y1 - 2023 U6 - https://doi.org/https://doi.org/10.1109/IV55152.2023.10186776 SP - 1 EP - 7 PB - IEEE ER - TY - CHAP A1 - Hetzel, Manuel A1 - Reichert, Hannes A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Reliable Probabilistic Human Trajectory Prediction for Autonomous Applications T2 - Computer Vision – ECCV 2024 Workshops, Milan, Italy, September 29–October 4, 2024, Proceedings, Part XVII KW - Autonomes System KW - Mensch-Maschine-Kommunikation Y1 - 2025 SN - 9783031915840 U6 - https://doi.org/https://doi.org/10.1007/978-3-031-91585-7_9 SN - 0302-9743 SP - 135 EP - 152 PB - Springer Nature CY - Cham ER - TY - CHAP A1 - Hetzel, Manuel A1 - Reichert, Hannes A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Smart Infrastructure: A Research Junction T2 - 2021 IEEE International Smart Cities Conference (ISC2) KW - Autonomes Fahrzeug KW - Kreuzung Y1 - 2021 U6 - https://doi.org/https://doi.org/10.1109/ISC253183.2021.9562809 SP - 1 EP - 4 PB - IEEE ER - TY - CHAP A1 - Goldhammer, Michael A1 - Köhler, Sebastian A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Track-Based Forecasting of Pedestrian Behavior by Polynomial Approximation and Multilayer Perceptrons T2 - Intelligent Systems and Applications - Extended and Selected Results from the SAI Intelligent Systems Conference (IntelliSys) 2015 N2 - We present an approach for predicting continuous pedestrian trajectories over a time horizon of 2.5 s by means of polynomial least squares approximation and multilayer perceptron (MLP) artificial neural networks. The training data are gathered from 1075 real urban traffic scenes with uninstructed pedestrians including starting, stopping, walking and bending in. The polynomial approximation provides an extraction of the principal information of the underlying time series in the form of the polynomial coefficients. It is independent of sensor parameters such as cycle time and robust regarding noise. Approximation and prediction can be performed very efficiently. It only takes 35 ms on an Intel Core i7 CPU. Test results show 28% lower prediction errors for starting scenes and 32% for stopping scenes in comparison to applying a constant velocity movement model. Approaches based on MLP without polynomial input or Support Vector Regression (SVR) models as motion predictor are outperformed as well. KW - Fußgänger KW - Verkehrsverhalten KW - Prognose Y1 - 2016 SN - 978-3-319-33386-1 SP - 259 EP - 279 PB - Springer International Publishing ER - TY - CHAP A1 - Kreß, Viktor A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Pose Based Trajectory Forecast of Vulnerable Road Users T2 - IEEE Symposium Series on Computational Intelligence (SSCI) N2 - In this article, we investigate the use of 3D human poses for trajectory forecasting of vulnerable road users (VRUs), such as pedestrians and cyclists, in road traffic. The forecast is based on past movements of the respective VRU and an important aspect in driver assistance systems and autonomous driving, which both could increase VRU safety. The 3D poses represent the entire body posture of the VRUs and can therefore provide important indicators for trajectory forecasting. In particular, we investigate the influence of different joint combinations and input sequence lengths of past movements on the accuracy of trajectory forecasts for pedestrians and cyclists. In addition, we divide VRU movements into the motion types wait, start, move, and stop and evaluate the results separately for each of them. Comparing it to an existing, solely head based trajectory forecast, we show the advantages of using 3D poses. With an input sequence length of 1.0 s, the forecasting error is reduced by 17.9 % for starting, 8.18 % for moving, and 11.0 % for stopping cyclists. For pedestrians, the error is reduced by 6.93 %, 2.73 %, and 5.02 %, respectively. With shorter input sequences, the improvements over the solely head based method remain for cyclists and even increase for pedestrians. KW - Fahrerassistenzsystem KW - Fußgänger KW - Radfahrer Y1 - 2019 U6 - https://doi.org/10.1109/SSCI44817.2019.9003023 VL - 2019 SP - 1200 EP - 1207 PB - IEEE CY - Xiamen, China ER - TY - CHAP A1 - Goldhammer, Michael A1 - Hubert, Andreas A1 - Köhler, Sebastian A1 - Zindler, Klaus A1 - Brunsmann, Ulrich A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Analysis on Termination of Pedestrians‘ Gait at Urban Intersections T2 - Intelligent Transportation Systems (ITSC), 2014 IEEE 17th International Conference on KW - Fahrerassistenzsystem KW - Fußgänger Y1 - 2014 U6 - https://doi.org/10.1109/ITSC.2014.6957947 SP - 1758 EP - 1763 PB - IEEE CY - Qingdao, China ER - TY - CHAP A1 - Goldhammer, Michael A1 - Doll, Konrad A1 - Brunsmann, Ulrich A1 - Gensler, Andre A1 - Sick, Bernhard T1 - Pedestrian's Trajectory Forecast in Public Traffic with Artificial Neural Networks T2 - 22nd International Conference on Pattern Recognition (ICPR 2014), Stockholm, Sweden KW - Fahrerassistenzsystem KW - Fußgänger Y1 - 2014 SN - 978-1-4799-5208-3 U6 - https://doi.org/10.1109/ICPR.2014.704 SN - 1051-4651 SP - 4110 EP - 4115 PB - IEEE ER - TY - CHAP A1 - Goldhammer, Michael A1 - Köhler, Sebastian A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Camera Based Pedestrian Path Prediction by Means of Polynomial Least-squares Approximation and Multilayer Perceptron Neural Networks T2 - SAI Intelligent Systems Conference (IntelliSys), 2015 N2 - This paper provides a method to forecast pedestrian trajectories by means of polynomial least-squares approximation and multilayer perceptron artificial neural networks for traffic safety applications. The approach uses camera based head tracking as input data to predict a continuous trajectory for a 2.5 s future time horizon. Training and test is performed using 1075 recorded tracks of uninstructed pedestrians in common public traffic situations, including many challenging scenarios like starting, stopping and bending in. The neural network approach has the ability to handle these scenes by learning a single implicit movement model independent of a specific motion type. The polynomial approximation provides an extraction of the principal information of the underlying time series in the form of the polynomial coefficients, high independence of input data, e.g., sample rate, and additional noise resistance. Our test results show 24% lower prediction errors for starting scenes and 29% for stopping scenes in comparison to a constant velocity Kalman filter. Approaches using MLP without polynomial input and the usage of Support Vector KW - Artificial Neural Networks KW - Polynomial Approximation KW - Path Prediction KW - Intelligent Vehicles KW - Neuronales Netz KW - Polynomapproximation Y1 - 2015 U6 - https://doi.org/10.1109/IntelliSys.2015.7361171 SP - 390 EP - 399 PB - IEEE ER - TY - CHAP A1 - Reichert, Hannes A1 - Lang, Lukas A1 - Rosch, Kevin A1 - Bogdoll, Daniel A1 - Doll, Konrad A1 - Sick, Bernhard A1 - Rellss, Hans-Christian A1 - Stiller, Christoph A1 - Zollner, J. Marius T1 - Towards Sensor Data Abstraction of Autonomous Vehicle Perception Systems T2 - 2021 IEEE International Smart Cities Conference (ISC2) KW - Autonomes Fahrzeug Y1 - 2021 U6 - https://doi.org/https://doi.org/10.1109/ISC253183.2021.9562912 SP - 1 EP - 4 PB - IEEE ER - TY - CHAP A1 - Schreck, Steven A1 - Reichert, Hannes A1 - Hetzel, Manuel A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Height Change Feature Based Free Space Detection T2 - 2023 11th International Conference on Control, Mechatronics and Automation (ICCMA) KW - Gabelstapler KW - Autonomes Fahrzeug Y1 - 2023 U6 - https://doi.org/https://doi.org/10.1109/ICCMA59762.2023.10374705 SP - 171 EP - 176 PB - IEEE ER - TY - CHAP A1 - Reichert, Hannes A1 - Hetzel, Manuel A1 - Hubert, Andreas A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Sensor Equivariance: A Framework for Semantic Segmentation with Diverse Camera Models T2 - 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) KW - Bildverarbeitung KW - Sensor Y1 - 2024 U6 - https://doi.org/https://doi.org/10.1109/CVPRW63382.2024.00132 SP - 1254 EP - 1261 PB - IEEE ER - TY - CHAP A1 - Bieshaar, Maarten A1 - Reitberger, Günther A1 - Zernetsch, Stefan A1 - Sick, Bernhard A1 - Fuchs, Erich A1 - Doll, Konrad T1 - Detecting intentions of vulnerable road users based on collective intelligence T2 - AAET – Automatisiertes und vernetztes Fahren N2 - Vulnerable road users (VRUs, i.e. cyclists and pedestrians) will play an important role in future traffic. To avoid accidents and achieve a highly efficient traffic flow, it is important to detect VRUs and to predict their intentions. In this article a holistic approach for detecting intentions of VRUs by cooperative methods is presented. The intention detection consists of basic movement primitive prediction, e.g. standing, moving, turning, and a forecast of the future trajectory. Vehicles equipped with sensors, data processing systems and communication abilities, referred to as intelligent vehicles, acquire and maintain a local model of their surrounding traffic environment, e.g. crossing cyclists. Heterogeneous, open sets of agents (cooperating and interacting vehicles, infrastructure, e.g. cameras and laser scanners, and VRUs equipped with smart devices and body-worn sensors) exchange information forming a multi-modal sensor system with the goal to reliably and robustly detect VRUs and their intentions under consideration of real time requirements and uncertainties. The resulting model allows to extend the perceptual horizon of the individual agent beyond their own sensory capabilities, enabling a longer forecast horizon. Concealments, implausibilities and inconsistencies are resolved by the collective intelligence of cooperating agents. Novel techniques of signal processing and modelling in combination with analytical and learning based approaches of pattern and activity recognition are used for detection, as well as intention prediction of VRUs. Cooperation, by means of probabilistic sensor and knowledge fusion, takes place on the level of perception and intention recognition. Based on the requirements of the cooperative approach for the communication a new strategy for an ad hoc network is proposed. The evaluation is done using real data gathered with a research vehicle, a research intersection with public traffic and mobile devices. KW - Verkehrsverhalten Y1 - 2017 SP - 67 EP - 87 ER - TY - CHAP A1 - Kreß, Viktor A1 - Jung, Janis A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Pose Based Start Intention Detection of Cyclists N2 - In this work, we present a new approach for start intention detection of cyclists based on 3D human pose estimation to increase their safety in road traffic. Start intention detection is realized using sequences of frame-wise estimated 3D poses. The poses were obtained by image sequences recorded by a stereo camera mounted behind the windshield of a moving vehicle. For training and evaluation, a dataset with 206 starting cyclists was created in real traffic. We demonstrate the advantages of this approach by comparing it to an existing, solely head trajectory based method. In particular, we investigate the performance for different observed time horizons ranging from 0.12 s up to 1.0 s as inputs for the two methods. This is of special importance for the protection of cyclists in road traffic, as they often only become visible to approaching vehicles shortly before dangerous situations occur. With an input length of 1.0 s the solely head trajectory based approach detects starting motions on average 0.834 s after the first motion of the bicycle with an F1-score of 97.5 %. The pose based approach outperforms these results by achieving the same F1-score 0.135 s earlier. The advantages of the pose based method become even more obvious with shorter input lengths. With an input length of 0.12 s, the head based approach achieves an F1-score of 93.5 % after 2.37 s, while the same score is reached after 0.668 s using poses. KW - Fahrerassistenzsystem KW - Fahrrad Y1 - 2019 U6 - https://doi.org/10.1109/ITSC.2019.8917215 SP - 2381 EP - 2386 PB - IEEE CY - Auckland ER - TY - CHAP A1 - Kreß, Viktor A1 - Jung, Janis A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard ED - Draude, Claude ED - Lange, Martin ED - Sick, Bernhard T1 - Start Intention Detection of Cyclists using an LSTM Network T2 - INFORMATIK 2019: 50 Jahre Gesellschaft für Informatik – Informatik für Gesellschaft (Workshop-Beiträge) N2 - In this article, we present an approach for start intention detection of cyclists based on their head trajectories. Therefore, we are using a network architecture based on Long Short-Term Memory (LSTM) cells, which is able to handle input sequences of different lengths. This is important because, for example, due to occlusions, cyclists often only become visible to approaching vehicles shortly before dangerous situations occur. Hence, the dependency of the results on the input sequence length is investigated. We use a dataset with 206 situations where cyclists were transitioning from waiting to moving that was recorded from a moving vehicle in inner-city traffic.With an input sequence length of 1.0 s we achieve an F1-score of 96.2% on average 0.680 s after the first movement of the bicycle. We obtain similar results for sequence lengths down to 0.2 s. For shorter sequences, the results regarding the F1-score and the mean detection time deteriorate considerably. KW - Fahrerassistenzsystem KW - Fahrrad Y1 - 2019 SN - 978-3-88579-689-3 U6 - https://doi.org/10.18420/inf2019_ws25 SN - 1617-5468 SP - 219 EP - 228 PB - Gesellschaft für Informatik e.V. CY - Bonn ER - TY - CHAP A1 - Reitberger, Günther A1 - Bieshaar, Maarten A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard A1 - Fuchs, Erich T1 - Cooperative Tracking of Cyclists Based on Smart Devices and Infrastructure T2 - 21st International Conference on Intelligent Transportation Systems (ITSC) 2018 N2 - In future traffic scenarios, vehicles and other traffic participants will be interconnected and equipped with various types of sensors, allowing for cooperation based on data or information exchange. This article presents an approach to cooperative tracking of cyclists using smart devices and infrastructure-based sensors. A smart device is carried by the cyclists and an intersection is equipped with a wide angle stereo camera system. Two tracking models are presented and compared. The first model is based on the stereo camera system detections only, whereas the second model cooperatively combines the camera based detections with velocity and yaw rate data provided by the smart device. Our aim is to overcome limitations of tracking approaches based on single data sources. We show in numerical evaluations on scenes where cyclists are starting or turning right that the cooperation leads to an improvement in both the ability to keep track of a cyclist and the accuracy of the track particularly when it comes to occlusions in the visual system. We, therefore, contribute to the safety of vulnerable road users in future traffic. KW - Fahrerassistenzsystem KW - Fahrrad KW - Sensortechnik Y1 - 2018 U6 - https://doi.org/10.1109/ITSC.2018.8569267 PB - IEEE CY - Maui, HI, USA ER - TY - CHAP A1 - Zernetsch, Stefan A1 - Kohnen, Sascha A1 - Goldhammer, Michael A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Trajectory prediction of cyclists using a physical model and an artificial neural network T2 - Intelligent Vehicles Symposium (IV), 2016 N2 - This article presents two methods for predicting the trajectories of cyclists at an intersection and compares them to a Kalman Filter (KF) approach. The first method uses a physical model of cyclists to predict their future position. The second method is based on a polynomial least-squares approximation in combination with a multilayer perceptron artificial neural network and is able to predict the future position of cyclists independent of their motion type such as “Starting”, “Stopping”, “Waiting” or “Passing”. To evaluate the performance of the methods, 566 tracks (394 for training, 172 for testing) of uninstructed cyclists were recorded at a public intersection using a wide angle stereo camera system and laser scanners. Using the tracks as input data, the future trajectory was predicted for a time horizon of 2.5 s. For starting motions the prediction using the physical model leads to 27% more accurate positions than the KF approach for a forecast horizon of 2.5 s. The neural network shows a 34% more accurate result for starting and stopping motions and a similar result for waiting and passing motions. KW - Kalman-Filter KW - Prognose Y1 - 2016 U6 - https://doi.org/10.1109/IVS.2016.7535484 SP - 833 EP - 838 ER - TY - CHAP A1 - Kreß, Viktor A1 - Jung, Janis A1 - Zernetsch, Stefan A1 - Doll, Konrad A1 - Sick, Bernhard T1 - Human Pose Estimation in Real Traffic Scenes T2 - 2018 IEEE Symposium Series on Computational Intelligence (SSCI) KW - Autonomes Fahrzeug KW - Fahrerassistenzsystem KW - Fußgänger KW - Radfahrer Y1 - 2018 U6 - https://doi.org/10.1109/SSCI.2018.8628660 SP - 518 EP - 523 PB - IEEE CY - Bangalore, India ER - TY - CHAP A1 - Zernetsch, Stefan A1 - Kreß, Viktor A1 - Sick, Bernhard A1 - Doll, Konrad T1 - Early Start Intention Detection of Cyclists Using Motion History Images and a Deep Residual Network T2 - 2018 IEEE Intelligent Vehicles Symposium (IV) N2 - In this article, we present a novel approach to detect starting motions of cyclists in real world traffic scenarios based on Motion History Images (MHIs). The method uses a deep Convolutional Neural Network (CNN) with a residual network architecture (ResNet), which is commonly used in image classification and detection tasks. By combining MHIs with a ResNet classifier and performing a frame by frame classification of the MHIs, we are able to detect starting motions in image sequences. The detection is performed using a wide angle stereo camera system at an urban intersection. We compare our algorithm to an existing method to detect movement transitions of pedestrians that uses MHIs in combination with a Histograms of Oriented Gradients (HOG) like descriptor and a Support Vector Machine (SVM), which we adapted to cyclists. To train and evaluate the methods a dataset containing MHIs of 394 cyclist starting motions was created. The results show that both methods can be used to detect starting motions of cyclists. Using the SVM approach, we were able to safely detect starting motions 0.506 s on average after the bicycle starts moving with an F 1 -score of 97.7%. The ResNet approach achieved an F 1- score of 100% at an average detection time of 0.144 s. The ResNet approach outperformed the SVM approach in both robustness against false positive detections and detection time. KW - Fahrerassistenzsystem KW - Radfahrer KW - Fußgänger Y1 - 2018 U6 - https://doi.org/10.1109/IVS.2018.8500428 PB - IEEE CY - Changshu, China ER -