• search hit 13 of 51
Back to Result List

Deep Learning-Based Multi-scale Multi-object Detection and Classification for Autonomous Driving

  • Autonomous driving vehicles need to perceive their immediate environment in order to detect other traffic participants such as vehicles or pedestrians. Vision based functionality using camera images have been widely investigated because of the low sensor price and the detailed information they provide. Conventional computer vision techniques are based on hand-engineered features. Due to the very complex environmental conditions this limited feature representations fail to uniquely identify a specific object. Thanks to the rapid development of processing power (especially GPUs), advanced software frameworks and the availability of large image datasets, Convolutional Neural Networks (CNN) have distinguished themselves by scoring the best on populthis information, the boundingar object detection benchmarks in the research community. Using deep architectures of CNN with many layers, they are able to extract both low-level and high-level features from images by skipping the feature design procedures of conventional computer visionAutonomous driving vehicles need to perceive their immediate environment in order to detect other traffic participants such as vehicles or pedestrians. Vision based functionality using camera images have been widely investigated because of the low sensor price and the detailed information they provide. Conventional computer vision techniques are based on hand-engineered features. Due to the very complex environmental conditions this limited feature representations fail to uniquely identify a specific object. Thanks to the rapid development of processing power (especially GPUs), advanced software frameworks and the availability of large image datasets, Convolutional Neural Networks (CNN) have distinguished themselves by scoring the best on populthis information, the boundingar object detection benchmarks in the research community. Using deep architectures of CNN with many layers, they are able to extract both low-level and high-level features from images by skipping the feature design procedures of conventional computer vision approaches. In this work, an end-to-end learning pipeline for multi-object detection based on one existing CNN architecture, namely Single Shot MultiBox Detector (SSD) [1], with real-time capability, is first reviewed. The SSD detector predicts the object’s position based on feature maps of different resolution together with a default set of bounding boxes. Using the SSD architecture as a starting point, this work focuses on training a single CNN to achieve high detection accuracy for vehicles and pedestrians computed in real time. Since vehicles and pedestrians have different sizes, shapes and poses, independent NNs are normally trained to perform the two detection tasks. It is thus very challenging to train one NN to learn the multi-scale detection ability. The contribution of this work can be summarized as follows: A detailed investigation on different public datasets (e.g., KITTI [2], Caltech [3] and Udacity [4] datasets). The datasets provide annotated images from real world traffic scenarios containing objects of vehicles and pedestrians. A data augmentation and weighting scheme is proposed to tackle the problem of class imbalance in the datasets to enable the training for both classes in a balanced manner. Specific default bounding box design for small objects and further data augmentation techniques to balance the number of objects in different scales. Extended SSD+ and SSD2 architectures are proposed in order to improve the detection performance and keeping the computational requirements low.show moreshow less

Export metadata

Additional Services

Search Google Scholar
Metadaten
Author:Maximilian Fink, Ying Liu, Armin Engstle, Stefan-Alexander SchneiderORCiDGND
DOI:https://doi.org/10.1007/978-3-658-23751-6_20
Identifier:978-3-658-23750-9 OPAC HS OPAC extern
Parent Title (Multiple languages):Fahrerassistenzsysteme 2018
Subtitle (Multiple languages):Von der Assistenz zum automatisierten Fahren 4. Internationale ATZ-Fachtagung Automatisiertes Fahren
Publisher:Springer
Document Type:conference proceeding (article)
Conference:Von der Assistenz zum automatisierten Fahren 4. Internationale ATZ-Fachtagung Automatisiertes Fahren
Language:English
Year of first Publication:2019
Number of pages:10 Seiten
First Page:233
Last Page:242
Institutes:Fakultät Elektrotechnik
Research focus:FSP2: Mobilität
Publication Lists:Schneider, Stefan-Alexander
Publication reviewed:begutachtet
Release Date:2021/02/16
Verstanden ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.