Refine
Year of publication
Document Type
- Article (37)
- Conference Proceeding (23)
- Book (2)
- Preprint (2)
- Part of a Book (1)
- Doctoral Thesis (1)
- Master's Thesis (1)
Language
- English (67) (remove)
Keywords
- Artificial Intelligence (3)
- DEAL (2)
- DFG Publikationskosten (2)
- DOAJ (2)
- HSD Publikationsfonds (2)
- Machine Learning (2)
- ADAS (1)
- AI performance metrics (1)
- Computer Vision (1)
- Computers and Society (1)
Department/institution
- Fachbereich - Elektro- & Informationstechnik (67) (remove)
We present a novel metric Spatial Recall Index to assess the performance of machine-learning (ML) algorithms for automotive applications, focusing on where in the image which performance occurs. Typical metrics like intersection-over-union (IoU), precisionrecallcurves or average precision (AP) quantify the performance over a whole database of images, neglecting spatial performance variations. But as the optics of camera systems are spatially variable over the field of view, the performance of ML-based algorithms is also a function of space, which we show in simulation: A realistic objective lens based on a Cooke-triplet that exhibits typical optical aberrations like astigmatism and chromatic aberration, all variable over field, is modeled. The model is then applied to a subset of the BDD100k dataset with spatially-varying kernels. We then quantify local changes in the performance of the pre-trained Mask R-CNN algorithm. Our examples demonstrate the spatial dependence of the performance of ML-based algorithms from the optical quality over field, highlighting the need to take the spatial dimension into account when training ML-based algorithms, especially when looking forward to autonomous driving applications.