Refine
Year of publication
Document Type
- Article (22)
- Conference Proceeding (9)
- Preprint (2)
- Diploma Thesis (1)
- Doctoral Thesis (1)
- Patent (1)
Keywords
- Artificial Intelligence (3)
- DEAL (2)
- DFG Publikationskosten (2)
- HSD Publikationsfonds (2)
- Machine Learning (2)
- ADAS (1)
- AI performance metrics (1)
- Computer Vision (1)
- Computers and Society (1)
- DOAJ (1)
Department/institution
Image restoration is a process used to remove blur (from different sources like object motion or aberrations) from images by either non-blind or blind-deconvolution. The metrics commonly used to quantify the restoration process are peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM). Often only a small sample of test images are used (like Lena or the camera guy). In optical design research PSNR and SSIM are not normally used, here image quality metrics based on linear system theory (e.g. modulation transfer function, MTF) are used to quantify optical errors like spherical or chromatic aberration. In this article we investigate how different image restoration algorithms can be quantified by applying image quality metrics. We start with synthetic image data that is used in camera test stands (e.g. Siemens star etc.), apply two different spatially variant degradation algorithms, and restore the original image by a direct method (Wiener filtering within sub-images), and by an iterative method (alternating direction method of multipliers, ADMM). Afterwards we compare the quality metrics (like MTF curves) for the original, the degraded and the restored image. As a first result we show that restoration algorithms sometimes fail in dealing with non-natural scenes, e.g. slanted-edge targets. Further, these first results indicate a correlation between degradation and restoration, i.e. the restoration algorithms are not capable of removing the optically relevant errors introduced by the degradation, a fact neither visible nor available from the PSNR values. We discuss the relevance in the context of the automotive industry, where image restoration may yield distinct advantages for camera-based applications, but testing methods rely on the used image quality metrics.
We present an experimental technique that allows the simultaneous spatial imaging and spectral analysis of falling droplets that exhibit lasing. Single droplet investigations serve as, among other purposes, a preliminary study for spray and combustion researchers. The described setup provides a valuable tool for the evaluation of microdroplet investigations with laser-spectroscopic techniques that rely on laser-induced fluorescence (LIF) or similar spectroscopical phenomena. The emphasis is that both spatial and spectral information are obtained from single-shot images of a falling droplet. Furthermore, combining spatial imaging and a spatially resolving optical multichannel analyzer makes a pointwise rastering of the droplets spectrum possible. This allows for the (almost) unambiguous determination of sources of influence on the spectrum of these droplets-such as geometrical distortion and lasing, nondissolved tracer lumps, and similar phenomena. Although the focus is on the experimental technique itself, we supplement detailed studies of lasing in falling microdroplets. These results were obtained with the aim of developing a system for measuring temperature distributions in droplets and sprays. In the light of these results the practice of calibrating a droplets spectrum by use of a bulk liquid sample needs to be critically reviewed.
Differentiable Compound Optics and Processing Pipeline Optimization for End-to-end Camera Design
(2021)
Most modern commodity imaging systems we use directly for photography‐-or indirectly rely on for downstream applications‐-employ optical systems of multiple lenses that must balance deviations from perfect optics, manufacturing constraints, tolerances, cost, and footprint. Although optical designs often have complex interactions with downstream image processing or analysis tasks, today’s compound optics are designed in isolation from these interactions. Existing optical design tools aim to minimize optical aberrations, such as deviations from Gauss’ linear model of optics, instead of application-specific losses, precluding joint optimization with hardware image signal processing (ISP) and highly parameterized neural network processing. In this article, we propose an optimization method for compound optics that lifts these limitations. We optimize entire lens systems jointly with hardware and software image processing pipelines, downstream neural network processing, and application-specific end-to-end losses. To this end, we propose a learned, differentiable forward model for compound optics and an alternating proximal optimization method that handles function compositions with highly varying parameter dimensions for optics, hardware ISP, and neural nets. Our method integrates seamlessly atop existing optical design tools, such as Zemax. We can thus assess our method across many camera system designs and end-to-end applications. We validate our approach in an automotive camera optics setting‐-together with hardware ISP post processing and detection‐-outperforming classical optics designs for automotive object detection and traffic light state detection. For human viewing tasks, we optimize optics and processing pipelines for dynamic outdoor scenarios and dynamic low-light imaging. We outperform existing compartmentalized design or fine-tuning methods qualitatively and quantitatively, across all domain-specific applications tested.