Filtern
Dokumenttyp
- Beitrag zu einem Tagungsband (6)
- Vortrag (5)
- Posterpräsentation (5)
- Sonstiges (3)
Referierte Publikation
- nein (19) (entfernen)
Schlagworte
- Super resolution (13)
- Laser thermography (11)
- 1d laser (6)
- High-power laser (6)
- Joint sparsity (6)
- Laser array (6)
- VCSEL array (6)
- Virtual wave (6)
- Nondestructive testing (5)
- Thermography (4)
Organisationseinheit der BAM
Eingeladener Vortrag
- nein (5)
Learned block iterative shrinkage thresholding algorithm for photothermal super resolution imaging
(2020)
Block-sparse regularization is already well-known in active thermal imaging and is used for multiple measurement based inverse problems. The main bottleneck of this method is the choice of regularization parameters which differs for each experiment. To avoid time-consuming manually selected regularization parameters, we propose a learned block-sparse optimization approach using an iterative algorithm unfolded into a deep neural network. More precisely, we show the benefits of using a learned block iterative shrinkage thresholding algorithm that is able to learn the choice of regularization parameters. In addition, this algorithm enables the determination of a suitable weight matrix to solve the underlying inverse problem. Therefore, in this paper we present the algorithm and compare it with state of the art block iterative shrinkage thresholding using synthetically generated test data and experimental test data from active thermography for defect reconstruction. Our results show that the use of the learned block-sparse optimization approach provides smaller normalized mean square errors for a small fixed number of iterations than without learning. Thus, this new approach allows to improve the convergence speed and only needs a few iterations to generate accurate defect reconstruction in photothermal super resolution imaging.
This paper presents deep unfolding neural networks to handle inverse problems in photothermal radiometry enabling super resolution (SR) imaging. Photothermal imaging is a well-known technique in active thermography for nondestructive inspection of defects in materials such as metals or composites. A grand challenge of active thermography is to overcome the spatial resolution limitation imposed by heat diffusion in order to accurately resolve each defect. The photothermal SR approach enables to extract high-frequency spatial components based on the deconvolution with the thermal point spread function. However, stable deconvolution can only be achieved by using the sparse structure of defect patterns, which often requires tedious, hand-crafted tuning of hyperparameters and results in computationally intensive algorithms. On this account, Photothermal-SR-Net is proposed in this paper, which performs deconvolution by deep unfolding considering the underlying physics. This enables to super resolve 2D thermal images for nondestructive testing with a substantially improved convergence rate. Since defects appear sparsely in materials, Photothermal-SR-Net applies trained blocksparsity thresholding to the acquired thermal images in each convolutional layer. The performance of the proposed approach is evaluated and discussed using various deep unfolding and thresholding approaches applied to 2D thermal images. Subsequently, studies are conducted on how to increase the reconstruction quality and the computational performance of Photothermal-SR-Net is evaluated.
Thereby, it was found that the computing time for creating high-resolution images could be significantly reduced without decreasing the reconstruction quality by using pixel binning as a preprocessing step.
Optical lock-in thermography is a completely contactless and very sensitive NDT technique. As an optical source of energy, incandescent lamps are most commonly used because they are relatively inexpensive and offer high irradiances at the test specimen. However, they are strongly restricted by their low modulation bandwidth with a maximum modulation frequency of only about 1 Hz. The use of high-power kilowattclass laser sources, e.g. diode laser arrays, pushes this constraint beyond 100 Hz. This allows for the exploration of the near-surface region of metals and layer systems with better and more accurate penetration depth and depth resolution. Moreover, these lasers are virtually free of any additional thermal radiation that could interfere with the “true” thermal response emitted from the heated sample. In turn, they can be easily used in a one-sided test configuration. We present current activities with kilowatt-class highpower laser sources for advanced lock-in thermography and focus on the application of laser arrays that offer a very high irradiation strength over a large sample area beyond the mentioned advantages.
Thermographic NDE is based on the interaction of thermal waves with inhomogeneities. These inhomogeneities are related to sample geometry or material composition. Although thermography is suitable for a wide range of inhomogeneities and materials, the fundamental limitation is the diffusive nature of thermal waves and the need to measure their effect radiometrically at the sample surface only. The propagation of the thermal waves from the heat source to the inhomogeneity and to the detection surface results in a degradation in the spatial resolution of the technique. A new concerted ansatz based on a spatially structured heating and a joint sparsity of the signal ensemble allows an improved reconstruction of inhomogeneities. As a first step to establish an improved thermographic NDE method, an experimental setup was built based on structured 1D illumination using a flash lamp behind a mechanical aperture. As a follow-up to this approach, we now use direct structured illumination using a 1D laser array. The individual emitter cells are driven by a random binary pattern and additionally shifted by fractions of the cell period. The repeated measurement of these different configurations with simultaneously constant inhomogeneity allows for a reconstruction that makes use of joint sparsity. With analytical-numerical modelling or numerical FEM simulations, we study the influence of the parameters on the result of non-linear reconstruction. For example, the influence of the illumination pattern as a variable heat flux density and Neumann boundary condition for convolution with the constant Green's function can be studied. These studies can be used to derive optimal conditions for a measurement technique.
Thermal waves are solutions of the heat diffusion equation for periodic boundary conditions and can be seen analogously to strongly damped waves. Although the underlying differential equation differs from the wave equation, the essential property for analogy between both equations is linearity such that superposition applies. This linearity is maintained even after a linear transformation, such as the Fourier transform from time to frequency domain. It follows that the temporal superposition principle is already used in active thermography, e.g. in pulsed thermography, as a superposition of many individual frequencies. However, the systematic spatial superposition has not yet been fully exploited, mainly due to a lack of suitable energy sources.
As a first step, we are investigating how thermal wave fields of arbitrary space-time structures can be engineered using structured laser illumination. The proof of principle was shown using a laser coupled projector. Unfortunately, the available optical output power was limited due to the thermal stress limit of the device. That is why we are working towards a more sophisticated moving 1D array of high-power diode lasers. We characterized the novel light source and believe that apart from the benefit of spatial and temporal illumination it can combine the temporal regimes of impulse and lock-in thermography.
In a second step, we investigate moving and oscillating line sources with different line shapes. We use a Green’s Function ansatz to analytically model the thermal wave propagation of structured 1D laser illumination in isotropic materials. Furthermore, we show some methods how they can be implemented. With this technique, we were able to accelerate our detection method firstly presented in for vertical narrow defects by factor three. Generally, we believe that this technique opens up similar opportunities than in other NDE methods. High-resolution ultrasound, for example, is also based on the superposition of single emitters and a recent concept suggests an option to deal with the diffusion wave character of the thermal waves.
Die thermografische ZfP basiert auf der Wechselwirkung von thermischen Wellen mit Inhomogenitäten. Die Ausbreitung von thermischen Wellen von der Wärmequelle zur Inhomogenität und zur Detektionsoberfläche entsprechend der thermischen Diffusionsgleichung führt dazu, dass zwei eng beieinander liegende Defekte fälschlicherweise als ein Defekt im gemessenen Thermogramm erkannt werden können. Um diese räumliche Auflösungsgrenze zu durchbrechen, also eine Super Resolution zu realisieren, kann die Kombination von räumlich strukturierter Erwärmung und numerischen Verfahren des Compressed Sensings verwendet werden.
Für unsere Arbeiten benutzen wir Hochleistungs-Laser im Kilowatt-Bereich um die Probe entweder hochaufgelöst entlang einer Linie (1D) abzurastern oder strukturiert zu erwärmen. Die Verbesserung des räumlichen Auflösungsvermögens zur Defekterkennung hängt dann im klassischen Sinne direkt von der Anzahl der Messungen ab. Mithilfe des Compressed Sensings und Vorkenntnissen über das System ist es jedoch möglich die Anzahl der Messungen zu reduzieren und trotzdem Super Resolution zu erzielen. Wie viele Messungen notwendig sind und wie groß der Auflösungsgewinn gegenüber der konventionellen thermografischen Prüfung mit flächiger Erwärmung ist, hängt von einer Reihe von Messparametern, der Messstrategie, Probeneigenschaften und den verwendeten Rekonstruktionsalgorithmen ab.
Unsere Studien befassen sich mit dem Einfluss der experimentellen Parameter, wie z.B. der Pulslänge der Laserbeleuchtung und der Größe des Laserspots. Weiterhin haben wir uns mit der Wahl der Parameter in der Rekonstruktion auseinandergesetzt, die einen Einfluss auf das im Compressed Sensing zugrundeliegende Minimierungsproblem haben. Für jeden getesteten Parametersatz wurde eine Rekonstruktionsqualität berechnet. Schließlich wurden die Defektrekonstruktionen basierend auf den Parameternsätzen verglichen, sodass eine Parameterwahl für hohe Rekonstruktionsqualitäten mit thermografischer Super Resolution empfohlen werden kann.
The work to be presented focuses on our most recent studies to laser excited super resolution (SR) thermography. The goal of nondestructive testing with SR is to facilitate the separation of closely spaced defects. Photothermal SR can be realized by performing structured illumination measurements in com-bination with the use of deconvolution algorithms in post-processing. We explain that stepwise as well as continuous scanning techniques are applicable to generate structured illumination measurements. Finally, we discuss the effect of experimental parameters and image processing techniques to find the optimal SR technique which leads to the highest reconstruction quality within laser thermography.
Thermographic nondestructive evaluation (NDE) is based on the interaction of thermal waves with inhomogeneities. These inhomogeneities are related to sample geometry or material composition. Although thermography is suitable for a wide range of inhomogeneities and materials, the fundamental limitation is the diffusive nature of thermal waves and the need to measure their effect radiometrically at the sample surface only. The propagation of the thermal waves from the heat source to the inhomogeneity and to the detection surface results in a degradation in the spatial resolution of the technique. A new concerted ansatz based on a spatially structured heating and a joint sparsity of the signal ensemble allows an improved reconstruction of inhomogeneities. As a first step to establish an improved thermographic NDE method, an experimental setup was built based on structured 1D illumination using a flash lamp behind a mechanical aperture. As a follow-up to this approach, we now use direct structured illumination using a 1D laser array. The individual emitter cells are driven by a pseudo-random binary pattern and are additionally shifted by fractions of the cell period. The repeated measurement of these different configurations enables to illuminate each spot of the sample surface in lateral direction. This allows for a reconstruction that makes use of joint sparsity.
The measured data set is processed using super resolution image reconstruction algorithms such as the iterative joint sparsity (IJOSP) algorithm. Using this reconstruction technique and 150 different illumination patterns results in a spatial resolution enhancement of approximately a factor of four compared to the resolution of 5.9 mm for homogenously illuminated thermographic reconstruction.
Further, new data processing techniques have been studied before applying the IJOSP algorithm that are more performant or less prone to errors regarding image reconstruction. The choice of regularization parameters in data processing as well as experimental parameters such as the illumination pattern as a variable heat flux density (i.e., the Neumann boundary condition for convolution with the constant Green's function) have a big influence on the reconstruction goodness. With analytical-numerical modelling and numerical FEM simulations, we studied the influence of the experimental parameters on the result of the non-linear IJOSP reconstruction. This has also been investigated experimentally e.g. using different laser line widths or more measurements per position. These studies are used to derive optimal conditions for a certain measurement image reconstruction technique.
The separation of two closely spaced defects in fields of Thermographic NDE is very challenging. The diffusive nature of thermal waves leads to a fundamental limitation in spatial resolution. Therefore, super resolution image reconstruction can be used. A new concerted ansatz based on spatially structured heating and joint sparsity of the signal ensemble allows for an improved reconstruction of closely spaced defects. This new technique has been studied using a 1D laser array with randomly chosen illumination pattern.
This paper presents the results after applying super resolution algorithms, such as the iterative joint sparsity (IJOSP) algorithm, to our processed measurement data. Different data processing techniques before applying the IJOSP algorithm as well as the influence of regularization parameters in the data processing techniques are discussed. Moreover, the degradation of super resolution reconstruction goodness by the choice of experimental parameters such as laser line width or number of measurements is shown.
The application of the super resolution results in a spatial resolution enhancement of approximately a factor of four which leads to a better separation of two closely spaced defects.
In this work we focus on our most recent studies to super resolution (SR) laser thermography. The goal of SR nondestructive testing methods is to facilitate the separation of closely spaced defects. We explain how to combine laser scanning with SR techniques. It can be shown that stepwise as well as continuous scanning techniques are applicable. Finally, we discuss the effect of experimental parameters and im-age processing techniques to find the optimal SR technique which leads to the highest reconstruction quality within laser thermography.