Filtern
Erscheinungsjahr
Dokumenttyp
- Zeitschriftenartikel (18)
- Beitrag zu einem Tagungsband (13)
- Vortrag (5)
- Posterpräsentation (3)
Schlagworte
- Thermography (39) (entfernen)
Organisationseinheit der BAM
Paper des Monats
- ja (1)
Eingeladener Vortrag
- nein (5)
In this work, we present a novel approach to photothermal super resolution based thermographic resolution of internal defects using two-dimensional pixel pattern-based active photothermal laser heating in conjunction with subsequent numerical reconstruction to achieve a high-resolution reconstruction of internal defect structures. With the proposed adoption of pixelated patterns generated using laser coupled high-power DLP projector technology the complexity for achieving true two-dimensional super resolution can be dramatically reduced taking a crucial step forward towards widespread practical viability. Furthermore, based on the latest developments in high-power DLP projectors, we present their first application for structured pulsed thermographic inspection of macroscopic metal samples. In addition, a forward solution to the underlying inverse problem is proposed along with an appropriate heuristic to find the regularization parameters necessary for the numerical inversion in a laboratory setting. This allows the generation of synthetic measurement data, opening the door for the application of machine learning based methods for future improvements towards full automation of the method. Finally, the proposed method is experimentally validated and shown to outperform several established conventional thermographic testing techniques while conservatively improving the required measurement times by a factor of 8 compared to currently available photothermal super resolution techniques.
This article presents deep unfolding neural networks to handle inverse problems in photothermal radiometry enabling super-resolution (SR) imaging. The photothermal SR approach is a well-known technique to overcome the spatial resolution limitation in photothermal imaging by extracting high-frequency spatial components based on the deconvolution with the thermal point spread function (PSF). However, stable deconvolution can only be achieved by using the sparse structure of defect patterns, which often requires tedious, handcrafted tuning of hyperparameters and results in computationally intensive algorithms. On this account, this article proposes Photothermal-SR-Net, which performs deconvolution by deep unfolding considering the underlying physics. Since defects appear sparsely in materials, our approach includes trained block-sparsity thresholding in each convolutional layer. This enables to super-resolve 2-D thermal images for nondestructive testing (NDT) with a substantially improved convergence rate compared to classic approaches. The performance of the proposed approach is evaluated on various deep unfolding and thresholding approaches. Furthermore, we explored how to increase the reconstruction quality and the computational performance. Thereby, it was found that the computing time for creating high-resolution images could be significantly reduced without decreasing the reconstruction quality by using pixel binning as a preprocessing step.
Learned block iterative shrinkage thresholding algorithm for photothermal super resolution imaging
(2022)
Block-sparse regularization is already well known in active thermal imaging and is used for multiple-measurement-based inverse problems. The main bottleneck of this method is the choice of regularization parameters which differs for each experiment. We show the benefits of using a learned block iterative shrinkage thresholding algorithm (LBISTA) that is able to learn the choice of regularization parameters, without the need to manually select them. In addition, LBISTA enables the determination of a suitable weight matrix to solve the underlying inverse problem. Therefore, in this paper we present LBISTA and compare it with state-of-the-art block iterative shrinkage thresholding using synthetically generated and experimental test data from active thermography for defect reconstruction. Our results show that the use of the learned block-sparse optimization approach provides smaller normalized mean square errors for a small fixed number of iterations. Thus, this allows us to improve the convergence speed and only needs a few iterations to generate accurate defect reconstruction in photothermal super-resolution imaging.
Thermographic photothermal super resolution reconstruction enables the resolution of internal defects/inhomogeneities below the classical limit, which is governed by the diffusion properties of thermal wave propagation. Based on a combination of the application of special sampling strategies and a subsequent numerical optimization step in post-processing, thermographic super resolution has already proven to be superior to standard thermographic methods in the detection of one-dimensional defect/inhomogeneity structures. In our work, we report an extension of the capabilities of the method for efficient detection and resolution of defect cross sections with fully two-dimensional structured laser-based heating. The reconstruction is carried out using one of two different algorithms that are proposed within this work. Both algorithms utilize the combination of several coherent measurements using convex optimization and exploit the sparse nature of defects/inhomogeneities as is typical for most nondestructive testing scenarios. Finally, the performance of each algorithm is rated on reconstruction quality and algorithmic complexity. The presented experimental approach is based on repeated spatially structured heating by a high power laser. As a result, a two-dimensional sparse defect/inhomogeneity map can be obtained. In addition, the obtained results are compared with those of conventional thermographic inspection methods that make use of homogeneous illumination. Due to the sparse nature of the reconstructed defect/inhomogeneity map, this comparison is performed qualitatively.
In this work, we report on our progress for investigating a new experimental approach for thermographic detection of internal defects by performing 2D photothermal super resolution reconstruction. We use modern high-power laser projector technology to repeatedly excite the sample surface photothermally with varying spatially structured 2D pixel patterns. In the subsequent (blind) numerical reconstruction, multiple measurements are combined by exploiting the joint-sparse nature of the defects within the specimen using nonlinear convex optimization methods. As a result, a 2D-sparse defect/inhomogeneity map can be obtained. Using such spatially structured heating combined with compressed sensing and computational imaging methods allows to significantly reduce the experimental complexity and to study larger test surfaces as compared to the one-dimensional approach reported earlier.
Thermographic non-destructive testing is based on the interaction of thermal waves with inhomogeneities. The propagation of thermal waves from the heat source to the inhomogeneity and to the detection surface according to the thermal diffusion equation leads to the fact that two closely spaced defects can be incorrectly detected as one defect in the measured thermogram. In order to break this spatial resolution limit (super resolution), the combination of spatially structured heating and numerical methods of compressed sensing can be used. The improvement of the spatial resolution for defect detection then depends in the classical sense directly on the number of measurements. Current practical implementations of this super resolution detection still suffer from long measurement times, since not only the achievable resolution depends on performing multiple measurements, but due to the use of single spot laser sources or laser arrays with low pixel count, also the scanning process itself is quite slow. With the application of most recent high-power digital micromirror device (DMD) based laser projector technology this issue can now be overcome.
Due to the diffusive nature of heat propagation in solids, the detection and resolution of internal defects with active thermography based non-destructive testing is commonly limited to a defect-depth-to-defect-size ratio greater than or equal to one. In the more recent past, we have already demonstrated that this limitation can be overcome by using a spatially modulated illumination source and photothermal super resolution-based reconstruction. Furthermore, by relying on compressed sensing and computational imaging methods we were able to significantly reduce the experimental complexity to make the method viable for investigating larger regions of interest. In this work we share our progress on improving the defect/inhomogeneity characterization using fully 2D spatially structured illumination patterns instead of scanning with a single laser spot. The experimental approach is based on the repeated blind pseudo-random illumination using modern projector technology and a high-power laser. In the subsequent post-processing, several measurements are then combined by taking advantage of the joint sparsity of the defects within the sample applying 2D-photothermal super resolution reconstruction. Here, enhanced nonlinear convex optimization techniques are utilized for solving the underlying ill-determined inverse problem for typical simple defect geometries. As a result, a higher resolution defect/inhomogeneity map can be obtained at a fraction of the measurement time previously needed.
Thermographic super-resolution techniques allow the resolution of defects/inhomogeneities beyond the classical limit, which is governed by the diffusion properties of thermal wave propagation. Photothermal super-resolution is based on a combination of an experimental scanning strategy and a numerical optimization which has been proven to be superior to standard thermographic methods in the case of 1D linear defects. In this contribution, we report on the extension of this approach towards a full frame 2D photothermal super-resolution technique. The experimental approach is based on a repeated spatially structured heating using high power lasers. In a second post-processing step, several measurements are coherently combined using mathematical optimization and taking advantage of the (joint) sparsity of the defects in the sample. In our work we extend the possibilities of the method to efficiently detect and resolve defect cross sections with a fully 2D-structured blind illumination.
Active thermography as a nondestructive testing modality suffers greatly from the limitations imposed by the diffusive nature of heat conduction in solids. As a rule of thumb, the detection and resolution of internal defects/inhomogeneities is limited to a defect depth to defect size ratio greater than or equal to one. Earlier, we demonstrated that this classical limit can be overcome for 1D and 2D defect geometries by using photothermal laser-scanning super resolution. In this work we report a new experimental approach using 2D spatially structured illumination patterns in conjunction with compressed sensing and computational imaging methods to significantly decrease the experimental complexity and make the method viable for investigating larger regions of interest.
Thermographic super resolution techniques allow the spatial resolution of defects/inhomogeneities below the classical limit, which is governed by the diffusion properties of thermal wave propagation. In this work, we report on the extension of this approach towards a full frame 2D super resolution technique. The approach is based on a repeated spatially structured heating using high power lasers. In a second post-processing step, several measurements are coherently combined using mathematical optimization and taking advantage of the (joint) sparsity of the defects in the sample
Laser excited super resolution thermal imaging for nondestructive inspection of internal defects
(2020)
A photothermal super resolution technique is proposed for an improved inspection of internal defects. To evaluate the potential of the laser-based thermographic technique, an additively manufactured stainless steel specimen with closely spaced internal cavities is used. Four different experimental configurations in transmission, reflection, stepwise and continuous scanning are investigated. The applied image post-processing method is based on compressed sensing and makes use of the block sparsity from multiple measurement events. This concerted approach of experimental measurement strategy and numerical optimization enables the resolution of internal defects and outperforms conventional thermographic inspection techniques.
Thermographic reconstruction of defects that lie in the bulk of a sample is a difficult task because entropy production during heat diffusion leads to information loss. To reconstruct defects one has to solve an inverse heat conduction problem. The quality of the reconstruction is closely related to the information content of the observed data set that is reflected by the decreasing ability to spatially resolve a defect with growing defect depth. In this work we show a 2D reconstruction of rectangular slots with different width-to-depth ratios in a metallic sample. For this purpose, we apply the virtual wave concept and incorporate positivity and sparsity as prior information to overcome the diffusion-based information loss partially. The reconstruction is based on simulated and experimental pulse thermography data. In the first reconstruction step, we compute a virtual wave field from the surface temperature data. This allows us, in the second step, to use ultrasonic backpropagation methods for image reconstruction.
Using spatial and temporal shaping of laser-induced diffuse thermal wave fields in thermography
(2020)
The diffuse nature of thermal waves is a fun-damental limitation in thermographic nonde-structive testing. In our studies we investigated different approaches by shaping the thermal wave fields which result from heating. We have used high-power laser sources to heat metallic samples. Using these spatial and temporal shaping techniques leads to a higher detection sensitivity in our measurements with the infra-red camera. In this contribution we show our implementation of shaping laser-induced diffuse thermal wave fields and the effect on the defect reconstruction quality.
Photothermal radiometry with an infrared camera allows the contactless temperature measurement of multiple surface pixels simultaneously. A short light pulse heats the sample. The heat propagates through the sample by diffusion and the corresponding temperature evolution is measured at the sample’s surface by an infrared camera. The main drawback in radiometric imaging is the loss of the spatial resolution with increasing depth due to heat diffusion, which results in blurred images for deeper lying structures. We circumvent this information loss due to the diffusion process by using blind structured illumination, combined with a non-linear joint sparsity reconstruction algorithm. The structured illumination is realized by parallel laser lines from a vertical-cavity surface-emitting laser (VCSEL) array controlled by a random binary pattern generator. By using 150 different patterns of structured illumination and our iterative joint sparsity algorithm, it was possible to resolve 1 mm thick lines at a distance down to 0.5 mm, which results in a resolution enhancement of approximately a factor of four compared to the resolution of 5.9 mm for homogenous illuminated thermographic reconstruction.
Crack detection in metallic samples at high surface temperature, hostile and hazardous environments, etc. is challenging situation in any manufacturing industries. Most of the present NDE methods are suitable only for lower surface temperatures, especially room temperature. In this situation, we need a fast and non-contact NDT method which can be applied even in high sample surface temperature. Laser thermography is one of the techniques having a high potential in non-contact inspection. As a preliminary investigation, in this article, we have studied the potentiality of laser line thermography in crack detection at room temperature. In laser line thermography, a continuous wave (CW) laser is used to generate a laser line, which in turn is used to scan the metal surface. The heat distribution over the sample surface is recorded by an infrared thermal (IR) camera. Two different approaches are reported in this work. Firstly, a stationary laser line source and its interaction with cracks; secondly, moving laser line source scanning over a surface with crack. When the distance between crack centre to laser line centre increases, crack detectability will decrease; and when laser power increases, crack detectability will increase. A dedicated image processing algorithm was developed to improve the detectability of the cracks. To understand the heat transfer phenomenon, a simplified 3D model for laser thermography was developed for the heat distribution during laser heating and was validated with experimental results. Defects were incorporated as a thermally thin resistive layer (TTRL) in numerical modeling, and the effect of TTRL in heat conduction is compared with experimental results.
We report on photothermal detection of subsurface defects by coherent superposition of thermal wave fields. This is made possible by structured heating using high-power VCSEL laser arrays whose individual emitter groups can be arbitrarily controlled. In order to locate the defects, we have developed a scanning method based on the continuous wavelet transformation with complex Morlet wavelet using the destructive interference effect of thermal waves. This approach can also be used for thermally very fast and highly reflective materials such as uncoated aluminum. We show that subsurface defects at an aspect ratio of defect width to defect depth down to 1/3 are still detectable in this material.
Due to their high irradiance and wide modulation bandwidth, high-power lasers open up a wide field of application. For example, the classical methods of pulse and lock-in thermography can be realized in high quality. In addition, structured heating is also possible by using arrays of such lasers. This makes it possible to implement new thermographic methods, such as interference-based detection of cracks or super resolution.
The separation of two closely spaced defects in fields of Thermographic NDE is very challenging. The diffusive nature of thermal waves leads to a fundamental limitation in spatial resolution. Therefore, super resolution image reconstruction can be used. A new concerted ansatz based on spatially structured heating and joint sparsity of the signal ensemble allows for an improved reconstruction of closely spaced defects. This new technique has been studied using a 1D laser array with randomly chosen illumination pattern.
This paper presents the results after applying super resolution algorithms, such as the iterative joint sparsity (IJOSP) algorithm, to our processed measurement data. Different data processing techniques before applying the IJOSP algorithm as well as the influence of regularization parameters in the data processing techniques are discussed. Moreover, the degradation of super resolution reconstruction goodness by the choice of experimental parameters such as laser line width or number of measurements is shown.
The application of the super resolution results in a spatial resolution enhancement of approximately a factor of four which leads to a better separation of two closely spaced defects.
In the field of optically excited thermography, flash lamps (impulse shaped planar heating) and halogen lamps (modulated planar heating) have become established for the specific regimes of impulse and lock-in thermography. Flying-spot laser thermography is implemented by means of a rasterized focused laser, e. g. for crack detection (continuous wave operation) and photothermal material characterization (high-frequency modulated). The availability of novel technologies, i. e. fast and high-resolution IR cameras, brilliant innovative light sources and high-performance data acquisition and processing technology will enable a paradigm shift from stand-alone photothermal and thermographic techniques to uniform quantitative measurement and testing technology that is faster and more precise. Similar to an LED array, but with irradiance two orders of magnitude higher, a new type of brilliant laser source, i. e. the VCSEL array (vertical-cavity surface-emitting laser), is now available. This novel optical energy source eliminates the strong limitation to the temporal dynamics of established light sources and at the same time is spectrally clearly separated from the detection wavelength. It combines the fast temporal behavior of a diode laser with the high optical irradiance and the wide illumination area of flash lamps. In addition, heating can also be carried out in a structured manner, because individual areas of the VCSEL array can be controlled independently of each other. This new degree of freedom enables the development of completely new thermographic NDT methods.
Optical lock-in thermography is a completely contactless and very sensitive NDT technique. As an optical source of energy, incandescent lamps are most commonly used because they are relatively inexpensive and offer high irradiances at the test specimen. However, they are strongly restricted by their low modulation bandwidth with a maximum modulation frequency of only about 1 Hz. The use of high-power kilowatt-class laser sources, e.g. diode laser arrays, pushes this constraint beyond 100 Hz. This allows for the exploration of the near-surface region of metals and layer systems with better and more accurate penetration depth and depth resolution. Moreover, these lasers are virtually free of any additional thermal radiation that could interfere with the “true” thermal response emitted from the heated sample. In turn, they can be easily used in a one-sided test configuration.
We present current activities with kilowatt-class high-power laser sources for advanced lock-in thermography and focus on the application of laser arrays that offer a very high irradiation strength over a large sample area beyond the mentioned advantages.