Filtern
Erscheinungsjahr
Dokumenttyp
- Zeitschriftenartikel (18)
- Beitrag zu einem Tagungsband (13)
- Vortrag (5)
- Posterpräsentation (3)
Schlagworte
- Thermography (39) (entfernen)
Organisationseinheit der BAM
Paper des Monats
- ja (1)
Eingeladener Vortrag
- nein (5)
This article presents deep unfolding neural networks to handle inverse problems in photothermal radiometry enabling super-resolution (SR) imaging. The photothermal SR approach is a well-known technique to overcome the spatial resolution limitation in photothermal imaging by extracting high-frequency spatial components based on the deconvolution with the thermal point spread function (PSF). However, stable deconvolution can only be achieved by using the sparse structure of defect patterns, which often requires tedious, handcrafted tuning of hyperparameters and results in computationally intensive algorithms. On this account, this article proposes Photothermal-SR-Net, which performs deconvolution by deep unfolding considering the underlying physics. Since defects appear sparsely in materials, our approach includes trained block-sparsity thresholding in each convolutional layer. This enables to super-resolve 2-D thermal images for nondestructive testing (NDT) with a substantially improved convergence rate compared to classic approaches. The performance of the proposed approach is evaluated on various deep unfolding and thresholding approaches. Furthermore, we explored how to increase the reconstruction quality and the computational performance. Thereby, it was found that the computing time for creating high-resolution images could be significantly reduced without decreasing the reconstruction quality by using pixel binning as a preprocessing step.
Laser excited super resolution thermal imaging for nondestructive inspection of internal defects
(2020)
A photothermal super resolution technique is proposed for an improved inspection of internal defects. To evaluate the potential of the laser-based thermographic technique, an additively manufactured stainless steel specimen with closely spaced internal cavities is used. Four different experimental configurations in transmission, reflection, stepwise and continuous scanning are investigated. The applied image post-processing method is based on compressed sensing and makes use of the block sparsity from multiple measurement events. This concerted approach of experimental measurement strategy and numerical optimization enables the resolution of internal defects and outperforms conventional thermographic inspection techniques.
The separation of two closely spaced defects in fields of Thermographic NDE is very challenging. The diffusive nature of thermal waves leads to a fundamental limitation in spatial resolution. Therefore, super resolution image reconstruction can be used. A new concerted ansatz based on spatially structured heating and joint sparsity of the signal ensemble allows for an improved reconstruction of closely spaced defects. This new technique has been studied using a 1D laser array with randomly chosen illumination pattern.
This paper presents the results after applying super resolution algorithms, such as the iterative joint sparsity (IJOSP) algorithm, to our processed measurement data. Different data processing techniques before applying the IJOSP algorithm as well as the influence of regularization parameters in the data processing techniques are discussed. Moreover, the degradation of super resolution reconstruction goodness by the choice of experimental parameters such as laser line width or number of measurements is shown.
The application of the super resolution results in a spatial resolution enhancement of approximately a factor of four which leads to a better separation of two closely spaced defects.
Using an infrared camera for radiometric imaging allows the contactless temperature measurement of multiple surface pixels simultaneously. From the measured surface data, a sub-surface structure, embedded inside a sample or tissue, can be reconstructed and imaged when heated by an excitation light pulse. The main drawback in radiometric imaging is the degradation of the spatial resolution with increasing depth, which results in blurred images for deeper lying structures. We circumvent this degradation with blind structured illumination, combined with a non-linear joint sparsity reconstruction algorithm. The ground-breaking concept of super-resolution can be transferred from optics to thermographic imaging.
Photothermal radiometry with an infrared camera allows the contactless temperature measurement of multiple surface pixels simultaneously. A short light pulse heats the sample. The heat propagates through the sample by diffusion and the corresponding temperature evolution is measured at the sample’s surface by an infrared camera. The main drawback in radiometric imaging is the loss of the spatial resolution with increasing depth due to heat diffusion, which results in blurred images for deeper lying structures. We circumvent this information loss due to the diffusion process by using blind structured illumination, combined with a non-linear joint sparsity reconstruction algorithm. The structured illumination is realized by parallel laser lines from a vertical-cavity surface-emitting laser (VCSEL) array controlled by a random binary pattern generator. By using 150 different patterns of structured illumination and our iterative joint sparsity algorithm, it was possible to resolve 1 mm thick lines at a distance down to 0.5 mm, which results in a resolution enhancement of approximately a factor of four compared to the resolution of 5.9 mm for homogenous illuminated thermographic reconstruction.
Learned block iterative shrinkage thresholding algorithm for photothermal super resolution imaging
(2022)
Block-sparse regularization is already well known in active thermal imaging and is used for multiple-measurement-based inverse problems. The main bottleneck of this method is the choice of regularization parameters which differs for each experiment. We show the benefits of using a learned block iterative shrinkage thresholding algorithm (LBISTA) that is able to learn the choice of regularization parameters, without the need to manually select them. In addition, LBISTA enables the determination of a suitable weight matrix to solve the underlying inverse problem. Therefore, in this paper we present LBISTA and compare it with state-of-the-art block iterative shrinkage thresholding using synthetically generated and experimental test data from active thermography for defect reconstruction. Our results show that the use of the learned block-sparse optimization approach provides smaller normalized mean square errors for a small fixed number of iterations. Thus, this allows us to improve the convergence speed and only needs a few iterations to generate accurate defect reconstruction in photothermal super-resolution imaging.
Single-pulse tests of the catastrophic optical damage (COD) are performed for three batches of diode lasers with different gain-regions. The tests involve in situ inspection of front, rear, and side of the devices by a thermocamera. Devices with an Al-containing gain-region show COD at the front facet, as expected for strong facet heating via surface recombination and reabsorption of laser light. In contrast, Al-free devices with low surface recombination rates tend to fail at the rear facet, pointing to a different heating scenario. The high carrier density at the rear facet favors heating and COD via Auger recombination processes.
Double-side cooled high-power diode laser bars packaged by different techniques on different types of passive heat sinks are analyzed in terms of packaging-induced strain. Reference data from standard devices being single-side cooled only and packaged by conventional soft and hard soldering are also presented. Thermal profiling across the devices complements the results. The most suitable packaging architecture and technique for double-side cooled bars is identified. Measurements of the laser emission near field and electroluminescence pattern provide direct reference to the functionality of the devices. Furthermore, a type of cross calibration of the methods used for strain analysis is made, since all techniques are applied to the same set of bars. This involves micro photoluminescence, micro Raman, and degree-of-polarization electroluminescence spectroscopy.
Catastrophic optical damage (COD) is analyzed during single current pulse excitation of 975 nm emitting diode lasers. Power transients and thermal images are monitored during each pulse. The COD process is unambiguously related to the occurrence of a thermal flash of Plancks radiation. We observe COD to ignite multiple times in subsequent pulses. Thermography allows for tracing a spatial motion of the COD site on the front facet of the devices. The time constant of power decay after the onset of COD has values from 400 to 2000 ns, i.e., an order of magnitude longer than observed for shorter-wavelength devices.
Thermographic photothermal super resolution reconstruction enables the resolution of internal defects/inhomogeneities below the classical limit, which is governed by the diffusion properties of thermal wave propagation. Based on a combination of the application of special sampling strategies and a subsequent numerical optimization step in post-processing, thermographic super resolution has already proven to be superior to standard thermographic methods in the detection of one-dimensional defect/inhomogeneity structures. In our work, we report an extension of the capabilities of the method for efficient detection and resolution of defect cross sections with fully two-dimensional structured laser-based heating. The reconstruction is carried out using one of two different algorithms that are proposed within this work. Both algorithms utilize the combination of several coherent measurements using convex optimization and exploit the sparse nature of defects/inhomogeneities as is typical for most nondestructive testing scenarios. Finally, the performance of each algorithm is rated on reconstruction quality and algorithmic complexity. The presented experimental approach is based on repeated spatially structured heating by a high power laser. As a result, a two-dimensional sparse defect/inhomogeneity map can be obtained. In addition, the obtained results are compared with those of conventional thermographic inspection methods that make use of homogeneous illumination. Due to the sparse nature of the reconstructed defect/inhomogeneity map, this comparison is performed qualitatively.
Active thermography as a nondestructive testing modality suffers greatly from the limitations imposed by the diffusive nature of heat conduction in solids. As a rule of thumb, the detection and resolution of internal defects/inhomogeneities is limited to a defect depth to defect size ratio greater than or equal to one. Earlier, we demonstrated that this classical limit can be overcome for 1D and 2D defect geometries by using photothermal laser-scanning super resolution. In this work we report a new experimental approach using 2D spatially structured illumination patterns in conjunction with compressed sensing and computational imaging methods to significantly decrease the experimental complexity and make the method viable for investigating larger regions of interest.
Thermographic super-resolution techniques allow the resolution of defects/inhomogeneities beyond the classical limit, which is governed by the diffusion properties of thermal wave propagation. Photothermal super-resolution is based on a combination of an experimental scanning strategy and a numerical optimization which has been proven to be superior to standard thermographic methods in the case of 1D linear defects. In this contribution, we report on the extension of this approach towards a full frame 2D photothermal super-resolution technique. The experimental approach is based on a repeated spatially structured heating using high power lasers. In a second post-processing step, several measurements are coherently combined using mathematical optimization and taking advantage of the (joint) sparsity of the defects in the sample. In our work we extend the possibilities of the method to efficiently detect and resolve defect cross sections with a fully 2D-structured blind illumination.
Thermographic super resolution techniques allow the spatial resolution of defects/inhomogeneities below the classical limit, which is governed by the diffusion properties of thermal wave propagation. In this work, we report on the extension of this approach towards a full frame 2D super resolution technique. The approach is based on a repeated spatially structured heating using high power lasers. In a second post-processing step, several measurements are coherently combined using mathematical optimization and taking advantage of the (joint) sparsity of the defects in the sample
In this work, we report on our progress for investigating a new experimental approach for thermographic detection of internal defects by performing 2D photothermal super resolution reconstruction. We use modern high-power laser projector technology to repeatedly excite the sample surface photothermally with varying spatially structured 2D pixel patterns. In the subsequent (blind) numerical reconstruction, multiple measurements are combined by exploiting the joint-sparse nature of the defects within the specimen using nonlinear convex optimization methods. As a result, a 2D-sparse defect/inhomogeneity map can be obtained. Using such spatially structured heating combined with compressed sensing and computational imaging methods allows to significantly reduce the experimental complexity and to study larger test surfaces as compared to the one-dimensional approach reported earlier.
In this work, we present a novel approach to photothermal super resolution based thermographic resolution of internal defects using two-dimensional pixel pattern-based active photothermal laser heating in conjunction with subsequent numerical reconstruction to achieve a high-resolution reconstruction of internal defect structures. With the proposed adoption of pixelated patterns generated using laser coupled high-power DLP projector technology the complexity for achieving true two-dimensional super resolution can be dramatically reduced taking a crucial step forward towards widespread practical viability. Furthermore, based on the latest developments in high-power DLP projectors, we present their first application for structured pulsed thermographic inspection of macroscopic metal samples. In addition, a forward solution to the underlying inverse problem is proposed along with an appropriate heuristic to find the regularization parameters necessary for the numerical inversion in a laboratory setting. This allows the generation of synthetic measurement data, opening the door for the application of machine learning based methods for future improvements towards full automation of the method. Finally, the proposed method is experimentally validated and shown to outperform several established conventional thermographic testing techniques while conservatively improving the required measurement times by a factor of 8 compared to currently available photothermal super resolution techniques.
Due to the diffusive nature of heat propagation in solids, the detection and resolution of internal defects with active thermography based non-destructive testing is commonly limited to a defect-depth-to-defect-size ratio greater than or equal to one. In the more recent past, we have already demonstrated that this limitation can be overcome by using a spatially modulated illumination source and photothermal super resolution-based reconstruction. Furthermore, by relying on compressed sensing and computational imaging methods we were able to significantly reduce the experimental complexity to make the method viable for investigating larger regions of interest. In this work we share our progress on improving the defect/inhomogeneity characterization using fully 2D spatially structured illumination patterns instead of scanning with a single laser spot. The experimental approach is based on the repeated blind pseudo-random illumination using modern projector technology and a high-power laser. In the subsequent post-processing, several measurements are then combined by taking advantage of the joint sparsity of the defects within the sample applying 2D-photothermal super resolution reconstruction. Here, enhanced nonlinear convex optimization techniques are utilized for solving the underlying ill-determined inverse problem for typical simple defect geometries. As a result, a higher resolution defect/inhomogeneity map can be obtained at a fraction of the measurement time previously needed.
The paper presents an attempt for the calibration of an active
thermography method that is suitable for the non-destructive
evaluation of spot welds. Nowadays, the quality of spot welds is
commonly characterised by the application of random chisel tests,
which are time consuming, expensive and destructive. Recently a
non-destructive testing method by means of active thermography
was proposed that relies on the fact that the mechanical connection
formed by the spot weld also serves as a thermal bridge between
the two steel sheets joined in the welding process. It is shown in this
paper that this thermal bridge can be thermographically characterised
by extracting a measure for the spot weld diameter and hence the
quality of the spot weld. The determination of the absolute value
of the diameter hereby relies on a calibration of the testing system,
which is performed by means of X-ray computed tomography in this
study. The experiments were carried out using different experimental
approaches, namely transmission as well as reflection geometry
wSetup in reflectionith laser illumination. A comprehensive evaluation
of samples produced using different welding currents, hence different
quality, was carried out in order to validate the thermographic results.
We present a systematic study on the performance of laser-thermography for the detection of surface cracks in metallic components. Scanning a metallic surface with laser causes local heating that is mapped simultaneously by an IR-camera and allows identifying cracks with sub-µm openings. The detectability, however, depends on a number of acquisition parameters (e.g. scanning speed, laser power, IR-camera resolution) that typically relate on each other. Most importantly, the detection-sensitivity of surface breaking cracks is given by a particular combination for the acquisition parameter values. As a result, this sensitivity is adaptable within wide ranges allowing the detection of cracks with openings ranging from 200 to 0.1 µm at testing speeds of 100 to 0.05 cm²/s. By examining artificial as well as fatigue cracks, we demonstrate that the method can be even applied to shiny surfaces with no need of pretreatments, which makes it an entirely contactless, remote and automatable NDT technique. A comparison with magnetic particle testing shows that laser-thermography has the potential to become a strong competitor to conventional surface inspection methods in the future.
In-line laser thermography for crack detection at elevated temperature: A Numerical modeling study
(2016)
The detection and characterization of cracks prior to damage is a technologically and economically highly significant task and is of very importance when it comes to safety-relevant structures. The evaluation of a components life is closely related to the presence of cracks in it. Laser thermography has already high capability for the detection of surface cracks and for the characterization of the geometry of artificial surface flaws in metallic samples. Crack detection in metallic samples at high temperature is highly significant in present manufacturing scenario. During the casting process of billets, surface cracks form, due to the suboptimal cooling rates. These cracks reduce value of the billet and must be removed using machining process after cooling. This secondary process increases cost of manufacturing. In this work we developed a heat transfer model for laser thermography to study the thermal contrast variation with increase in surface temperature using finite element method (FEM). Here we are mainly concentrating the capability of the scanning laser thermography in crack detection which are in elevated temperature and numerical modeling study of thermal contrast variation of crack with respect increase in metal surface temperature. This study is important to prove the capability of laser thermography for crack detection in elevated temperature. Since we are using High power CW Laser to local heating of the metal surface which can give relatively high thermal contrast even at elevated temperature compare to other heating source. Here we are modeled and simulated 2D laser scanning across a surface breaking crack and developed an algorithm to produce the vicinity of crack. The algorithm we developed applied for various surface temperature data. And validated the credibility of the algorithm with experimental data.
Crack detection in metallic samples at high surface temperature, hostile and hazardous environments, etc. is challenging situation in any manufacturing industries. Most of the present NDE methods are suitable only for lower surface temperatures, especially room temperature. In this situation, we need a fast and non-contact NDT method which can be applied even in high sample surface temperature. Laser thermography is one of the techniques having a high potential in non-contact inspection. As a preliminary investigation, in this article, we have studied the potentiality of laser line thermography in crack detection at room temperature. In laser line thermography, a continuous wave (CW) laser is used to generate a laser line, which in turn is used to scan the metal surface. The heat distribution over the sample surface is recorded by an infrared thermal (IR) camera. Two different approaches are reported in this work. Firstly, a stationary laser line source and its interaction with cracks; secondly, moving laser line source scanning over a surface with crack. When the distance between crack centre to laser line centre increases, crack detectability will decrease; and when laser power increases, crack detectability will increase. A dedicated image processing algorithm was developed to improve the detectability of the cracks. To understand the heat transfer phenomenon, a simplified 3D model for laser thermography was developed for the heat distribution during laser heating and was validated with experimental results. Defects were incorporated as a thermally thin resistive layer (TTRL) in numerical modeling, and the effect of TTRL in heat conduction is compared with experimental results.