Filtern
Dokumenttyp
Sprache
- Englisch (25)
Referierte Publikation
- ja (25) (entfernen)
Schlagworte
- Thermography (15)
- NDT (9)
- Laser thermography (8)
- Super resolution (8)
- Internal defects (5)
- Inspection (4)
- Defect reconstruction (3)
- Non-destructive testing (3)
- VCSEL (3)
- Active thermal imaging (2)
Organisationseinheit der BAM
- 8 Zerstörungsfreie Prüfung (25) (entfernen)
Paper des Monats
- ja (1)
Infrared thermography using a focused (spot or line) beam has proved to be effective for detection of surface breaking cracks on planar samples. In this work, we use the same principle, but applied to complex shaped components, like a rail section, a gear, and a gas turbine blade. We use a six-axis robot arm to move the sample in front of our thermographic setup. Several scanning paths and thermographic parameters are explored: scanning speed, density of points in each scanning slice, laser power and camera frame-rate. Additionally, we explore semi-automatic evaluation algorithms for crack detection, as well as 2D-to-3D registration of the found indications.
In this work, the limits of using spatially structured heating combined with subsequent photothermal super resolution reconstruction for the thermographic detection and resolution of internal defects are investigated. The approach is based on the application of modern high-power laser projector technology, which is used to repeatedly project varying spatially structured 2D pixel patterns to photothermally heat the object under test. After processing the generated thermographic data using nonlinear convex optimisation in conjunction with exploiting the joint-sparse nature of the defect signals within the individual measurements, a high-resolution 2D-sparse defect/inhomogeneity map is obtained. The main focus of the investigation is set on the influence of the number of individual measurements on the achievable reconstruction quality. Using numerical simulations based on an analytical representation of the forward solution to the underlying inverse problem, the convergence rate over performed measurements of the achievable reconstruction quality is determined. Finally, all findings are experimentally validated by reconstructing a set of internal defects in an additively manufactured sample. In this work, it is shown that for a variety of different defect separation distances, the projection of 50 different pixel patterns allows for a good trade-off between experimental complexity and reconstruction quality.
In this work, we present a novel approach to photothermal super resolution based thermographic resolution of internal defects using two-dimensional pixel pattern-based active photothermal laser heating in conjunction with subsequent numerical reconstruction to achieve a high-resolution reconstruction of internal defect structures. With the proposed adoption of pixelated patterns generated using laser coupled high-power DLP projector technology the complexity for achieving true two-dimensional super resolution can be dramatically reduced taking a crucial step forward towards widespread practical viability. Furthermore, based on the latest developments in high-power DLP projectors, we present their first application for structured pulsed thermographic inspection of macroscopic metal samples. In addition, a forward solution to the underlying inverse problem is proposed along with an appropriate heuristic to find the regularization parameters necessary for the numerical inversion in a laboratory setting. This allows the generation of synthetic measurement data, opening the door for the application of machine learning based methods for future improvements towards full automation of the method. Finally, the proposed method is experimentally validated and shown to outperform several established conventional thermographic testing techniques while conservatively improving the required measurement times by a factor of 8 compared to currently available photothermal super resolution techniques.
Learned block iterative shrinkage thresholding algorithm for photothermal super resolution imaging
(2022)
Block-sparse regularization is already well known in active thermal imaging and is used for multiple-measurement-based inverse problems. The main bottleneck of this method is the choice of regularization parameters which differs for each experiment. We show the benefits of using a learned block iterative shrinkage thresholding algorithm (LBISTA) that is able to learn the choice of regularization parameters, without the need to manually select them. In addition, LBISTA enables the determination of a suitable weight matrix to solve the underlying inverse problem. Therefore, in this paper we present LBISTA and compare it with state-of-the-art block iterative shrinkage thresholding using synthetically generated and experimental test data from active thermography for defect reconstruction. Our results show that the use of the learned block-sparse optimization approach provides smaller normalized mean square errors for a small fixed number of iterations. Thus, this allows us to improve the convergence speed and only needs a few iterations to generate accurate defect reconstruction in photothermal super-resolution imaging.
Due to the diffusive nature of heat propagation in solids, the detection and resolution of internal defects with active thermography based non-destructive testing is commonly limited to a defect-depth-to-defect-size ratio greater than or equal to one. In the more recent past, we have already demonstrated that this limitation can be overcome by using a spatially modulated illumination source and photothermal super resolution-based reconstruction. Furthermore, by relying on compressed sensing and computational imaging methods we were able to significantly reduce the experimental complexity to make the method viable for investigating larger regions of interest. In this work we share our progress on improving the defect/inhomogeneity characterization using fully 2D spatially structured illumination patterns instead of scanning with a single laser spot. The experimental approach is based on the repeated blind pseudo-random illumination using modern projector technology and a high-power laser. In the subsequent post-processing, several measurements are then combined by taking advantage of the joint sparsity of the defects within the sample applying 2D-photothermal super resolution reconstruction. Here, enhanced nonlinear convex optimization techniques are utilized for solving the underlying ill-determined inverse problem for typical simple defect geometries. As a result, a higher resolution defect/inhomogeneity map can be obtained at a fraction of the measurement time previously needed.
Thermographic photothermal super resolution reconstruction enables the resolution of internal defects/inhomogeneities below the classical limit, which is governed by the diffusion properties of thermal wave propagation. Based on a combination of the application of special sampling strategies and a subsequent numerical optimization step in post-processing, thermographic super resolution has already proven to be superior to standard thermographic methods in the detection of one-dimensional defect/inhomogeneity structures. In our work, we report an extension of the capabilities of the method for efficient detection and resolution of defect cross sections with fully two-dimensional structured laser-based heating. The reconstruction is carried out using one of two different algorithms that are proposed within this work. Both algorithms utilize the combination of several coherent measurements using convex optimization and exploit the sparse nature of defects/inhomogeneities as is typical for most nondestructive testing scenarios. Finally, the performance of each algorithm is rated on reconstruction quality and algorithmic complexity. The presented experimental approach is based on repeated spatially structured heating by a high power laser. As a result, a two-dimensional sparse defect/inhomogeneity map can be obtained. In addition, the obtained results are compared with those of conventional thermographic inspection methods that make use of homogeneous illumination. Due to the sparse nature of the reconstructed defect/inhomogeneity map, this comparison is performed qualitatively.
This article presents deep unfolding neural networks to handle inverse problems in photothermal radiometry enabling super-resolution (SR) imaging. The photothermal SR approach is a well-known technique to overcome the spatial resolution limitation in photothermal imaging by extracting high-frequency spatial components based on the deconvolution with the thermal point spread function (PSF). However, stable deconvolution can only be achieved by using the sparse structure of defect patterns, which often requires tedious, handcrafted tuning of hyperparameters and results in computationally intensive algorithms. On this account, this article proposes Photothermal-SR-Net, which performs deconvolution by deep unfolding considering the underlying physics. Since defects appear sparsely in materials, our approach includes trained block-sparsity thresholding in each convolutional layer. This enables to super-resolve 2-D thermal images for nondestructive testing (NDT) with a substantially improved convergence rate compared to classic approaches. The performance of the proposed approach is evaluated on various deep unfolding and thresholding approaches. Furthermore, we explored how to increase the reconstruction quality and the computational performance. Thereby, it was found that the computing time for creating high-resolution images could be significantly reduced without decreasing the reconstruction quality by using pixel binning as a preprocessing step.
In this work we introduce an algorithm based on the well-known Canny approach for effectual crack detection in thermographic films obtained using flying spot thermography (FST) or flying line thermography (FLT). The proposed algorithm performs faster than another algorithm, for crack detection, based on the application of two Sobel filters (one in x and another one in y directions). For FLT it is shown that processing 10-25 % of the thermograms of a thermographic film required to scan a whole sample is enough to obtain good results. In contrast, using the Sobel filter approach requires the processing of twice the thermographic film length. Experimental measurements are performed on a metallic component of complex shape which contains real defects, that is, surface breaking cracks due to industrial use. The specimen is tested using flying line thermography. Three different scanning speeds are tested: 10, 30 and 60 mms-1 with laser powers of 50, 60 and 120 W respectively. The sample and an infrared camera are aligned and fixed on a motorized linear stage. The diode laser LDM500 (500 W max power) is fixed on an optical bench separately from the linear stage. The results obtained
with the proposed algorithm are additionally compared with a previously established algorithm for flying spot thermography based on the Sobel filter. It is shown that the proposed algorithm based on the Canny approach, can be used in automated systems for thermographic non-destructive testing.
Active thermography as a nondestructive testing modality suffers greatly from the limitations imposed by the diffusive nature of heat conduction in solids. As a rule of thumb, the detection and resolution of internal defects/inhomogeneities is limited to a defect depth to defect size ratio greater than or equal to one. Earlier, we demonstrated that this classical limit can be overcome for 1D and 2D defect geometries by using photothermal laser-scanning super resolution. In this work we report a new experimental approach using 2D spatially structured illumination patterns in conjunction with compressed sensing and computational imaging methods to significantly decrease the experimental complexity and make the method viable for investigating larger regions of interest.
Pulse-compression thermography is an emerging technique that has shown versatility by combination of pulsed and lock-in thermography. Accordingly, several aspects of this technique are still unexplored, and some others not fully developed yet. Barker codes were widely used in radar applications due to their simplicity and their optimum autocorrelation function. Nevertheless, applications were limited by the amplitude of the sidelobes present in the autocorrelation function and therefore, several filters have been developed which aim to reduce the sidelobes. However, the filters usually depend on empirical parameters which must be determined for each application. A better alternative would improve the applicability of the Barker codes. In this work, we further develop the pulse-compression thermography technique by introducing a 13-bit modified Barker code (mBC): This allows to drastically reduce the sidelobes characteristic of the 13-bit Barker code (BC). Consequently, the thermographic impulse response, obtained by cross-correlation, is almost free of such sidelobes. Deeper defects become easier to detect in comparison with using a 13-bit Barker code. Numerical simulations using the finite element method are used for comparison and experimental measurements are performed in a sample of steel grade St 37 with machined notches of three different depths: 2 mm, 4 mm and 6 mm.
We combine three different approaches to greatly enhance the defect reconstruction ability of active thermographic testing. As experimental approach, laser-based structured illumination is performed in a step-wise manner. As an intermediate signal processing step, the virtual wave concept is used in order to effectively convert the notoriously difficult to solve diffusion-based inverse problem into a somewhat milder wavebased inverse problem. As a final step, a compressed-sensing based optimization procedure is applied which efficiently solves the inverse problem by making advantage of the joint sparsity of multiple blind measurements. To evaluate our proposed processing technique, we investigate an additively manufactured stainless steel sample with eight internal defects. The concerted super resolution approach is compared to conventional thermographic reconstruction techniques and shows an at least four times better spatial resolution.
Thermographic super-resolution techniques allow the resolution of defects/inhomogeneities beyond the classical limit, which is governed by the diffusion properties of thermal wave propagation. Photothermal super-resolution is based on a combination of an experimental scanning strategy and a numerical optimization which has been proven to be superior to standard thermographic methods in the case of 1D linear defects. In this contribution, we report on the extension of this approach towards a full frame 2D photothermal super-resolution technique. The experimental approach is based on a repeated spatially structured heating using high power lasers. In a second post-processing step, several measurements are coherently combined using mathematical optimization and taking advantage of the (joint) sparsity of the defects in the sample. In our work we extend the possibilities of the method to efficiently detect and resolve defect cross sections with a fully 2D-structured blind illumination.
Classification of Spot-Welded Joints in Laser Thermography Data Using Convolutional Neural Networks
(2021)
Spot welding is a crucial process step in various industries. However, classification of spot welding quality is still a tedious process due to the complexity and sensitivity of the test material, which drain conventional approaches to its limits. In this article, we propose an approach for quality inspection of spot weldings using images from laser thermography data. We propose data preparation approaches based on the underlying physics of spot-welded joints, heated with pulsed laser thermography by analyzing the intensity over time and derive dedicated data filters to generate training datasets. Subsequently, we utilize convolutional neural networks to classify weld quality and compare the performance of different models against each other. We achieve competitive results in terms of classifying the different welding quality classes compared to traditional approaches, reaching an accuracy of more than 95 percent. Finally, we explore the effect of different augmentation methods.
Laser excited super resolution thermal imaging for nondestructive inspection of internal defects
(2020)
A photothermal super resolution technique is proposed for an improved inspection of internal defects. To evaluate the potential of the laser-based thermographic technique, an additively manufactured stainless steel specimen with closely spaced internal cavities is used. Four different experimental configurations in transmission, reflection, stepwise and continuous scanning are investigated. The applied image post-processing method is based on compressed sensing and makes use of the block sparsity from multiple measurement events. This concerted approach of experimental measurement strategy and numerical optimization enables the resolution of internal defects and outperforms conventional thermographic inspection techniques.
Crack detection in steel bars at high surface temperatures is a critical problem in any manufacturing industry. Surface breaking cracks are the major problems during the billet casting. Many NDT techniques are proven its capability in crack detection at room temperature. Here, we are demonstrating the possibility of exposure of cracks using laser line thermography at higher surface temperatures (up to 600 °C). A continuous-wave (CW) laser is used to excite the sample kept at higher surface temperatures. The temperature distribution over the sample due to the laser line scanning is captured using a temperature calibrated infrared (IR) thermal camera. The response of the sample temperature in crack detection is investigated using a validated FE model. The impact of the oxide layer in crack detection is investigated by using two types of samples; one without any oxide layer and the second is with the oxide layer. The influence of laser power in the detection of defects at high temperatures is studied. 3D numerical models were developed for the cases; when the sample is with oxide layer and without any oxide layer for a better understanding of physics. The surface temperature rise due to laser heating is higher for the scaled sample compared to the no-scale sample. The presence of the oxide layer above the parent metal will reduce the reflectivity of the surface. Lower reflectivity will lead to increased absorption of incident energy so that the surface temperature rise will be higher than the surface with no scale. Thermal contrast linearly depends on laser power, which means higher laser power will increase the defect detectability even at a higher surface temperature.
In this paper we propose super resolution measurement and post-processing strategies that can be applied in thermography using laser line scanning. The implementation of these techniques facilitates the separation of two closely spaced defects and avoids the expected deterioration of spatial resolution due to heat diffusion. The experimental studies were performed using a high-power laser as heat source in combination with pulsed thermography measurements (step scanning) or with continuous heating measurements (continuous scanning). Our work shows that laser line step scanning as well as continuous scanning both can be used within our developed super resolution (SR) techniques. Our SR techniques make use of a compressed sensing based algorithm in post- processing, the so-called iterative joint sparsity (IJOSP) approach. The IJOSP method benefits from both - the sparse nature of defects in space as well as from the similarity of each measurement. In addition, we show further methods to improve the reconstruction quality e.g. by simple manipulations in thermal image processing such as by considering the effect of the scanning motion or by using different optimization algorithms within the IJOSP approach. These super resolution image processing methods are discussed so that the advantages and disadvantages of each method can be extracted. Our contribution thus provides new approaches for the implementation of super resolution techniques in laser line scanning thermography and informs about which experimental and post-processing parameters should be chosen to better separate two closely spaced defects.
Thermographic reconstruction of defects that lie in the bulk of a sample is a difficult task because entropy production during heat diffusion leads to information loss. To reconstruct defects one has to solve an inverse heat conduction problem. The quality of the reconstruction is closely related to the information content of the observed data set that is reflected by the decreasing ability to spatially resolve a defect with growing defect depth. In this work we show a 2D reconstruction of rectangular slots with different width-to-depth ratios in a metallic sample. For this purpose, we apply the virtual wave concept and incorporate positivity and sparsity as prior information to overcome the diffusion-based information loss partially. The reconstruction is based on simulated and experimental pulse thermography data. In the first reconstruction step, we compute a virtual wave field from the surface temperature data. This allows us, in the second step, to use ultrasonic backpropagation methods for image reconstruction.
This paper presents different super resolution reconstruction techniques to overcome the spatial resolution limits in thermography. Pseudo-random blind structured illumination from a onedimensional laser array is used as heat source for super resolution thermography. Pulsed thermography measurements using an infrared camera with a high frame rate sampling lead to a huge amount of data. To handle this large data set, thermographic reconstruction techniques are an essential step of the overall reconstruction process. Four different thermographic reconstruction techniques are analyzed based on the Fourier transform amplitude, principal component analysis, virtual wave reconstruction and the maximum thermogram. The application of those methods results in a sparse basis representation of the measured data and serves as input for a compressed sensing based algorithm called iterative joint sparsity (IJOSP). Since the thermographic reconstruction techniques have a high influence on the result of the IJOSP algorithm, this paper Highlights their Advantages and disadvantages.
Crack detection in metallic samples at high surface temperature, hostile and hazardous environments, etc. is challenging situation in any manufacturing industries. Most of the present NDE methods are suitable only for lower surface temperatures, especially room temperature. In this situation, we need a fast and non-contact NDT method which can be applied even in high sample surface temperature. Laser thermography is one of the techniques having a high potential in non-contact inspection. As a preliminary investigation, in this article, we have studied the potentiality of laser line thermography in crack detection at room temperature. In laser line thermography, a continuous wave (CW) laser is used to generate a laser line, which in turn is used to scan the metal surface. The heat distribution over the sample surface is recorded by an infrared thermal (IR) camera. Two different approaches are reported in this work. Firstly, a stationary laser line source and its interaction with cracks; secondly, moving laser line source scanning over a surface with crack. When the distance between crack centre to laser line centre increases, crack detectability will decrease; and when laser power increases, crack detectability will increase. A dedicated image processing algorithm was developed to improve the detectability of the cracks. To understand the heat transfer phenomenon, a simplified 3D model for laser thermography was developed for the heat distribution during laser heating and was validated with experimental results. Defects were incorporated as a thermally thin resistive layer (TTRL) in numerical modeling, and the effect of TTRL in heat conduction is compared with experimental results.
Photothermal radiometry with an infrared camera allows the contactless temperature measurement of multiple surface pixels simultaneously. A short light pulse heats the sample. The heat propagates through the sample by diffusion and the corresponding temperature evolution is measured at the sample’s surface by an infrared camera. The main drawback in radiometric imaging is the loss of the spatial resolution with increasing depth due to heat diffusion, which results in blurred images for deeper lying structures. We circumvent this information loss due to the diffusion process by using blind structured illumination, combined with a non-linear joint sparsity reconstruction algorithm. The structured illumination is realized by parallel laser lines from a vertical-cavity surface-emitting laser (VCSEL) array controlled by a random binary pattern generator. By using 150 different patterns of structured illumination and our iterative joint sparsity algorithm, it was possible to resolve 1 mm thick lines at a distance down to 0.5 mm, which results in a resolution enhancement of approximately a factor of four compared to the resolution of 5.9 mm for homogenous illuminated thermographic reconstruction.
We report on photothermal detection of subsurface defects by coherent superposition of thermal wave fields. This is made possible by structured heating using high-power VCSEL laser arrays whose individual emitter groups can be arbitrarily controlled. In order to locate the defects, we have developed a scanning method based on the continuous wavelet transformation with complex Morlet wavelet using the destructive interference effect of thermal waves. This approach can also be used for thermally very fast and highly reflective materials such as uncoated aluminum. We show that subsurface defects at an aspect ratio of defect width to defect depth down to 1/3 are still detectable in this material.
In the field of optically excited thermography, flash lamps (impulse shaped planar heating) and halogen lamps (modulated planar heating) have become established for the specific regimes of impulse and lock-in thermography. Flying-spot laser thermography is implemented by means of a rasterized focused laser, e. g. for crack detection (continuous wave operation) and photothermal material characterization (high-frequency modulated). The availability of novel technologies, i. e. fast and high-resolution IR cameras, brilliant innovative light sources and high-performance data acquisition and processing technology will enable a paradigm shift from stand-alone photothermal and thermographic techniques to uniform quantitative measurement and testing technology that is faster and more precise. Similar to an LED array, but with irradiance two orders of magnitude higher, a new type of brilliant laser source, i. e. the VCSEL array (vertical-cavity surface-emitting laser), is now available. This novel optical energy source eliminates the strong limitation to the temporal dynamics of established light sources and at the same time is spectrally clearly separated from the detection wavelength. It combines the fast temporal behavior of a diode laser with the high optical irradiance and the wide illumination area of flash lamps. In addition, heating can also be carried out in a structured manner, because individual areas of the VCSEL array can be controlled independently of each other. This new degree of freedom enables the development of completely new thermographic NDT methods.
Using an infrared camera for radiometric imaging allows the contactless temperature measurement of multiple surface pixels simultaneously. From the measured surface data, a sub-surface structure, embedded inside a sample or tissue, can be reconstructed and imaged when heated by an excitation light pulse. The main drawback in radiometric imaging is the degradation of the spatial resolution with increasing depth, which results in blurred images for deeper lying structures. We circumvent this degradation with blind structured illumination, combined with a non-linear joint sparsity reconstruction algorithm. The ground-breaking concept of super-resolution can be transferred from optics to thermographic imaging.
Systematic errors in the evaluation of uncorrected data from thermographic lock-in measurements
(2018)
Lock-in thermography (LT) is based on the correct evaluation of phase differences between the temperature oscillations at different surface regions of the object under test during periodic heating. Since the usual heating procedures contain a DC component, the actual heating pattern achieved is not harmonic. This causes systematic deviations when phase differences are determined by means of harmonic analysis, e.g. with FFT analysis. The resulting errors depend clearly on the ratio between DC and AC amplitude, which is demonstrated at simulated and experimentally recorded temperature transients. Further experimental LT data obtained by different oscillating energy inputs showed a variety of possible shapes of transients with different DC components.
Among the photothermal methods, full-field thermal imaging is used to characterize materials, to determine thicknesses of layers, or to find inhomogeneities such as voids or cracks. The use of classical light sources such as flash lamps (impulse heating) or halogen lamps (modulated heating) led to a variety of nondestructive testing methods, in particular, lock-in and flash-thermography. In vertical-cavity surface-emitting lasers (VCSELs), laser light is emitted perpendicularly to the surface with a symmetrical beam profile. Due to the vertical structure, they can be arranged in large arrays of many thousands of individual lasers, which allows power scaling into the kilowatt range. Recently, a high-power yet very compact version of such a VCSEL-array became available that offers both the fast timing behavior of a laser as well as the large illumination area of a lamp. Moreover, it allows a spatial and temporal control of the heating because individual parts of the array can be controlled arbitrarily in frequency, amplitude, and phase. In conjunction with a fast infrared camera, such structured heating opens up a field of novel thermal imaging and testing methods. As a first demonstration of this approach, we chose a testing problem very challenging to conventional thermal infrared testing: The detection of very thin subsurface defects perpendicularly oriented to the surface of metallic samples. First, we generate destructively interfering thermal wave fields, which are then affected by the presence of defects within their reach. It turned out that this technique allows highly sensitive detection of subsurface defects down to depths in excess of the usual thermographic rule of thumb, with no need for a reference or surface preparation.