TY - JOUR A1 - Ahmadi, Samim A1 - Kästner, L. A1 - Hauffen, Jan Christian A1 - Jung, P. A1 - Ziegler, Mathias T1 - Photothermal-SR-Net: A Customized Deep Unfolding Neural Network for Photothermal Super Resolution Imaging JF - IEEE Transactions on Instrumentation and Measurement N2 - This article presents deep unfolding neural networks to handle inverse problems in photothermal radiometry enabling super-resolution (SR) imaging. The photothermal SR approach is a well-known technique to overcome the spatial resolution limitation in photothermal imaging by extracting high-frequency spatial components based on the deconvolution with the thermal point spread function (PSF). However, stable deconvolution can only be achieved by using the sparse structure of defect patterns, which often requires tedious, handcrafted tuning of hyperparameters and results in computationally intensive algorithms. On this account, this article proposes Photothermal-SR-Net, which performs deconvolution by deep unfolding considering the underlying physics. Since defects appear sparsely in materials, our approach includes trained block-sparsity thresholding in each convolutional layer. This enables to super-resolve 2-D thermal images for nondestructive testing (NDT) with a substantially improved convergence rate compared to classic approaches. The performance of the proposed approach is evaluated on various deep unfolding and thresholding approaches. Furthermore, we explored how to increase the reconstruction quality and the computational performance. Thereby, it was found that the computing time for creating high-resolution images could be significantly reduced without decreasing the reconstruction quality by using pixel binning as a preprocessing step. KW - Deep unfolding KW - Defect reconstruction KW - Elastic net KW - Inverse problems KW - Iterative shrinkage thresholding KW - Neural network KW - Nondestructive testing (NDT) KW - Photothermal imaging KW - Super resolution (SR) KW - Thermography PY - 2022 DO - https://doi.org/10.1109/tim.2022.3154803 SN - 1557-9662 VL - 71 SP - 1 EP - 9 PB - IEEE AN - OPUS4-54678 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Ahmadi, Samim A1 - Thummerer, G. A1 - Breitwieser, S. A1 - Mayr, G. A1 - Lecompagnon, Julien A1 - Burgholzer, P. A1 - Jung, P. A1 - Caire, G. A1 - Ziegler, Mathias T1 - Multi-dimensional reconstruction of internal defects in additively manufactured steel using photothermal super resolution combined with virtual wave based image processing JF - IEEE transactions on industrial informatics N2 - We combine three different approaches to greatly enhance the defect reconstruction ability of active thermographic testing. As experimental approach, laser-based structured illumination is performed in a step-wise manner. As an intermediate signal processing step, the virtual wave concept is used in order to effectively convert the notoriously difficult to solve diffusion-based inverse problem into a somewhat milder wavebased inverse problem. As a final step, a compressed-sensing based optimization procedure is applied which efficiently solves the inverse problem by making advantage of the joint sparsity of multiple blind measurements. To evaluate our proposed processing technique, we investigate an additively manufactured stainless steel sample with eight internal defects. The concerted super resolution approach is compared to conventional thermographic reconstruction techniques and shows an at least four times better spatial resolution. KW - Active thermography KW - Additive manufacturing KW - Stainless steel KW - ADMM KW - Block regularization KW - Internal defects KW - Joint sparsity KW - Laser excitation KW - Multi-dimensional reconstruction KW - Photothermal super resolution KW - Virtual waves PY - 2021 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-525330 DO - https://doi.org/10.1109/tii.2021.3054411 SN - 1551-3203 SN - 1941-0050 VL - 17 IS - 11 SP - 7368 EP - 7378 PB - IEEE CY - New York, NY AN - OPUS4-52533 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Hauffen, J. C. A1 - Kästner, L. A1 - Ahmadi, Samim A1 - Jung, P. A1 - Caire, G. A1 - Ziegler, Mathias T1 - Learned block iterative shrinkage thresholding algorithm for photothermal super resolution imaging JF - Sensors N2 - Block-sparse regularization is already well known in active thermal imaging and is used for multiple-measurement-based inverse problems. The main bottleneck of this method is the choice of regularization parameters which differs for each experiment. We show the benefits of using a learned block iterative shrinkage thresholding algorithm (LBISTA) that is able to learn the choice of regularization parameters, without the need to manually select them. In addition, LBISTA enables the determination of a suitable weight matrix to solve the underlying inverse problem. Therefore, in this paper we present LBISTA and compare it with state-of-the-art block iterative shrinkage thresholding using synthetically generated and experimental test data from active thermography for defect reconstruction. Our results show that the use of the learned block-sparse optimization approach provides smaller normalized mean square errors for a small fixed number of iterations. Thus, this allows us to improve the convergence speed and only needs a few iterations to generate accurate defect reconstruction in photothermal super-resolution imaging. KW - Thermography KW - Laser KW - Machine learning KW - Optimization KW - Non-destructive testing KW - NDT KW - Neural network KW - Defect reconstruction KW - Block-sparsity KW - Active thermal imaging KW - Regularization KW - Laser thermography PY - 2022 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-554598 DO - https://doi.org/10.3390/s22155533 SN - 1424-8220 VL - 22 IS - 15 SP - 1 EP - 15 PB - MDPI CY - Basel AN - OPUS4-55459 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Burgholzer, P. A1 - Berer, T. A1 - Ziegler, Mathias A1 - Thiel, Erik A1 - Ahmadi, Samim A1 - Gruber, J. A1 - Mayr, G. A1 - Hendorfer, G. T1 - Blind structured illumination as excitation for super-resolution photothermal radiometry JF - Quantitative InfraRed Thermography Journal N2 - Photothermal radiometry with an infrared camera allows the contactless temperature measurement of multiple surface pixels simultaneously. A short light pulse heats the sample. The heat propagates through the sample by diffusion and the corresponding temperature evolution is measured at the sample’s surface by an infrared camera. The main drawback in radiometric imaging is the loss of the spatial resolution with increasing depth due to heat diffusion, which results in blurred images for deeper lying structures. We circumvent this information loss due to the diffusion process by using blind structured illumination, combined with a non-linear joint sparsity reconstruction algorithm. The structured illumination is realized by parallel laser lines from a vertical-cavity surface-emitting laser (VCSEL) array controlled by a random binary pattern generator. By using 150 different patterns of structured illumination and our iterative joint sparsity algorithm, it was possible to resolve 1 mm thick lines at a distance down to 0.5 mm, which results in a resolution enhancement of approximately a factor of four compared to the resolution of 5.9 mm for homogenous illuminated thermographic reconstruction. KW - Super-resolution imaging KW - Thermography KW - Blind structured illumination KW - VCSEL array PY - 2019 DO - https://doi.org/10.1080/17686733.2019.1655247 SN - 1768-6733 VL - 17 IS - 4 SP - 268 EP - 278 PB - Taylor & Francis Group CY - Milton, UK AN - OPUS4-49122 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Ahmadi, Samim A1 - Burgholzer, P. A1 - Jung, P. A1 - Caire, G. A1 - Ziegler, Mathias T1 - Super resolution laser line scanning thermography JF - Optics and Lasers in Engineering N2 - In this paper we propose super resolution measurement and post-processing strategies that can be applied in thermography using laser line scanning. The implementation of these techniques facilitates the separation of two closely spaced defects and avoids the expected deterioration of spatial resolution due to heat diffusion. The experimental studies were performed using a high-power laser as heat source in combination with pulsed thermography measurements (step scanning) or with continuous heating measurements (continuous scanning). Our work shows that laser line step scanning as well as continuous scanning both can be used within our developed super resolution (SR) techniques. Our SR techniques make use of a compressed sensing based algorithm in post- processing, the so-called iterative joint sparsity (IJOSP) approach. The IJOSP method benefits from both - the sparse nature of defects in space as well as from the similarity of each measurement. In addition, we show further methods to improve the reconstruction quality e.g. by simple manipulations in thermal image processing such as by considering the effect of the scanning motion or by using different optimization algorithms within the IJOSP approach. These super resolution image processing methods are discussed so that the advantages and disadvantages of each method can be extracted. Our contribution thus provides new approaches for the implementation of super resolution techniques in laser line scanning thermography and informs about which experimental and post-processing parameters should be chosen to better separate two closely spaced defects. KW - Super resolution KW - Laser thermography KW - Compressed sensing KW - Laser scanning KW - Joint sparsity PY - 2020 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-509796 DO - https://doi.org/10.1016/j.optlaseng.2020.106279 SN - 0143-8166 VL - 134 SP - 106279 PB - Elsevier Ltd. AN - OPUS4-50979 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Ahmadi, Samim A1 - Burgholzer, P. A1 - Mayr, G. A1 - Jung, P. A1 - Caire, G. A1 - Ziegler, Mathias T1 - Photothermal super resolution imaging: A comparison of different thermographic reconstruction techniques JF - Nondestructive Testing & Evaluation International N2 - This paper presents different super resolution reconstruction techniques to overcome the spatial resolution limits in thermography. Pseudo-random blind structured illumination from a onedimensional laser array is used as heat source for super resolution thermography. Pulsed thermography measurements using an infrared camera with a high frame rate sampling lead to a huge amount of data. To handle this large data set, thermographic reconstruction techniques are an essential step of the overall reconstruction process. Four different thermographic reconstruction techniques are analyzed based on the Fourier transform amplitude, principal component analysis, virtual wave reconstruction and the maximum thermogram. The application of those methods results in a sparse basis representation of the measured data and serves as input for a compressed sensing based algorithm called iterative joint sparsity (IJOSP). Since the thermographic reconstruction techniques have a high influence on the result of the IJOSP algorithm, this paper Highlights their Advantages and disadvantages. KW - Super resolution KW - Compressed sensing KW - Laser thermography KW - Virtual wave KW - Defect reconstruction PY - 2020 DO - https://doi.org/10.1016/j.ndteint.2020.102228 VL - 111 SP - 2228 PB - Elsevier Ltd. CY - Netherlands AN - OPUS4-50419 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Kästner, L. A1 - Ahmadi, Samim A1 - Jonietz, Florian A1 - Jung, P. A1 - Caire, G. A1 - Ziegler, Mathias A1 - Lambrecht, J. T1 - Classification of Spot-Welded Joints in Laser Thermography Data Using Convolutional Neural Networks JF - IEEE Access N2 - Spot welding is a crucial process step in various industries. However, classification of spot welding quality is still a tedious process due to the complexity and sensitivity of the test material, which drain conventional approaches to its limits. In this article, we propose an approach for quality inspection of spot weldings using images from laser thermography data. We propose data preparation approaches based on the underlying physics of spot-welded joints, heated with pulsed laser thermography by analyzing the intensity over time and derive dedicated data filters to generate training datasets. Subsequently, we utilize convolutional neural networks to classify weld quality and compare the performance of different models against each other. We achieve competitive results in terms of classifying the different welding quality classes compared to traditional approaches, reaching an accuracy of more than 95 percent. Finally, we explore the effect of different augmentation methods. KW - Active thermal imaging KW - Laser thermography KW - Spot-welded joints KW - Convolutional neural network KW - Classification KW - Data processing PY - 2021 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-524216 DO - https://doi.org/10.1109/ACCESS.2021.3063672 VL - 9 SP - 48303 EP - 48312 AN - OPUS4-52421 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Ahmadi, Samim A1 - Lecompagnon, Julien A1 - Hirsch, Philipp Daniel A1 - Burgholzer, P. A1 - Jung, P. A1 - Caire, G. A1 - Ziegler, Mathias T1 - Laser excited super resolution thermal imaging for nondestructive inspection of internal defects JF - Scientific Reports N2 - A photothermal super resolution technique is proposed for an improved inspection of internal defects. To evaluate the potential of the laser-based thermographic technique, an additively manufactured stainless steel specimen with closely spaced internal cavities is used. Four different experimental configurations in transmission, reflection, stepwise and continuous scanning are investigated. The applied image post-processing method is based on compressed sensing and makes use of the block sparsity from multiple measurement events. This concerted approach of experimental measurement strategy and numerical optimization enables the resolution of internal defects and outperforms conventional thermographic inspection techniques. KW - Super Resolution KW - Laser Thermography KW - Non Destructive Testing KW - Comressed Sensing KW - Inverse Problem KW - Thermography PY - 2020 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-519016 DO - https://doi.org/10.1038/s41598-020-77979-y VL - 10 IS - 1 SP - 22357 PB - Springer Nature AN - OPUS4-51901 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Lecompagnon, Julien A1 - Ahmadi, Samim A1 - Hirsch, Philipp Daniel A1 - Rupprecht, C. A1 - Ziegler, Mathias T1 - Thermographic detection of internal defects using 2D photothermal super resolution reconstruction with sequential laser heating JF - Journal of Applied Physics N2 - Thermographic photothermal super resolution reconstruction enables the resolution of internal defects/inhomogeneities below the classical limit, which is governed by the diffusion properties of thermal wave propagation. Based on a combination of the application of special sampling strategies and a subsequent numerical optimization step in post-processing, thermographic super resolution has already proven to be superior to standard thermographic methods in the detection of one-dimensional defect/inhomogeneity structures. In our work, we report an extension of the capabilities of the method for efficient detection and resolution of defect cross sections with fully two-dimensional structured laser-based heating. The reconstruction is carried out using one of two different algorithms that are proposed within this work. Both algorithms utilize the combination of several coherent measurements using convex optimization and exploit the sparse nature of defects/inhomogeneities as is typical for most nondestructive testing scenarios. Finally, the performance of each algorithm is rated on reconstruction quality and algorithmic complexity. The presented experimental approach is based on repeated spatially structured heating by a high power laser. As a result, a two-dimensional sparse defect/inhomogeneity map can be obtained. In addition, the obtained results are compared with those of conventional thermographic inspection methods that make use of homogeneous illumination. Due to the sparse nature of the reconstructed defect/inhomogeneity map, this comparison is performed qualitatively. KW - Thermography KW - Super resolution KW - NDT KW - Inspection KW - Internal defects PY - 2022 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-548351 DO - https://doi.org/10.1063/5.0088102 SN - 1089-7550 VL - 131 IS - 18 SP - 1 EP - 12 PB - AIP Publishing AN - OPUS4-54835 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER -