TY - JOUR A1 - Kästner, L. A1 - Ahmadi, Samim A1 - Jonietz, Florian A1 - Jung, P. A1 - Caire, G. A1 - Ziegler, Mathias A1 - Lambrecht, J. T1 - Classification of Spot-Welded Joints in Laser Thermography Data Using Convolutional Neural Networks N2 - Spot welding is a crucial process step in various industries. However, classification of spot welding quality is still a tedious process due to the complexity and sensitivity of the test material, which drain conventional approaches to its limits. In this article, we propose an approach for quality inspection of spot weldings using images from laser thermography data. We propose data preparation approaches based on the underlying physics of spot-welded joints, heated with pulsed laser thermography by analyzing the intensity over time and derive dedicated data filters to generate training datasets. Subsequently, we utilize convolutional neural networks to classify weld quality and compare the performance of different models against each other. We achieve competitive results in terms of classifying the different welding quality classes compared to traditional approaches, reaching an accuracy of more than 95 percent. Finally, we explore the effect of different augmentation methods. KW - Active thermal imaging KW - Laser thermography KW - Spot-welded joints KW - Convolutional neural network KW - Classification KW - Data processing PY - 2021 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-524216 DO - https://doi.org/10.1109/ACCESS.2021.3063672 VL - 9 SP - 48303 EP - 48312 AN - OPUS4-52421 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - INPR A1 - Ahmadi, Samim A1 - Kästner, L. A1 - Hauffen, Jan Christian A1 - Jung, P. A1 - Ziegler, Mathias T1 - Photothermal-SR-Net: A customized deep unfolding neural network for photothermal super resolution imaging N2 - This paper presents deep unfolding neural networks to handle inverse problems in photothermal radiometry enabling super resolution (SR) imaging. Photothermal imaging is a well-known technique in active thermography for nondestructive inspection of defects in materials such as metals or composites. A grand challenge of active thermography is to overcome the spatial resolution limitation imposed by heat diffusion in order to accurately resolve each defect. The photothermal SR approach enables to extract high-frequency spatial components based on the deconvolution with the thermal point spread function. However, stable deconvolution can only be achieved by using the sparse structure of defect patterns, which often requires tedious, hand-crafted tuning of hyperparameters and results in computationally intensive algorithms. On this account, Photothermal-SR-Net is proposed in this paper, which performs deconvolution by deep unfolding considering the underlying physics. This enables to super resolve 2D thermal images for nondestructive testing with a substantially improved convergence rate. Since defects appear sparsely in materials, Photothermal-SR-Net applies trained blocksparsity thresholding to the acquired thermal images in each convolutional layer. The performance of the proposed approach is evaluated and discussed using various deep unfolding and thresholding approaches applied to 2D thermal images. Subsequently, studies are conducted on how to increase the reconstruction quality and the computational performance of Photothermal-SR-Net is evaluated. Thereby, it was found that the computing time for creating high-resolution images could be significantly reduced without decreasing the reconstruction quality by using pixel binning as a preprocessing step. KW - Photothermal super resolution KW - Nondestructive testing KW - Deep unfolding KW - Deep learning KW - Deep imaging KW - Physics-based deep learning KW - Laser thermography KW - Elastic net KW - Iterative shrinkage thresholding algorithm PY - 2021 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-525371 DO - https://doi.org/10.48550/arXiv.2104.10563 SN - 2331-8422 SP - 1 EP - 10 PB - Cornell University CY - Ithaca, NY AN - OPUS4-52537 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Hauffen, J. C. A1 - Kästner, L. A1 - Ahmadi, Samim A1 - Jung, P. A1 - Caire, G. A1 - Ziegler, Mathias T1 - Learned block iterative shrinkage thresholding algorithm for photothermal super resolution imaging N2 - Block-sparse regularization is already well known in active thermal imaging and is used for multiple-measurement-based inverse problems. The main bottleneck of this method is the choice of regularization parameters which differs for each experiment. We show the benefits of using a learned block iterative shrinkage thresholding algorithm (LBISTA) that is able to learn the choice of regularization parameters, without the need to manually select them. In addition, LBISTA enables the determination of a suitable weight matrix to solve the underlying inverse problem. Therefore, in this paper we present LBISTA and compare it with state-of-the-art block iterative shrinkage thresholding using synthetically generated and experimental test data from active thermography for defect reconstruction. Our results show that the use of the learned block-sparse optimization approach provides smaller normalized mean square errors for a small fixed number of iterations. Thus, this allows us to improve the convergence speed and only needs a few iterations to generate accurate defect reconstruction in photothermal super-resolution imaging. KW - Thermography KW - Laser KW - Machine learning KW - Optimization KW - Non-destructive testing KW - NDT KW - Neural network KW - Defect reconstruction KW - Block-sparsity KW - Active thermal imaging KW - Regularization KW - Laser thermography PY - 2022 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-554598 DO - https://doi.org/10.3390/s22155533 SN - 1424-8220 VL - 22 IS - 15 SP - 1 EP - 15 PB - MDPI CY - Basel AN - OPUS4-55459 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER -