TY - CONF A1 - Oster, Simon T1 - From Thermographic In-situ Monitoring to Porosity Detection – A Deep Learning Framework for Quality Control in Laser Powder Bed Fusion N2 - In this study, we present an enhanced deep learning framework for the prediction of porosity based on thermographic in-situ monitoring data of laser powder bed fusion processes. The manufacturing of two cuboid specimens from Haynes 282 (Ni-based alloy) powder was monitored by a short-wave infrared camera. We use thermogram feature data and x-ray computed tomography data to train a convolutional neural network classifier. The classifier is used to perform a multi-class prediction of the spatially resolved porosity level in small sub-volumes of the specimen bulk. T2 - Sensor and Measurement Science International CY - Nurnberg, Germany DA - 08.05.2023 KW - Laser powder bed fusion KW - In-situ monitoring KW - Thermography KW - Machine Learning KW - Porosity PY - 2023 AN - OPUS4-57614 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - CONF A1 - Oster, Simon T1 - Potentials and challenges of deep-learning-assisted porosity prediction based on thermographic in-situ monitoring in PBF-LB/M N2 - Laser powder bed fusion is one of the most promising additive manufacturing techniques for printing complex-shaped metal components. However, the formation of subsurface porosity poses a significant risk to the service lifetime of the printed parts. In-situ monitoring offers the possibility to detect porosity already during manufacturing. Thereby, process feedback control or a manual process interruption to cut financial losses is enabled. Short-wave infrared thermography can monitor the thermal history of manufactured parts which is closely connected to the probability of porosity formation. Artificial intelligence methods are increasingly used for porosity prediction from the obtained large amounts of complex monitoring data. In this study, we aim to identify the potential and the challenges of deep-learning-assisted porosity prediction based on thermographic in-situ monitoring. Therefore, the porosity prediction task is studied in detail using an exemplary dataset from the manufacturing of two Haynes282 cuboid components. Our trained 1D convolutional neural network model shows high performance (R2 score of 0.90) for the prediction of local porosity in discrete sub-volumes with dimensions of (700 x 700 x 40) μm³. It could be demonstrated that the regressor correctly predicts layer-wise porosity changes but presumably has limited capability to predict differences in local porosity. Furthermore, there is a need to study the significance of the used thermogram feature inputs to streamline the model and to adjust the monitoring hardware. Moreover, we identified multiple sources of data uncertainty resulting from the in-situ monitoring setup, the registration with the ground truth X-ray-computed tomography data and the used pre-processing workflow that might influence the model’s performance detrimentally. T2 - XXXVII. Messtechnisches Symposium 2023 CY - Freiburg im Breisgau, Germany DA - 27.09.2023 KW - Porosity prediction KW - Defect detection KW - Laser Powder Bed Fusion (PBF-LB/M, L-PBF) KW - Selective Laser Melting KW - Thermography KW - Machine Learning PY - 2023 AN - OPUS4-59192 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - CONF A1 - Oster, Simon T1 - Machine Learning based defect detection in Laser Powder Bed Fusion utilizing thermographic feature data N2 - The formation of irregularities such as keyhole porosity pose a major challenge to the manufacturing of metal parts by laser powder bed fusion (PBF-LB/M). In-situ thermography as a process monitoring technique shows promising potential in this manner since it is able to extract the thermal history of the part which is closely related to the formation of irregularities. In this study, we investigate the utilization of machine learning algorithms to detect keyhole porosity on the base of thermographic features. Here, as a referential technique, x-ray micro computed tomography is utilized to determine the part's porosity. An enhanced preprocessing workflow inspired by the physics of the keyhole irregularity formation is presented in combination with a customized model architecture. Furthermore, experiments were performed to clarify the role of important parameters of the preprocessing workflow for the task of defect detection . Based on the results, future demands on irregularity prediction in PBF-LB/M are derived. T2 - International Conference on NDE 4.0 CY - Berlin, Germany DA - 24.10.2022 KW - Laser Powder Bed Fusion KW - Thermography KW - In-situ Monitoring KW - Convolutional Neural Networks PY - 2022 AN - OPUS4-56332 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - CONF A1 - Oster, Simon T1 - A comparison of machine learning approaches for porosity prediction in PBF-LB/M based on thermography N2 - Metal-based additive manufacturing processes are increasingly used in industry to produce complex-shaped components. In this regard, the laser-based Powder Bed Fusion process (PBF-LB/M) is one of the key technologies due to its capability to produce components in high spatial accuracy. The formation of porosity during manufacturing poses a serious risk to the safety of the printed parts. For quality assessment, in-situ monitoring technologies such as thermography can be used to capture the thermal history during production. It was shown that discontinuities within the thermal history can be correlated with the probability of porosity or defect formation. In this context, Machine Learning (ML) algorithms have achieved promising results for the task of porosity prediction based on thermographic in-situ monitoring data. One important technique is the use of thermogram features for porosity prediction that are extracted from the raw data (e.g., features related to the melt pool geometry or spatter generation). However, the reduction from large thermogram data to discrete features holds the risk of losing potentially important thermal information and, thereby, introducing bias in the model. Therefore, we present a raw data-based deep learning approach that uses thermographic image sequences for the prediction of local porosity. The model takes advantage of the self-attention mechanism that considers not only the thermogram information but also its positional context within the sequence. The model is used to predict porosity in the form of a many-to-one regression. It is trained and tested on a dataset retrieved from the manufacturing of HAYNES282 cuboid specimens. The model results are compared against state-of-the-art thermogram feature-based ML models and artificial neural networks. The raw data model outperforms its feature-based counterparts in terms of prediction scores and, therefore, seems to make better use of the information available in the thermogram data. T2 - 4th Symposium on Materials and Additive Manufacturing CY - Berlin, Germany DA - 12.06.2024 KW - PBF-LB/M KW - In situ monitoring KW - Thermography KW - Additive Manufacturing KW - Machine learning KW - Porosity prediction PY - 2024 AN - OPUS4-62472 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - CONF A1 - Oster, Simon T1 - Defect prediction on the Base of Thermographic features in Laser Powder Bed Fusion Utilizing Machine Learning Algorithms N2 - Avoiding the formation of defects such as keyhole pores is a major challenge for the production of metal parts by Laser Powder Bed Fusion (LPBF). The use of in-situ monitoring by thermographic cameras is a promising approach to detect defects, however the data is hard to analyze by conventional algorithms. Therefore, we investigate the use of Machine Learning (ML) in this study, as it is a suitable tool to model complex processes with many influencing factors. A ML model for defect prediction is created based on features extracted from process thermograms. The porosity information calculated from an x-ray Micro Computed Tomography (µCT) scan is used as reference. Physical characteristics of the keyhole pore formation are incorporated into the model to increase the prediction accuracy. Based on the prediction result, the quality of the input data is inferred and future demands on in-situ monitoring of LPBF processes are derived. T2 - Additive Manufacturing Benchmarks 2022 CY - Bethesda, MA, USA DA - 14.08.2022 KW - Laser Powder Bed Fusion KW - Thermography KW - In-situ Monitoring KW - Machine Learning KW - Defect prediction PY - 2022 AN - OPUS4-55591 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - CONF A1 - Oster, Simon T1 - Investigation of the thermal history of L-PBF metal parts by feature extraction from in-situ SWIR thermography N2 - Laser powder bed fusion is used to create near net shape metal parts with a high degree of freedom in geometry design. When it comes to the production of safety critical components, a strict quality assurance is mandatory. An alternative to cost-intensive non-destructive testing of the produced parts is the utilization of in-situ process monitoring techniques. The formation of defects is linked to deviations of the local thermal history of the part from standard conditions. Therefore, one of the most promising monitoring techniques in additive manufacturing is thermography. In this study, features extracted from thermographic data are utilized to investigate the thermal history of cylindrical metal parts. The influence of process parameters, part geometry and scan strategy on the local heat distribution and on the resulting part porosity are presented. The suitability of the extracted features for in-situ process monitoring is discussed. T2 - Thermosense: Thermal Infrared Applications XLIII CY - Online meeting DA - 12.04.2021 KW - SWIR camera KW - Additive manufacturing (AM) KW - Selective laser melting (SLM) KW - Laser beam melting (LBM) KW - In-situ monitoring KW - Infrared thermography PY - 2021 UR - https://www.spiedigitallibrary.org/conference-proceedings-of-spie/11743/117430C/Investigation-of-the-thermal-history-of-L-PBF-metal-parts/10.1117/12.2587913.short?SSO=1&tab=ArticleLink AN - OPUS4-52540 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - CONF A1 - Oster, Simon T1 - Defect prediction in laser powder bed fusion based on thermographic features utilizing convolutional neural networks N2 - The appearance of irregularities such as keyhole porosity is a major challenge for the production of metal parts by laser powder bed fusion (PBF-LB/M). The utilization of thermographic in-situ monitoring is a promising approach to extract the thermal history which is closely related to the formation of irregularities. In this study, we investigate the utilization of convolutional neural networks to predict keyhole porosity based on thermographic features. Here, the porosity information calculated from an x-ray micro computed tomography scan is used as reference. Feature engineering is performed to enable the model to learn the complex physical characteristics of the porosity formation. The model is examined with regard to the choice of hyperparameters, the significance of thermal features and characteristics of the data acquisition. Based on the results, future demands on irregularity prediction in PBF-LB/M are derived. T2 - GIMC SIMAI YOUNG 2022 CY - Pavia, Italy DA - 29.09.2022 KW - Laser Powder Bed Fusion KW - Thermography KW - In-situ Monitoring KW - Convolutional Neural Networks PY - 2022 AN - OPUS4-56331 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Oster, Simon A1 - Breese, Philipp Peter A1 - Ulbricht, Alexander A1 - Mohr, Gunther A1 - Altenburg, Simon T1 - A deep learning framework for defect prediction based on thermographic in-situmonitoring in laser powder bed fusion N2 - The prediction of porosity is a crucial task for metal based additive manufacturing techniques such as laser powder bed fusion. Short wave infrared thermography as an in-situ monitoring tool enables the measurement of the surface radiosity during the laser exposure. Based on the thermogram data, the thermal history of the component can be reconstructed which is closely related to the resulting mechanical properties and to the formation of porosity in the part. In this study, we present a novel framework for the local prediction of porosity based on extracted features from thermogram data. The framework consists of a data pre-processing workflow and a supervised deep learning classifier architecture. The data pre-processing workflow generates samples from thermogram feature data by including feature information from multiple subsequent layers. Thereby, the prediction of the occurrence of complex process phenomena such as keyhole pores is enabled. A custom convolutional neural network model is used for classification. Themodel is trained and tested on a dataset from thermographic in-situ monitoring of the manufacturing of an AISI 316L stainless steel test component. The impact of the pre-processing parameters and the local void distribution on the classification performance is studied in detail. The presented model achieves an accuracy of 0.96 and an f1-Score of 0.86 for predicting keyhole porosity in small sub-volumes with a dimension of (700 × 700 × 50) μm3. Furthermore, we show that pre-processing parameters such as the porosity threshold for sample labeling and the number of included subsequent layers are influential for the model performance. Moreover, the model prediction is shown to be sensitive to local porosity changes although it is trained on binary labeled data that disregards the actual sample porosity. KW - Laser Powder Bed Fusion (PBF-LB/M, L-PBF) KW - Selective Laser Melting (SLM) KW - SWIR thermography KW - Online monitoring KW - Flaw detection KW - Machine learning KW - Convolutional neural networks (CNN) PY - 2023 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-575148 DO - https://doi.org/10.1007/s10845-023-02117-0 SN - 0956-5515 SP - 1 EP - 20 PB - Springer AN - OPUS4-57514 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Oster, Simon A1 - Fritsch, Tobias A1 - Ulbricht, Alexander A1 - Mohr, Gunther A1 - Bruno, Giovanni A1 - Maierhofer, Christiane A1 - Altenburg, Simon T1 - On the Registration of Thermographic In Situ Monitoring Data and Computed Tomography Reference Data in the Scope of Defect Prediction in Laser Powder Bed Fusion N2 - The detection of internal irregularities is crucial for quality assessment in metal-based additive manufacturing (AM) technologies such as laser powder bed fusion (L-PBF). The utilization of in-process thermography as an in situ monitoring tool in combination with post-process X-ray micro computed tomography (XCT) as a reference technique has shown great potential for this aim. Due to the small irregularity dimensions, a precise registration of the datasets is necessary as a requirement for correlation. In this study, the registration of thermography and XCT reference datasets of a cylindric specimen containing keyhole pores is carried out for the development of a porosity prediction model. The considered datasets show variations in shape, data type and dimensionality, especially due to shrinkage and material elevation effects present in the manufactured part. Since the resulting deformations are challenging for registration, a novel preprocessing methodology is introduced that involves an adaptive volume adjustment algorithm which is based on the porosity distribution in the specimen. Thus, the implementation of a simple three-dimensional image-to-image registration is enabled. The results demonstrate the influence of the part deformation on the resulting porosity location and the importance of registration in terms of irregularity prediction. KW - Selective laser melting (SLM) KW - Laser powder bed fusion (L-PBF) KW - Additive manufacturing (AM) KW - Process monitoring KW - Infrared thermography KW - X-ray computed tomography (XCT) KW - Defect detection KW - Image registration PY - 2022 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-549412 DO - https://doi.org/10.3390/met12060947 VL - 12 IS - 6 SP - 1 EP - 21 PB - MDPI AN - OPUS4-54941 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - CONF A1 - Oster, Simon A1 - Maierhofer, Christiane A1 - Mohr, Gunther A1 - Hilgenberg, Kai A1 - Ulbricht, Alexander A1 - Altenburg, Simon T1 - Investigation of the thermal history of L-PBF metal parts by feature extraction from in-situ SWIR thermography N2 - Laser powder bed fusion is used to create near net shape metal parts with a high degree of freedom in geometry design. When it comes to the production of safety critical components, a strict quality assurance is mandatory. An alternative to cost-intensive non-destructive testing of the produced parts is the utilization of in-situ process monitoring techniques. The formation of defects is linked to deviations of the local thermal history of the part from standard conditions. Therefore, one of the most promising monitoring techniques in additive manufacturing is thermography. In this study, features extracted from thermographic data are utilized to investigate the thermal history of cylindrical metal parts. The influence of process parameters, part geometry and scan strategy on the local heat distribution and on the resulting part porosity are presented. The suitability of the extracted features for in-situ process monitoring is discussed. T2 - Thermosense: Thermal Infrared Applications XLIII CY - Online meeting DA - 12.04.2021 KW - SWIR camera KW - Additive manufacturing (AM) KW - Selective laser melting (SLM) KW - Laser beam melting (LBM) KW - In-situ monitoring KW - Infrared thermography PY - 2021 SN - 978-1-5106-4324-6 DO - https://doi.org/10.1117/12.2587913 VL - 11743 SP - 1 EP - 11 PB - SPIE - The international society for optics and photonics AN - OPUS4-52535 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER -