Context-Aware Fault Diagnosis in Smart Manufacturing

  • The manufacturing industry is undergoing a transformation marked by the emergence of Industry 4.0 and Industry 5.0 paradigms, which are characterized by the integration and automation of machinery. Thereby, the machinery evolves into Cyber-Physical Systems (CPSs). These CPSs consist of software and hardware modules implementing complex manufacturing processes. The ongoing integration of machinery, and external technologies, e.g., the Industrial Internet of Things (IIoT), led to an evolving Smart Manufacturing (SM) environment. At the same time, legacy machinery, the brownfield machinery, exists side-by-side with modern CPSs. The brownfield machinery might be integrated by retrofitting in the modern manufacturing process. Therefore, the evolution of the SM domain thriven by the Industry 4.0 and Industry 5.0 paradigms leads to a more complex SM environment. Moreover, the integration and ongoing adaption of technologies and processes introduce novel relationships and dependencies between employed machinery and systems. Fault Diagnosis (FD) in such a complex SM environment becomes more time-consuming and laborious. A side effect of the ongoing evolution is the advancing capabilities of the machinery and the ability to produce data. Therewith, not only complex data has to be analyzed during any FD but also vast quantities. The search for the origin of the fault is challenging. Additionally, technical challenges in the SM environment hinder a thorough FD. For instance, the available bandwidth for data transmission is unequal to the capabilities of the machinery to produce vast data quantities. Therefore, the application challenge exists to focus on specific areas of the SM environment while choosing a reasonable granularity in data surveillance to cover the fault traces without losing too much information. Thereby, any FD depends heavily on the domain knowledge of the professionals entrusted with the FD task. On top, there is also economic pressure, which raises the tension on the employed professionals as an unexpected downtime, and the loss in production quantity equals the economic loss. The thesis introduces context-aware FD to mitigate the risen complexity of the SM environment and support the professionals in their work. By supporting the professionals, the time for FD can be reduced, which results in faster fault amendment and reduced cost-intensive production downtimes. The Context-Aware Diagnosis in Smart Manufacturing (TAOISM) Visual Analytics (VA) model backs the context-aware FD. The TAOISM VA model is the theoretical foundation for the context-aware FD and defines the data layer, the models layer, the visualization layer, and the knowledge layer for SM. Hereby, the VA model enables the definition of context, context models, and context hierarchies for their integration in the respective layers. The main idea behind the context-aware FD is to use the narrowing character of the context definition to slice vast amounts of data into manageable context-separated data groups. Thereby, the context model works as a virtual boundary across machinery and systems, which encloses the physical domain (hardware) and the immaterial domain (software) equally. Further, the thesis focuses on contextual faults, which arise from context model violations, and proposes approaches for collecting contextual data. Also, the automated building of context models and the extraction and transformation of contextual data is part of the thesis. Employing the context models impacts each layer of the proposed TAOISM VA model. For each layer, various approaches show the impact of the context models and their employment in three different application scenarios for FD in SM. The performed research is tested and verified in the scenarios of Robotics Application Development (RAD), Maintenance of Industrial Inspection Machines (MIIM) and Abnormal Event Management in Production Lines (AEMPL). Along with employing context models, data augmentation with context models is proposed. Along with other benefits, the presented data augmentation technique has the ability to balance undersampled datasets, which would enable a reduction of data recordings for any context-aware FD in the future. Thereby, the data augmentation technique is to answer the existing inaccuracies in an SM environment, which also impacts the quality of any employed Artificial Intelligence (AI). Another approach targets the unsupervised selection of production-relevant variables to focus FD-related data recordings and surveillance on areas of the SM environment active during production automatically without any domain knowledge involved. The hypothesis, which was proven right, was that faults, especially contextual faults, occur more often on active software and hardware modules. Another challenge from the vast amount of data is that labeling data for AI becomes uneconomical, even for small fault cases in AI. As a result, evaluating any AI model in SM becomes challenging, as standard measures, e.g., accuracy, precision, recall, and F1-score, cannot be applied. In this case, the thesis proposes novel AI performance metrics that decouple comparability and correctness to enable the evaluation of AI models in an SM environment. All the contributions have led to the development of two distinct Proof of Concepts (PoCs). The PoCs are the reference implementation of the context-aware FD and reflect a knowledge-based FD Expert System (ES) and an unsupervised data-driven FD system. The latter was part of the thorough evaluation of the context-aware FD by two groups of domain experts and junior professionals. The successful qualitative evaluation not only hints towards a working context-aware FD but also unveils future research directions and a future vision for SM. Additional domain expert interviews expose the views on the relevancy of a context-aware FD in SM for the future. In general, the evaluation hints towards a context-aware FD, which has versatile applicability, usability, and suitability in SM-related FD.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar       frontdoor_oas    
Metadaten
Author:Lukas Kaupp
URN:urn:nbn:de:hebis:ds114-opus4-4110
DOI:https://doi.org/10.48444/h_docs-pub-411
Publisher:Hochschule Darmstadt
Place of publication:Darmstadt
Referee:Ulrich Schwanecke, Tobias Schreck
Advisor:Bernhard Humm, Kawa Nazemi, Jens-Peter Akelbein
Document Type:Doctoral Thesis
Language:English
Year of Completion:2024
Publishing Institution:Hochschule Darmstadt
Granting Institution:Hochschule Darmstadt
Date of final exam:2023/11/30
Release Date:2024/01/19
Tag:Industry 4.0; artificial intelligence; artificial intelligence performance measures; autoencoder; context visualization; context-aware fault diagnosis; cyber-physical production systems; cyber-physical systems; fault diagnosis; machine learning; smart manufacturing; visual analytics
Page Number:317
Institutes:Promotionszentrum Angewandte Informatik
OpenAIRE:OpenAIRE
Licence (German):License LogoCreative Commons - CC BY-NC-ND - Namensnennung - Nicht kommerziell - Keine Bearbeitungen 4.0 International