TY - JOUR A1 - Müller, Christina A1 - Bertovic, Marija A1 - Kanzler, Daniel A1 - Ronneteg, U. T1 - Conclusions of the 6th European American workshop on reliability of NDE N2 - The principles of Open Space Technology (OST) were again applied to discuss burning issues in the field of NDE reliability. The results of the discussions among NDE professionals concerning new reliability methods, human factors and integrated solutions will be presented. T2 - 42nd Annual Review of Progress in Quantitative Nondestructive Evaluation CY - Minneapolis, Minnesota, USA DA - 26.07.20155 KW - NDT KW - Reliability KW - Probability of detection KW - Human factors KW - POD PY - 2016 SN - 978-0-7354-1353-5 DO - https://doi.org/10.1063/1.4940452 SN - 0094-243X VL - 1706 SP - 020006-1 EP - 020006-9 PB - AIP Publishing AN - OPUS4-36637 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - RPRT A1 - Bertovic, Marija A1 - Ronneteg, U. T1 - User-centred approach to the development of NDT instructions N2 - One of the aims of considering human factors in the reliability of non-destructive testing (NDT) – for the purposes of the disposal of spent nuclear fuel – is to identify factors that can lead to errors in the completion of the NDT task and to determine how to prevent these errors. The current study is the first to examine mechanised NDT from the human factors perspective. A number of risks were identified and further analysed. Among a number of influencing factors, the NDT inspection procedure was identified as a potential error source and, therefore, was examined in this study. NDT inspection procedures and instructions are, without question, some of the most important tools in the everyday life of an NDT inspector. Experience and research have shown that NDT procedures and instructions, despite being written according to requirements and by certified personnel, are not always used as foreseen and may need to be optimised. The suggested approach for developing and optimising NDT procedures and instructions consists of applying human factors principles by adopting a user-centred approach. The user-centred approach refers to involving users in the process of instruction development by learning from their errors during the data evaluation task and connecting those errors to the shortcomings in the instructions. The first study assessed the quality of the selected NDT instruction by observing four experienced inspectors during the evaluation of data that were collected with the ultrasonic testing (UT) method while the participants followed the instruction. Through the use of an eye-tracking methodology, the participants’ eye movements across the screen were observed and further analysed. This analysis, together with discussions with the individual users, led to the identification of a number of errors and error sources. Such error identification, combined with theoretical considerations, led to the creation of a new version of the instruction. This new instruction was evaluated using the same method in a follow-up study, resulting in the creation of a third (and final) NDT instruction. Throughout this iterative process, version 4.0 of the instruction was replaced first by version 5.5 and then by version 6.0. As a result of these studies, changes were introduced to the instruction content (e.g. adding missing content) and to the instruction format (e.g. changing the layout, highlighting, presenting the information differently, altering the writing style). The participants reported higher satisfaction with the instruction after the changes were implemented. The main changes included using consistency in writing, highlighting information (e.g. number values, reporting levels, exceptions, reminders), improving navigation throughout the instruction (e.g. through the use of titles and subtitles), and presenting information more uniformly (e.g. all tasks being listed stepwise following the “one action per step” rule). Considering the benefits of including the user in the development of the NDT instructions and procedures, the main lesson that was learned in this study is that the review process must be carried out through action rather than by solely reading the instructions. This study exposed a number of problems of which the writer and the reviewer were unaware. After the new instruction was developed, two empirical studies with 20 participants were conducted to evaluate the instruction information by investigating 1) whether the instruction content was understood by the users (the understanding study) and 2) whether the new format supported a more efficient (i.e. less effortful), effective (i.e. more accurate and complete), and satisfying use of the instruction (the usability study). The aim of these studies was to increase the understanding of the factors that contribute to a high-quality NDT instruction. In the understanding study, the participants were asked to read the NDT instruction and then to answer a number of questions. Based on their answers, specific problems that were related to their understanding of the written content were identified. The results showed that the understanding of the information can be affected by the information order, information organisation, logics and clarity in the writing, and cognitive demands. The study also emphasised the relevance of placing information in a logical order. PY - 2014 UR - http://www.skb.se/upload/publications/pdf/R-14-06%20.pdf SN - 1402-3091 SP - ID 1430722, 1 EP - 103 AN - OPUS4-32513 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - RPRT A1 - Müller, Christina A1 - Heckel, Thomas A1 - Brömel, Philip A1 - Pavlovic, Mato A1 - Ronneteg, U. T1 - Attenuation dependent detectability at ultrasonic inspection of copper N2 - This report describes the progress in understanding and describing the detectability of the ultrasonic inspection technique developed by SKB for the inspection of copper tubes used for the final disposal of the Swedish spent nuclear fuel. In former research activities dedicated to the different parts of the canister, the probability of detection (POD) evaluation technique, as developed for thin aircraft components, was further developed for the application on complex hick-walled components. The result of this development was the introduction of a “multi-parameter” POD framework. In contrast to taking only the defect size into consideration (as for aircraft components) additional influencing factors, relevant for thick components, such as depth position, orientation and part geometry, were included. Furthermore, the variation of ultrasonic attenuation due to various material properties was included. PY - 2014 SP - ID 1411328, 1 EP - 54 AN - OPUS4-32522 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Bertovic, Marija A1 - Calmon, P. A1 - Carter, L. A1 - Fischer, J. A1 - Forsyth, D. A1 - Holstein, R. A1 - McGrath, B. A1 - Müller, Christina A1 - Pavlovic, Mato A1 - Ronneteg, U. A1 - Rummel, W. A1 - Schubert, F. A1 - Selby, G. T1 - Summary of the "open space technology discussions" on reliability of NDE N2 - Since the beginnings of the European American Workshops (EAW) in 1997, the aim was to gather the experts in NDE reliability and discuss burning topics with the aim of identifying crucial problems and suggesting ways to move forward. This was usually achieved during the so-called break-out sessions, in which predetermined topics were discussed. During the 5th EAW, held in Berlin in 2013, this approach was replaced by an Open Space Technology (OST) approach. The benefit of this approach is seen in the freedom of topic choices, i. e., the topics are not predetermined but rather arise at that moment in that space and by the participants’ choice. The following topics arose: new reliability methods (Bayesian, MAPOD, …), structural health monitoring, definition of requirements of NDE by customer versus provider, what value of POD is good enough?, human factors, manual versus automated inspection, and basic concepts of reliability of NDE. The participants were encouraged to walk from one session to another and openly express their opinions. These were in the end summarized by a chosen group of moderators and presented in this paper. N2 - Seit den Anfängen der europäischen amerikanischen Workshops (EAW) im Jahr 1997 war es das Ziel, Experten auf dem Gebiet der ZfP-Zuverlässigkeit zusammenzuführen und aktuelle Themen zu diskutieren, um wichtige Probleme zu identifizieren und Wege für deren Lösung vorzuschlagen. Dies wurde in der Regel während der sogenannten „Break-out Sessions“ erreicht, in denen vorgegebene Themen diskutiert wurden. Während des 5. EAW, der in Berlin im Jahr 2013 stattfand, wurde dieser Ansatz durch einen Open Space Technology (OST) Ansatz ersetzt. Open Space ist eine Methode der Gruppenmoderation, die sehr gut geeignet ist, um neue Ideen zu entwickeln und selbstständiges Arbeiten zu fördern, d. h. die Themen werden nicht vorgegeben, sondern ergeben sich in diesem Moment in diesem Raum und durch die Wahl der Teilnehmer. Die folgenden Themen wurden herausgearbeitet: neue Zuverlässigkeitsmethoden (Bayes, MAPOD, ...…), Structural Health Monitoring, Definition von Anforderungen der Kunden gegenüber den ZfP-Anbietern, Welcher Wert der POD ist gut genug?, der Einfluss menschlicher Faktoren, manuelle gegenüber automatisierte Prüfung, sowie Grundkonzepte der ZfP-Zuverlässigkeit. Die Teilnehmer wurden aufgefordert, von einer Sitzung zur anderen zu wechseln und offen ihre Meinung zu äußern. Diese Meinungen wurden am Ende von einer ausgewählten Gruppe von Moderatoren zusammengefasst und werden in diesem Beitrag vorgestellt. KW - NDE reliability KW - POD KW - Bayesian approach KW - Structural health monitoring KW - Human factors KW - Open space technology PY - 2014 UR - http://www.hanser-elibrary.com/doi/pdf/10.3139/120.110604 DO - https://doi.org/10.3139/120.110604 SN - 0025-5300 VL - 56 IS - 7-8 SP - 602 EP - 606 PB - Hanser CY - München AN - OPUS4-31269 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - CONF A1 - Bertovic, Marija A1 - Müller, Christina A1 - Fahlbruch, B. A1 - Ronneteg, U. A1 - Pitkänen, J. T1 - Holistic risk assessment and risk prevention approach to the mechanized NDT and the inspection procedure N2 - The difficulty to deal with human factors in non-destructive testing (NDT) stems from their diversity and complexity – no single human or organizational factor is responsible for the entire fluctuations in the NDT performance. The typical approach to decrease the variability in the inspection results had been found in replacing manual NDT with mechanized methods. However, even though some human errors can be avoided by automating the process, there are new risks that can arise from its application and need to be further investigated. To address this problem, a combination of theoretical and practical approaches should be applied, where the source of error is not seen only in the inspector, but also in his interaction with social and technical systems, as well as the organization. An analysis of potential risks in the use of mechanized inspections methods for spent fuel canisters has shown potential for human error in acquisition, as well as in the evaluation of the gathered results. Assessed causes of those errors lay in the inspector, but also in the organization and in shortcomings of the inspection procedure. The aim of the analysis was to provide with preventive measures and optimization recommendations. Those include further automation of the process, application of human redundancy, improvements of the inspection procedure, hardware and software improvements etc. Before improvements can be made, there is a need to understand the resulting processes and the influence of their interaction on the inspection results. The results have shown that when working with an automated system, one must avoid over relying on its proper functioning and form appropriate trust towards automation. Furthermore, human redundancy should be applied only in cases where the redundant inspectors are completely unaware of each other, in order to avoid the effects of social loafing and shirking. The inspection procedure is one of the most important tools in the application of NDT. On an example of ultrasonic data evaluation, the results will show an improvement of an NDT instruction as a result of consideration of the effectiveness, efficiency and user satisfaction T2 - 5th European-American workshop on reliability of NDE CY - Berlin, Germany DA - 07.10.2013 PY - 2013 SN - 978-3-940283-53-5 IS - DGZfP-BB 144 SP - Lecture 20, 1 EP - 10 CY - Berlin AN - OPUS4-31270 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - CONF A1 - Bertovic, Marija A1 - Calmon, P. A1 - Carter, L. A1 - Fisher, J. A1 - Forsyth, D. A1 - Holstein, R. A1 - McGrath, B. A1 - Müller, Christina A1 - Pavlovic, Mato A1 - Ronneteg, U. A1 - Rummel, W. A1 - Schubert, F. A1 - Selby, G. T1 - Summary of the open space technology discussions N2 - The highlight of 5th European American Workshop on Reliability of NDE (5th EAW) was the “Open Space Technology“(OST) discussion. The aim of the 5thEAW and, in particular, of the OST discussion - was to shed light on the reasons, which create a “deltcT between all the qualifications and reliability models and the real reliability in the field. In the previous 4 Workshops, the different topics of interest were discussed in the so-called break-out sessions, in which a specific goal for each working group was defined beforehand. In order not to move on “the old rails” in search for an answer, the break-out sessions were this year replaced by an open space approach. The reason for this was not to restrict the participants to a certain number of topics, but rather to allow the topics to arisefrom the interests of the participants and the needs of both the researchers and the NDT practitioners. This was achieved through setting up a wall of ideas. Each of the participantswas asked to write down as many questions or topics as they wanted, and pin them up on the wall throughout the duration of the entire Workshop. Finally, when the participants gathered for the discussion, those ideas were organized into 6 main topics: A. New reliability methods: Multiparameter POD, MAPOD, Bayesian B. Structural health monitoring C. Applications in industry D. Human factors E. Integrated Solutions and “delta" F. Basic concepts of reliability of NDE As in the spirit of the OST, in which the participants themselves determine the topics and decide how the discussion will flow, the participants from the topics C, D and E joined their forces and disused together. The groups separated and, under the moderation of several experts in different NDT reliability fields, the different issues have been discussed. At the end of the day the Groups were asked to present the content and the results of their work. Every group wrote a summary of the discussion. The purpose of this paper is to present the summaries of the held discussions and, therewith, share with the NDT community the main conclusions. T2 - 5th European-American workshop on reliability of NDE CY - Berlin, Germany DA - 07.10.2013 PY - 2013 SN - 978-3-940283-53-5 IS - DGZfP-BB 144 SP - 1 EP - 7 CY - Berlin AN - OPUS4-31271 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Gianneo, A. A1 - Carboni, M. A1 - Müller, Christina A1 - Ronneteg, U. T1 - PAUT inspection of copper canister: structural attenuation and POD formulation N2 - For inspection of thick-walled (50mm) copper canisters for final disposal of spent nuclear fuel in Sweden, ultrasonic inspection using phased array technique (PAUT) is applied. Because thick-walled copper is not commonly used as a structural material, previous experience on Phased Array Ultrasonic Testing for this type of application is limited. The paper presents the progress in understanding the amplitudes and attenuation changes acting on the Phased Array Ultrasonic Testing inspection of copper canisters. Previous studies showed the existence of a low pass filtering effect and a heterogeneous grain size distribution along the depth, thus affecting both the detectability of defects and their "Probability of Detection" determination. Consequently, the difference between the first and second back wall echoes were not sufficient to determine the local attenuation (within the inspection range), which affects the signal response for each individual defect. Experimental evaluation of structural attenuation was carried out onto step-wedge samples cut from full-size, extruded and pierced&drawn, copper canisters. Effective attenuation values has been implemented in numerical simulations to achieve a Multi Parameter Probability of Detection and to formulate a Model Assisted Probability of Detection through a Monte-Carlo extraction model. T2 - 42nd Annual Review of Progress in Quantitative Nondestructive Evaluation (QNDE) CY - Minneapolis, MN, USA DA - 26.07.2015 KW - Phased array ultrasonic testing KW - POD KW - Copper PY - 2016 DO - https://doi.org/10.1063/1.4940649 SN - 0094-243X VL - 1706 SP - Article: 200005, 1 EP - 13 PB - AIP Publishing AN - OPUS4-37592 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - GEN A1 - Müller, Christina A1 - Pavlovic, Mato A1 - Takahashi, Kazunori A1 - Ewert, Uwe A1 - Rosenthal, Martina A1 - Brekow, Gerhard A1 - Böhm, R. A1 - Ronneteg, U. A1 - Pitkänen, J. T1 - POD Evaluation of NDE Techniques for Canister-Components for Risk Assessment of Nuclear Waste Encapsulation T2 - 6th International Conference on NDE in Relation to Structural Integrity for Nuclear and Pressurised Components CY - Budapest, Hungary DA - 2007-10-08 KW - Zerstörungsfreie Prüfung KW - Zuverlässigkeit KW - POD PY - 2008 SN - 978-92-79-08897-1 DO - https://doi.org/10.2790/1274 SN - 1018-5593 SP - 168 EP - 179 AN - OPUS4-18589 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - GEN A1 - Müller, Christina A1 - Bertovic, Marija A1 - Gaal, Mate A1 - Heidt, Heinrich A1 - Pavlovic, Mato A1 - Rosenthal, Martina A1 - Takahashi, K. A1 - Pitkänen, J. A1 - Ronneteg, U. T1 - Progress in evaluating the reliability of NDE systems - Paradigm shift N2 - The paper will give an overview of new methodology for evaluating the reliability of NDE systems accurately, reliably and efficiently in accordance with the specific requirements of industrial application. After a review of the substantive issues from the previous workshops, the go forward guidance from these interactions is considered. At the beginning of the reliability analysis, the actual safety demands have to be defined in order to fit the investigation to the level of risk when the component would fail. Next, all the essential influencing parameters need to be documented and transferred to an appropriate design of experiments (DOE) to determine the reliability in terms of a qualitative assessment for lower risk or in terms of a quantitative probability of detection (POD) or ROC (Receiver Operating Characteristics) curves for higher safety demands. A new paradigm is offered to consider the POD or reliability of the system as a function of the configuration of input variables and use it for optimisation rather than for a final judgement. An advantage for the end user is also to sample all single PODs to an integral 'Volume POD' of a part. Among the influencing parameters, the human factor is the most important one. A systematic psychological approach shall help to find out where the bottlenecks are but most importantly to provide best possible working conditions for the human inspectors. T2 - 4th European-American workshop on reliability of NDE CY - Berlin, Germany DA - 2009-06-24 KW - Zuverlässigkeit von ZfP-Systemen KW - Multiparameter POD PY - 2009 UR - http://www.ndt.net/article/reliability2009/Inhalt/we1a2.pdf SN - 978-3-940283-17-7 IS - DGZfP-BB 116 SP - 1 EP - 13 AN - OPUS4-20616 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - GEN A1 - Takahashi, K. A1 - Pavlovic, Mato A1 - Ronneteg, U. A1 - Pitkänen, J. A1 - Müller, Christina T1 - Probability of detection from C-scan data for reliability analysis of ultrasonic non-destructive testing T2 - 4th European-American workshop on reliability of NDE CY - Berlin, Germany DA - 2009-06-24 KW - POD KW - UT KW - Reliability KW - C-scan PY - 2009 SN - 978-3-940283-17-7 IS - DGZfP-BB 116 SP - 1 EP - 7 AN - OPUS4-20617 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - GEN A1 - Pavlovic, Mato A1 - Takahashi, K. A1 - Ronneteg, U. A1 - Pitkänen, J. A1 - Müller, Christina T1 - Multi-parameter influence on the response of the flaw to the phased array ultrasonic NDT system. The volume POD. T2 - 4th European-American workshop on reliability of NDE CY - Berlin, Germany DA - 2009-06-24 KW - POD KW - Reliability KW - Multi-parameter signal response PY - 2009 SN - 978-3-940283-17-7 IS - DGZfP-BB 116 SP - 1 EP - 6 AN - OPUS4-20618 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER -