Filtern
Dokumenttyp
Schlagworte
- Feldtests (5)
- Metalldetektor (5)
- Modulares Modell (5)
- Human factors (3)
- Zuverlässigkeit der Minensuche (3)
- Nuclear power plants (2)
- Time pressure (2)
- ZfP (2)
- Zuverlässigkeit in der Minensuche (2)
- 4-Eye Principle (1)
Proposals for Performance Demonstration and Modular Reliability Assessment for Humanitarian Demining
(2003)
For safe and reliable demining it is necessary to determine the actual true performance of mine searching equipment in detecting mines. The subject to detect a hidden subject by penetrating physical interaction with the target is similar to that of non-destructive testing where it is looked for hidden cracks etc. in material via waves and rays. The non destructive testing profession is now about 100 years old and developed some procedures to check reliability of testing. Those principles like the performance demonstration where the successful detections are statistically evaluated against false calls rates and their implementation in an industrial standard (ASME section XI appendix VIII) are analysed. A first adoption to demining was accomplished in the prescription for blind trials in the CEN workshop agreement CEN BT 126
CWA07 for test and evaluation of metal detectors. A number of blind trials were accomplished within an ITEP project to learn about the necessary statistical layout of those trials to achieve true, reproducible and repeatable results to give guidance to selection and improvement of metal detectors. The special focus in these investigations was on the influence of the human factor due to the degree of experience of the operators and the infulence of uncooperative soil. The correlation of the results of the physical parameter measurement and the statistical results is analysed in a first attempt.
Because the demining process is always connected with a danger for human beings, it is necessary to make sure the proper functioning of mine searching equipment in detecting mines. Detecting a hidden target by penetrating physical interaction of rays or waves is similar to non-destructive testing. The non-destructive testing profession developed procedures to check the reliability of testing. These procedures, like the performance demonstration where the successful detections are statistically evaluated against false call rates and their implementation in an industrial standard (ASME section XI appendix VIII) are used as a template. A first adoption to demining was accomplished in the prescription for blind trials in the CEN workshop agreement CWA 14747: 2003 for test and evaluation of metal detectors. Within an ITEP project a number of blind trials were carried out to learn about the necessary statistical basis of those trials to achieve true, reproducible and repeatable results to give guidance for the selection and improvement of metal detectors. The special focus in this first investigation was on the influence of the human factor due to the different degree of experience of the operators and the influence of the soil.
The total reliability of a mine searching system is driven by the triple of intrinsic
capability, which describes the physical-technical basis capability, the application and
environmental factors and the human factors. Some of them can be determined in
laboratory measurements but the human factor and a part of environment conditions
and their interaction with the device need to be treated statistically. That is why the
test & evaluation procedure described in CEN CWA 14747:2003, includes in addition
to parameter tests of metal detectors also the reliability or blind field tests under local
conditions with local personnel. A series of three big field trials had been
accomplished in the ITEP-project 2.1.1.2 Reliability Model for Test & Evaluation of
Metal Detectors to specify the optimum conditions for reliable trial results with
affordable effort. For each set of specific working conditions, characterized in terms
of a combination of one mine type in one soil with one detector handled by local
personnel, the searching system will show up a working performance in mine
detection rates as a function of mine depth and show up a certain overall false call
rate. During the ITEP-trials in Benkovac and Oberjettenberg the authors learnt to
determine this function separately for each mine type in each soil, which is especially
important for low metal mines in uncooperative soil which will be illustrated for the
mine PMA2 in different types of soil. The question of representativeness for field
conditions on the one hand and necessary statistical set up for the possibility to
distinguish between individual detector performances is still under discussion.
The detection of defects in aircraft components or parts of a power plant or mines in the ground is connected with the task to distinguish between signals caused be the item searched for and noisy signals from other sources. The reliability of the system is the better the better the system is in detecting the wanted signal and avoiding false alarms caused by noise. It is usual to measure the reliability of diagnostic systems in terms of ROC-curves (Re-ceiver Operating Characteristics) and POD-curves (Probability of Detec-tion). The ROC curves describe the POD versus Probability of False Alarm with growing system sensitivity along the curve. POD curves describe the Probability of Detection for a fixed sensitivity for a variation of item sizes or depths. Reliability of the whole system is always a composition of the physics
and technique, application influences and the human factors. For the scien-tific understanding and possibilities of improvement, decomposition accord-ing to a modular model is helpful. The authors present their experiences with the reliability evaluation of metal detectors for humanitarian demining and an NDT system of mechanized ultrasonic phased array testing of copper welds. The special concern in demining is the influence of soil types, detec-tors and the experiences of human beings.
Trial Design for Testing and Evaluation of Metal Detectors Used in Humanitarian Landmine Clearance
(2006)
The human factors approach relies on understanding the properties of
human capability and limitations under various conditions and the application of that
knowledge in designing and developing safe systems. Following the principles of
MTO (Man Technology Organization) approach, emphasis should be given to the
way people interact with technical as well as organizational systems.
A model describing human factor influences in relation to the performance shaping
factors and their effect on the manual ultrasonic inspection performance had been
built and a part of it empirically tested. The experimental task involved repeated
inspection of 18 flaws according to the standard procedure under no, middle and
high time pressure. Stress coping strategies, mental workload of the task, stress
reaction and organizational factors have been measured. The results have shown that
time pressure, mental workload and experience influence the quality of the
inspection performance. Organizational factors and their influence on the inspection
results were rated as important by the operators. However, further research is
necessary into the effects of stress.
The paper will give an overview of new methodology for evaluating the
reliability of NDE systems accurately, reliably and efficiently in accordance with the
specific requirements of industrial application. After a review of the substantive
issues from the previous workshops, the go forward guidance from these
interactions is considered.
At the beginning of the reliability analysis, the actual safety demands have to
be defined in order to fit the investigation to the level of risk when the component
would fail. Next, all the essential influencing parameters need to be documented and
transferred to an appropriate design of experiments (DOE) to determine the
reliability in terms of a qualitative assessment for lower risk or in terms of a
quantitative probability of detection (POD) or ROC (Receiver Operating
Characteristics) curves for higher safety demands. A new paradigm is offered to
consider the POD or reliability of the system as a function of the configuration of
input variables and use it for optimisation rather than for a final judgement. An
advantage for the end user is also to sample all single PODs to an integral 'Volume
POD' of a part.
Among the influencing parameters, the human factor is the most important one.
A systematic psychological approach shall help to find out where the bottlenecks are
but most importantly to provide best possible working conditions for the human
inspectors.
Es werden die Fortschritte bei der Bewertung der Zuverlässigkeit von ZfP-Systemen in den vergangenen 10 Jahren vorgestellt. Der modulare Ansatz bzw. die systematische Auflistung aller wesentlichen Einflussfaktoren stehen am Anfang jeder Bewertung, die jeweils spezifisch für einen industriellen bzw. Feldeinsatz angelegt wird. Weiterhin legt die zu Grunde liegende Sicherheitsanforderung fest, ob ein exaktes quantitatives statistisches Ergebnis z. B. für die Fehlergröße, die mit hoher Sicherheit detektiert wird angestrebt wird oder ob man sich mit einer qualitativen Abschätzung zufrieden geben kann. Moderne Werkzeuge wie das 'Design of Experiments' (Statistische Versuchsplanung), die Volumen-POD für ein Bauteil als ganzes oder auch die systematische psychologische Betrachtung des menschlichen Faktors unterstützen die Treffsicherheit der Untersuchung für den gewünschten Einsatzfall. Die Ergebnisse der ZfP-Prüfungen können immer nur so gut sein, wie der Mensch mit den Bedingungen zurechtkommt. Weiterhin kann die POD im Zusammenhang mit den Prozessparametern als helfendes Optimierungswerkzeug eingesetzt werden und nicht als endgültige Be(Ver)urteilung. Es werden Beispiele aus Bereichen der Energieerzeugung und Endlagerung präsentiert.