TY - CHAP A1 - Höcherl, Johannes A1 - Adam, Andreas A1 - Schlegl, Thomas A1 - Wrede, Britta T1 - Human-Robot Assembly: Methodical Design and Assessment of an Immersive Virtual Environment for Real-World Significance T2 - 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA): 8-11 Sept. 2020, Vienna, Austria N2 - Virtual reality is a powerful tool for industrial applications. The article at hand addresses designers of industrial virtual environments. It summarizes key aspects to design immersive and coherent virtual environments. Furthermore, relevant influencing factors for a high quality virtual environment and tools to quantify this quality are presented. So far, a methodology to design, evaluate, and transfer knowledge from virtual environments into reality has been missing and is of high value for industrial applications. The proposed methodical approach includes the steps application analysis, technology selection and integration, design of virtual environment, evaluation of simulator quality, as well as discussion of the real-world validity. The method is shown on the example of a virtual human-robot working cell used to analyze the human perception of robot behavior during mutual assembly processes. The quality of the virtual environment is evaluated to be adequate for those purposes and the transfer of knowledge gained in virtuality on a corresponding real-world application is discussed. To the best of our knowing a system like the presented one, including full-body tracking, finger tracking, a virtual avatar and a head-mounted display has not been used for industrial use cases and human-robot cooperation before. KW - assembly KW - Avatars KW - coherent virtual environment KW - Conferences KW - Design methodology KW - fidelity KW - Head-mounted displays KW - human-robot cooperation KW - immersive KW - industrial applications KW - Knowledge transfer KW - Manufacturing automation KW - real-world validity KW - Robots KW - simulator quality KW - system design KW - virtual environments KW - Virtual reality Y1 - 2020 U6 - https://doi.org/10.1109/ETFA46521.2020.9212039 SP - 549 EP - 556 PB - IEEE ER - TY - JOUR A1 - Maier, Johannes A1 - Perret, Jerome A1 - Simon, Martina A1 - Schmitt-Rüth, Stephanie A1 - Wittenberg, Thomas A1 - Palm, Christoph T1 - Force-feedback assisted and virtual fixtures based K-wire drilling simulation JF - Computers in Biology and Medicine N2 - One common method to fix fractures of the human hand after an accident is an osteosynthesis with Kirschner wires (K-wires) to stabilize the bone fragments. The insertion of K-wires is a delicate minimally invasive surgery, because surgeons operate almost without a sight. Since realistic training methods are time consuming, costly and insufficient, a virtual-reality (VR) based training system for the placement of K-wires was developed. As part of this, the current work deals with the real-time bone drilling simulation using a haptic force-feedback device. To simulate the drilling, we introduce a virtual fixture based force-feedback drilling approach. By decomposition of the drilling task into individual phases, each phase can be handled individually to perfectly control the drilling procedure. We report about the related finite state machine (FSM), describe the haptic feedback of each state and explain, how to avoid jerking of the haptic force-feedback during state transition. The usage of the virtual fixture approach results in a good haptic performance and a stable drilling behavior. This was confirmed by 26 expert surgeons, who evaluated the virtual drilling on the simulator and rated it as very realistic. To make the system even more convincing, we determined real drilling feed rates through experimental pig bone drilling and transferred them to our system. Due to a constant simulation thread we can guarantee a precise drilling motion. Virtual fixtures based force-feedback calculation is able to simulate force-feedback assisted bone drilling with high quality and, thus, will have a great potential in developing medical applications. KW - Handchirurgie KW - Osteosynthese KW - Operationstechnik KW - Lernprogramm KW - Virtuelle Realität KW - Medical training system KW - Virtual fixtures KW - Virtual reality KW - Force-feedback haptic KW - Minimally invasive hand surgery KW - K-wire drilling Y1 - 2019 U6 - https://doi.org/10.1016/j.compbiomed.2019.103473 N1 - Corresponding author: Christoph Palm VL - 114 SP - 1 EP - 10 PB - Elsevier ER -