TY - JOUR A1 - Maier, Johannes A1 - Perret, Jerome A1 - Simon, Martina A1 - Schmitt-Rüth, Stephanie A1 - Wittenberg, Thomas A1 - Palm, Christoph T1 - Force-feedback assisted and virtual fixtures based K-wire drilling simulation JF - Computers in Biology and Medicine N2 - One common method to fix fractures of the human hand after an accident is an osteosynthesis with Kirschner wires (K-wires) to stabilize the bone fragments. The insertion of K-wires is a delicate minimally invasive surgery, because surgeons operate almost without a sight. Since realistic training methods are time consuming, costly and insufficient, a virtual-reality (VR) based training system for the placement of K-wires was developed. As part of this, the current work deals with the real-time bone drilling simulation using a haptic force-feedback device. To simulate the drilling, we introduce a virtual fixture based force-feedback drilling approach. By decomposition of the drilling task into individual phases, each phase can be handled individually to perfectly control the drilling procedure. We report about the related finite state machine (FSM), describe the haptic feedback of each state and explain, how to avoid jerking of the haptic force-feedback during state transition. The usage of the virtual fixture approach results in a good haptic performance and a stable drilling behavior. This was confirmed by 26 expert surgeons, who evaluated the virtual drilling on the simulator and rated it as very realistic. To make the system even more convincing, we determined real drilling feed rates through experimental pig bone drilling and transferred them to our system. Due to a constant simulation thread we can guarantee a precise drilling motion. Virtual fixtures based force-feedback calculation is able to simulate force-feedback assisted bone drilling with high quality and, thus, will have a great potential in developing medical applications. KW - Handchirurgie KW - Osteosynthese KW - Operationstechnik KW - Lernprogramm KW - Virtuelle Realität KW - Medical training system KW - Virtual fixtures KW - Virtual reality KW - Force-feedback haptic KW - Minimally invasive hand surgery KW - K-wire drilling Y1 - 2019 U6 - https://doi.org/10.1016/j.compbiomed.2019.103473 N1 - Corresponding author: Christoph Palm VL - 114 SP - 1 EP - 10 PB - Elsevier ER - TY - CHAP A1 - Franz, Daniela A1 - Dreher, Maria A1 - Prinzen, Martin A1 - Teßmann, Matthias A1 - Palm, Christoph A1 - Katzky, Uwe A1 - Perret, Jerome A1 - Hofer, Mathias A1 - Wittenberg, Thomas T1 - CT-basiertes virtuelles Fräsen am Felsenbein BT - Bild- und haptischen Wiederholfrequenzen bei unterschiedlichen Rendering Methoden T2 - Bildverarbeitung für die Medizin 2018; Algorithmen - Systeme - Anwendungen. Proceedings des Workshops vom 11. bis 13. März 2018 in Erlangen N2 - Im Rahmen der Entwicklung eines haptisch-visuellen Trainingssystems für das Fräsen am Felsenbein werden ein Haptikarm und ein autostereoskopischer 3D-Monitor genutzt, um Chirurgen die virtuelle Manipulation von knöchernen Strukturen im Kontext eines sog. Serious Game zu ermöglichen. Unter anderem sollen Assistenzärzte im Rahmen ihrer Ausbildung das Fräsen am Felsenbein für das chirurgische Einsetzen eines Cochlea-Implantats üben können. Die Visualisierung des virtuellen Fräsens muss dafür in Echtzeit und möglichst realistisch modelliert, implementiert und evaluiert werden. Wir verwenden verschiedene Raycasting Methoden mit linearer und Nearest Neighbor Interpolation und vergleichen die visuelle Qualität und die Bildwiederholfrequenzen der Methoden. Alle verglichenen Verfahren sind sind echtzeitfähig, unterscheiden sich aber in ihrer visuellen Qualität. KW - Felsenbein KW - Fräsen KW - Virtualisierung KW - Computertomographie KW - Computerassistierte Chirurgie Y1 - 2018 SN - 978-3-662-56537-7 U6 - https://doi.org/10.1007/978-3-662-56537-7_51 SP - 176 EP - 181 PB - Springer CY - Berlin ER - TY - CHAP A1 - Maier, Johannes A1 - Huber, Michaela A1 - Katzky, Uwe A1 - Perret, Jerome A1 - Wittenberg, Thomas A1 - Palm, Christoph T1 - Force-Feedback-assisted Bone Drilling Simulation Based on CT Data T2 - Bildverarbeitung für die Medizin 2018; Algorithmen - Systeme - Anwendungen; Proceedings des Workshops vom 11. bis 13. März 2018 in Erlangen N2 - In order to fix a fracture using minimally invasive surgery approaches, surgeons are drilling complex and tiny bones with a 2 dimensional X-ray as single imaging modality in the operating room. Our novel haptic force-feedback and visual assisted training system will potentially help hand surgeons to learn the drilling procedure in a realistic visual environment. Within the simulation, the collision detection as well as the interaction between virtual drill, bone voxels and surfaces are important. In this work, the chai3d collision detection and force calculation algorithms are combined with a physics engine to simulate the bone drilling process. The chosen Bullet-Physics-Engine provides a stable simulation of rigid bodies, if the collision model of the drill and the tool holder is generated as a compound shape. Three haptic points are added to the K-wire tip for removing single voxels from the bone. For the drilling process three modes are proposed to emulate the different phases of drilling in restricting the movement of a haptic device. KW - Handchirurgie KW - Osteosynthese KW - Simulation KW - Lernprogramm Y1 - 2018 U6 - https://doi.org/10.1007/978-3-662-56537-7_78 SP - 291 EP - 296 PB - Springer CY - Berlin ER -