TY - GEN A1 - Joachimsky, Robert A1 - Ambellan, Felix A1 - Zachow, Stefan T1 - Computerassistierte Auswahl und Platzierung von interpositionalen Spacern zur Behandlung früher Gonarthrose N2 - Degenerative Gelenkerkrankungen, wie die Osteoarthrose, sind ein häufiges Krankheitsbild unter älteren Erwachsenen. Hierbei verringert sich u.a. der Gelenkspalt aufgrund degenerierten Knorpels oder geschädigter Menisci. Ein in den Gelenkspalt eingebrachter interpositionaler Spacer soll die mit der Osteoarthrose einhergehende verringerte Gelenkkontaktfläche erhöhen und so der teilweise oder vollständige Gelenkersatz hinausgezögert oder vermieden werden. In dieser Arbeit präsentieren wir eine Planungssoftware für die Auswahl und Positionierung eines interpositionalen Spacers am Patientenmodell. Auf einer MRT-basierten Bildsegmentierung aufbauend erfolgt eine geometrische Rekonstruktion der 3D-Anatomie des Kniegelenks. Anhand dieser wird der Gelenkspalt bestimmt, sowie ein Spacer ausgewählt und algorithmisch vorpositioniert. Die Positionierung des Spacers ist durch den Benutzer jederzeit interaktiv anpassbar. Für jede Positionierung eines Spacers wird ein Fitness-Wert zur Knieanatomie des jeweiligen Patienten berechnet und den Nutzern Rückmeldung hinsichtlich Passgenauigkeit gegeben. Die Software unterstützt somit als Entscheidungshilfe die behandelnden Ärzte bei der patientenspezifischen Spacerauswahl. T3 - ZIB-Report - 17-72 KW - Osteoarthrose KW - Kniegelenk KW - Medizinische Planung KW - Visualisierung Y1 - 2017 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-66064 SN - 1438-0064 ER - TY - GEN A1 - Hege, Hans-Christian A1 - Merzky, Andre A1 - Zachow, Stefan T1 - Distributed Visualization with OpenGL Vizserver: Practical Experiences N2 - The increasing demand for distributed solutions in computing technology does not stop when it comes to visualization techniques. However, the capabilities of todays applications to perform remote rendering are limited by historical design legacys. Especially the popular X11 protokoll, which has been proven to be extremely flexible and usefull for remote 2D graphics applications, breaks down for the case of remote 3D rendering. In this white paper, we give a short overview of generic remote rendering technologies available today, and compare their performance to the recently released vizserver by SGI: a network extension to the SGI OpenGL rendering engines. T3 - ZIB-Report - 00-31 KW - remote visualization KW - high performance computing Y1 - 2000 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-5992 ER - TY - GEN A1 - Kober, Cornelia A1 - Sader, Robert A1 - Zeilhofer, Hans-Florian A1 - Prohaska, Steffen A1 - Zachow, Stefan A1 - Deuflhard, Peter T1 - Anisotrope Materialmodellierung für den menschlichen Unterkiefer N2 - Im Rahmen der biomechanischen Simulation knöcherner Organe ist die Frage nach einer befriedigenden Materialbeschreibung nach wie vor ungelöst. Computertomographische Datensätze liefern eine räumliche Verteilung der (Röntgen-)Dichte und ermöglichen damit eine gute Darstellung der individuellen Geometrie. Weiter können die verschiedenen Materialbestandteile des Knochens, Spongiosa und Kortikalis, voneinander getrennt werden. Aber die richtungsabängige Information der Materialanisotropie ist verloren. In dieser Arbeit wird ein Ansatz für eine anisotrope Materialbeschreibung vorgestellt, die es ermöglicht, den Einfluss der individuellen knöchernen Struktur auf das makroskopische Materialverhalten abzuschätzen. T3 - ZIB-Report - 01-31 KW - menschlicher Unterkiefer KW - Simulation mit der Methode der finiten Elemente KW - innerer Aufbau des Knochens KW - anisotrope Elastizität Y1 - 2001 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-6574 ER - TY - THES A1 - Zachow, Stefan T1 - Computergestützte 3D Osteotomieplanung in der Mund-Kiefer-Gesichtschirurgie unter Berücksichtigung der räumlichen Weichgewebeanordnung T1 - Computer assisted 3D osteotomy planning in cranio-maxillofacial surgery under consideration of facial soft tissue arrangement N2 - In der Arbeit wird die computergestützte Planung von chirurgisch gesetzten Knochenfrakturen bzw. Knochenschnitten (sogenannten Osteotomien) an dreidimensionalen, computergrafischen Schädelmodellen, sowie die Umpositionierung separierter knöcherner Segmente im Kontext der rekonstruktiven MKG-Chirurgie behandelt. Durch die 3D Modellierung und Visualisierung anatomischer Strukturen, sowie der 3D Osteotomie- und Umstellungsplanung unter Einbeziehung der resultierenden Weichgewebedeformation wird den Chirurgen ein Werkzeug an die Hand gegeben, mit dem eine Therapieplanung am Computer durchgeführt und diese in Hinblick auf Funktion und Ästhetik bewertet werden kann. Unterschiedliche Strategien können dabei erprobt und in ihrer Auswirkung erfasst werden. Dazu wird ein methodischer Ansatz vorgestellt, der zum einen die chirurgische Planung im Vergleich zu existierenden Ansätzen deutlich verbessert und zum anderen eine robuste Weichgewebeprognose, durch den Einsatz geeigneter Planungsmodelle und eines physikalisch basierten Weichgewebemodells unter Nutzung numerischer Lösungsverfahren in die Planung integriert. Die Visualisierung der Planungsergebnisse erlaubt sowohl eine anschauliche und überzeugende, präoperative Patientenaufklärung, als auch die Demonstration möglicher Vorgehensweisen und deren Auswirkungen für die chirurgische Ausbildung. Ferner ergänzen die Planungsdaten die Falldokumentation und liefern einen Beitrag zur Qualitätssicherung. Die Arbeit ist in sieben Kapitel gegliedert und wie folgt strukturiert: Zuerst wird die medizinische Aufgabenstellung bei der chirurgischen Rekonstruktion von Knochenfehlbildungen und -fehlstellungen in der kraniofazialen Chirurgie sowie die daraus resultierenden Anforderungen an die Therapieplanung beschrieben. Anschließend folgt ein umfassender Überblick über entsprechende Vorarbeiten zur computergestützten Planung knochenverlagernder Operationen und eine kritische Bestandsaufnahme der noch vorhandenen Defizite. Nach der Vorstellung des eigenen Planungsansatzes wird die Generierung individueller, qualitativ hochwertiger 3D Planungsmodelle aus tomografischen Bilddaten beschrieben, die den Anforderungen an eine intuitive, 3D Planung von Umstellungsosteotomien entsprechen und eine Simulation der daraus resultierenden Weichgewebedeformation mittels der Finite-Elemente Methode (FEM) ermöglichen. Die Methoden der 3D Schnittplanung an computergrafischen Modellen werden analysiert und eine 3D Osteotomieplanung an polygonalen Schädelmodellen entwickelt, die es ermöglicht, intuitiv durch Definition von Schnittlinien am 3D Knochenmodell, eine den chirurgischen Anforderungen entsprechende Schnittplanung unter Berücksichtigung von Risikostrukturen durchzuführen. Separierte Knochensegmente lassen sich im Anschluss interaktiv umpositionieren und die resultierende Gesamtanordnung hinsichtlich einer funktionellen Rehabilitation bewerten. Aufgrund des in dieser Arbeit gewählten, physikalisch basierten Modellierungsansatzes kann unter Berücksichtigung des gesamten Weichgewebevolumens aus der Knochenverlagerung direkt die resultierende Gesichtsform berechnet werden. Dies wird anhand von 13 exemplarischen Fallstudien anschaulich demonstriert, wobei die Prognosequalität mittels postoperativer Fotografien und postoperativer CT-Daten überprüft und belegt wird. Die Arbeit wird mit einem Ausblick auf erweiterte Modellierungsansätze und einem Konzept für eine integrierte, klinisch einsetzbare Planungsumgebung abgeschlossen. N2 - In cranio-maxillofacial surgery, physicians are often faced with skeletal malformations that require complex bone relocations. Especially in severe cases of congenital dysgnathia (misalignment of upper and lower jaw) or hemifacial microsomia (asymmetric bone and tissue development), where multiple bone segments are to be mobilized and relocated simultaneously and in relation to each other, careful preoperative planning is mandatory. At present in clinical routine not all possible strategies can be planned and assessed with regard to functional rehabilitation. Moreover, the aesthetic outcome, i.e. the postoperative facial appearance, can only be estimated by a surgeon's experience and hardly communicated to the patient. On this account, a preoperative planning of complex osteotomies with bone relocations on a computerized model of a patient's head, including a reliable three-dimensional prediction and visualization of the post-surgical facial appearance is a highly appreciated possibility cranio-maxillofacial surgeons are longing for. This work, being performed at Zuse Institute Berlin (ZIB), addresses such a computer based 3D~surgery planning. A processing pipeline has been established and a simulation environment has been developed on basis of the software Amira, enabling a surgeon to perform bone cuts and bone rearrangements in an intuitive manner on virtual patient models. In addition, a prediction of the patients' postoperative appearance according to the relocated bone can be simulated and visualized realistically. For a meaningful planning of surgical procedures, anatomically correct patient models providing all relevant details are reconstructed from tomographic data with high fidelity. These patient models reliably represent bony structures as well as the facial soft tissue. Unstructured volumetric grids of the soft tissue are generated for a fast and efficient numerical solution of partial differential equations, describing tissue deformation on the foundation of 3D elastomechanics. The planning of osteotomies (bone cuts) for the mobilization and relocation of bone segments is performed in accordance to the planning on basis of life size replicas of a patient's skull, i.e. stereolitographic models. Osteotomy lines can be drawn on top of the polygonal planning models using suitable input devices. After evaluation of the consequence of a planned cut with regard to vulnerable inner structures (nerves, teeth etc.) the model is separated accordingly. A relocation of bone segments can be performed unrestrictedly in 3D or restricted to a translation or rotation within arbitrarily chosen planes under consideration of cephalometric guidelines. Bone and tooth collisions can be evaluated for functional analysis or orthodontic treatment planning with possible integration of digitized dental plaster casts. As a result of the preoperative planning, a single transformation matrix, encoding translation and rotation, or a sequence of such matrices are provided for each bone segment. Both the osteotomy paths and the transformation parameters can finally be used for intra-operative navigation. In the course of the planning, the relocated positions of bone segments serve as an input for the simulation of the resulting soft tissue deformation. Since bone and surrounding soft tissue share common boundaries that are either fixed or translocated, the resulting configuration of the entire tissue volume can be computed from the given boundary displacements by numerical minimization of the internal strain energy on basis of a biomechanical model, using a finite-element approach. In collaboration with different surgeons and hospitals more than 25 treatments have been accompanied by preoperative planning so far ranging from mandibular and midfacial hypoplasia to complex hemifacial microsomia. 13 of these cases are presented within this work. Simulation results were validated on the basis of photographs as well as of postoperative CT data, showing a good correlation between simulation and postoperative outcome. Further aspects of improving the modeling approach are discussed. It has been demonstrated that 3D~osteotomy planning on virtual patient models can be performed intuitively, and that 3D~tissue deformation for cranio-maxillofacial osteotomy planning can be predicted numerically without using heuristic ratios. It can be stated that by using 3D~planning software, a surgeon gains a better spatial understanding of complex dysplasia, and the 3D~soft tissue prediction gives an additional criterion for the assessment of the planned strategy. It turned out that, especially in complex cases such as hemifacial microsomia or for decisions bet­ween mono- and bimaxillary advancements, a 3D~planning aid is extremely helpful. The conclusion is, that images and animations created within the planning phase provide a valuable planning criterion for maxillofacial surgeons as well as a demonstrative information for patients and their relatives, thus greatly enhancing patient information, as well as surgical education. All data that result from the planning are also important for documentation and quality assurance. 3D osteotomy planning, including soft tissue prediction, likely will become a new paradigm of plastic and reconstructive surgery planning in the future. An assortment of results can be found under: http://www.zib.de/visual/medical/projects KW - MKG-Chirurgie KW - Mund-Kiefer-Gesichtschirurgie KW - Therapieplanung KW - Osteotomie KW - Weichgewebeprädiktion KW - computer assisted surgery KW - therapy planning KW - osteotomy KW - soft tissue prediction KW - CAS Y1 - 2005 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-10432 SN - 3899631986 ER - TY - GEN A1 - Zachow, Stefan A1 - Zilske, Michael A1 - Hege, Hans-Christian T1 - 3D reconstruction of individual anatomy from medical image data: Segmentation and geometry processing N2 - For medical diagnosis, visualization, and model-based therapy planning three-dimensional geometric reconstructions of individual anatomical structures are often indispensable. Computer-assisted, model-based planning procedures typically cover specific modifications of “virtual anatomy” as well as numeric simulations of associated phenomena, like e.g. mechanical loads, fluid dynamics, or diffusion processes, in order to evaluate a potential therapeutic outcome. Since internal anatomical structures cannot be measured optically or mechanically in vivo, three-dimensional reconstruction of tomographic image data remains the method of choice. In this work the process chain of individual anatomy reconstruction is described which consists of segmentation of medical image data, geometrical reconstruction of all relevant tissue interfaces, up to the generation of geometric approximations (boundary surfaces and volumetric meshes) of three-dimensional anatomy being suited for finite element analysis. All results presented herein are generated with amira ® – a highly interactive software system for 3D data analysis, visualization and geometry reconstruction. T3 - ZIB-Report - 07-41 KW - Medical image segmentation KW - computational geometry KW - virtual anatomy KW - finite element meshes Y1 - 2007 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-10440 SN - 1438-0064 ER - TY - GEN A1 - Grewe, C. Martin A1 - Zachow, Stefan T1 - Release of the FexMM for the Open Virtual Mirror Framework N2 - THIS MODEL IS FOR NON-COMMERCIAL RESEARCH PURPOSES. ONLY MEMBERS OF UNIVERSITIES OR NON-COMMERCIAL RESEARCH INSTITUTES ARE ELIGIBLE TO APPLY. 1. Download, fill, and sign the form available from: https://media.githubusercontent.com/media/mgrewe/ovmf/main/data/fexmm_license_agreement.pdf 2. Send the signed form to: fexmm@zib.de NOTE: Use an official email address of your institution for the request. Y1 - 2021 U6 - https://doi.org/10.12752/8532 ER - TY - JOUR A1 - Li, Jianning A1 - Pimentel, Pedro A1 - Szengel, Angelika A1 - Ehlke, Moritz A1 - Lamecker, Hans A1 - Zachow, Stefan A1 - Estacio, Laura A1 - Doenitz, Christian A1 - Ramm, Heiko A1 - Shi, Haochen A1 - Chen, Xiaojun A1 - Matzkin, Franco A1 - Newcombe, Virginia A1 - Ferrante, Enzo A1 - Jin, Yuan A1 - Ellis, David G. A1 - Aizenberg, Michele R. A1 - Kodym, Oldrich A1 - Spanel, Michal A1 - Herout, Adam A1 - Mainprize, James G. A1 - Fishman, Zachary A1 - Hardisty, Michael R. A1 - Bayat, Amirhossein A1 - Shit, Suprosanna A1 - Wang, Bomin A1 - Liu, Zhi A1 - Eder, Matthias A1 - Pepe, Antonio A1 - Gsaxner, Christina A1 - Alves, Victor A1 - Zefferer, Ulrike A1 - von Campe, Cord A1 - Pistracher, Karin A1 - Schäfer, Ute A1 - Schmalstieg, Dieter A1 - Menze, Bjoern H. A1 - Glocker, Ben A1 - Egger, Jan T1 - AutoImplant 2020 - First MICCAI Challenge on Automatic Cranial Implant Design JF - IEEE Transactions on Medical Imaging N2 - The aim of this paper is to provide a comprehensive overview of the MICCAI 2020 AutoImplant Challenge. The approaches and publications submitted and accepted within the challenge will be summarized and reported, highlighting common algorithmic trends and algorithmic diversity. Furthermore, the evaluation results will be presented, compared and discussed in regard to the challenge aim: seeking for low cost, fast and fully automated solutions for cranial implant design. Based on feedback from collaborating neurosurgeons, this paper concludes by stating open issues and post-challenge requirements for intra-operative use. Y1 - 2021 U6 - https://doi.org/10.1109/TMI.2021.3077047 SN - 0278-0062 VL - 40 IS - 9 SP - 2329 EP - 2342 ER - TY - JOUR A1 - Tack, Alexander A1 - Ambellan, Felix A1 - Zachow, Stefan T1 - Towards novel osteoarthritis biomarkers: Multi-criteria evaluation of 46,996 segmented knee MRI data from the Osteoarthritis Initiative JF - PLOS One N2 - Convolutional neural networks (CNNs) are the state-of-the-art for automated assessment of knee osteoarthritis (KOA) from medical image data. However, these methods lack interpretability, mainly focus on image texture, and cannot completely grasp the analyzed anatomies’ shapes. In this study we assess the informative value of quantitative features derived from segmentations in order to assess their potential as an alternative or extension to CNN-based approaches regarding multiple aspects of KOA. Six anatomical structures around the knee (femoral and tibial bones, femoral and tibial cartilages, and both menisci) are segmented in 46,996 MRI scans. Based on these segmentations, quantitative features are computed, i.e., measurements such as cartilage volume, meniscal extrusion and tibial coverage, as well as geometric features based on a statistical shape encoding of the anatomies. The feature quality is assessed by investigating their association to the Kellgren-Lawrence grade (KLG), joint space narrowing (JSN), incident KOA, and total knee replacement (TKR). Using gold standard labels from the Osteoarthritis Initiative database the balanced accuracy (BA), the area under the Receiver Operating Characteristic curve (AUC), and weighted kappa statistics are evaluated. Features based on shape encodings of femur, tibia, and menisci plus the performed measurements showed most potential as KOA biomarkers. Differentiation between non-arthritic and severely arthritic knees yielded BAs of up to 99%, 84% were achieved for diagnosis of early KOA. Weighted kappa values of 0.73, 0.72, and 0.78 were achieved for classification of the grade of medial JSN, lateral JSN, and KLG, respectively. The AUC was 0.61 and 0.76 for prediction of incident KOA and TKR within one year, respectively. Quantitative features from automated segmentations provide novel biomarkers for KLG and JSN classification and show potential for incident KOA and TKR prediction. The validity of these features should be further evaluated, especially as extensions of CNN- based approaches. To foster such developments we make all segmentations publicly available together with this publication. Y1 - 2021 U6 - https://doi.org/10.1371/journal.pone.0258855 VL - 16 IS - 10 ER - TY - JOUR A1 - Tack, Alexander A1 - Shestakov, Alexey A1 - Lüdke, David A1 - Zachow, Stefan T1 - A deep multi-task learning method for detection of meniscal tears in MRI data from the Osteoarthritis Initiative database JF - Frontiers in Bioengineering and Biotechnology, section Biomechanics N2 - We present a novel and computationally efficient method for the detection of meniscal tears in Magnetic Resonance Imaging (MRI) data. Our method is based on a Convolutional Neural Network (CNN) that operates on a complete 3D MRI scan. Our approach detects the presence of meniscal tears in three anatomical sub-regions (anterior horn, meniscal body, posterior horn) for both the Medial Meniscus (MM) and the Lateral Meniscus (LM) individually. For optimal performance of our method, we investigate how to preprocess the MRI data or how to train the CNN such that only relevant information within a Region of Interest (RoI) of the data volume is taken into account for meniscal tear detection. We propose meniscal tear detection combined with a bounding box regressor in a multi-task deep learning framework to let the CNN implicitly consider the corresponding RoIs of the menisci. We evaluate the accuracy of our CNN-based meniscal tear detection approach on 2,399 Double Echo Steady-State (DESS) MRI scans from the Osteoarthritis Initiative database. In addition, to show that our method is capable of generalizing to other MRI sequences, we also adapt our model to Intermediate-Weighted Turbo Spin-Echo (IW TSE) MRI scans. To judge the quality of our approaches, Receiver Operating Characteristic (ROC) curves and Area Under the Curve (AUC) values are evaluated for both MRI sequences. For the detection of tears in DESS MRI, our method reaches AUC values of 0.94, 0.93, 0.93 (anterior horn, body, posterior horn) in MM and 0.96, 0.94, 0.91 in LM. For the detection of tears in IW TSE MRI data, our method yields AUC values of 0.84, 0.88, 0.86 in MM and 0.95, 0.91, 0.90 in LM. In conclusion, the presented method achieves high accuracy for detecting meniscal tears in both DESS and IW TSE MRI data. Furthermore, our method can be easily trained and applied to other MRI sequences. Y1 - 2021 U6 - https://doi.org/10.3389/fbioe.2021.747217 SP - 28 EP - 41 ER - TY - GEN A1 - Tack, Alexander A1 - Shestakov, Alexey A1 - Lüdke, David A1 - Zachow, Stefan T1 - A deep multi-task learning method for detection of meniscal tears in MRI data from the Osteoarthritis Initiative database N2 - We present a novel and computationally efficient method for the detection of meniscal tears in Magnetic Resonance Imaging (MRI) data. Our method is based on a Convolutional Neural Network (CNN) that operates on a complete 3D MRI scan. Our approach detects the presence of meniscal tears in three anatomical sub-regions (anterior horn, meniscal body, posterior horn) for both the Medial Meniscus (MM) and the Lateral Meniscus (LM) individually. For optimal performance of our method, we investigate how to preprocess the MRI data or how to train the CNN such that only relevant information within a Region of Interest (RoI) of the data volume is taken into account for meniscal tear detection. We propose meniscal tear detection combined with a bounding box regressor in a multi-task deep learning framework to let the CNN implicitly consider the corresponding RoIs of the menisci. We evaluate the accuracy of our CNN-based meniscal tear detection approach on 2,399 Double Echo Steady-State (DESS) MRI scans from the Osteoarthritis Initiative database. In addition, to show that our method is capable of generalizing to other MRI sequences, we also adapt our model to Intermediate-Weighted Turbo Spin-Echo (IW TSE) MRI scans. To judge the quality of our approaches, Receiver Operating Characteristic (ROC) curves and Area Under the Curve (AUC) values are evaluated for both MRI sequences. For the detection of tears in DESS MRI, our method reaches AUC values of 0.94, 0.93, 0.93 (anterior horn, body, posterior horn) in MM and 0.96, 0.94, 0.91 in LM. For the detection of tears in IW TSE MRI data, our method yields AUC values of 0.84, 0.88, 0.86 in MM and 0.95, 0.91, 0.90 in LM. In conclusion, the presented method achieves high accuracy for detecting meniscal tears in both DESS and IW TSE MRI data. Furthermore, our method can be easily trained and applied to other MRI sequences. T3 - ZIB-Report - 21-33 Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-84415 SN - 1438-0064 ER - TY - JOUR A1 - Grewe, Carl Martin A1 - Liu, Tuo A1 - Hildebrandt, Andrea A1 - Zachow, Stefan T1 - The Open Virtual Mirror Framework for Enfacement Illusions - Enhancing the Sense of Agency With Avatars That Imitate Facial Expressions JF - Behavior Research Methods Y1 - 2022 U6 - https://doi.org/10.3758/s13428-021-01761-9 PB - Springer ER - TY - CHAP A1 - Siqueira Rodrigues, Lucas A1 - Riehm, Felix A1 - Zachow, Stefan A1 - Israel, Johann Habakuk T1 - VoxSculpt: An Open-Source Voxel Library for Tomographic Volume Sculpting in Virtual Reality T2 - 2023 9th International Conference on Virtual Reality (ICVR), Xianyang, China, 2023 N2 - Manual processing of tomographic data volumes, such as interactive image segmentation in medicine or paleontology, is considered a time-consuming and cumbersome endeavor. Immersive volume sculpting stands as a potential solution to improve its efficiency and intuitiveness. However, current open-source software solutions do not yield the required performance and functionalities. We address this issue by contributing a novel open-source game engine voxel library that supports real-time immersive volume sculpting. Our design leverages GPU instancing, parallel computing, and a chunk-based data structure to optimize collision detection and rendering. We have implemented features that enable fast voxel interaction and improve precision. Our benchmark evaluation indicates that our implementation offers a significant improvement over the state-of-the-art and can render and modify millions of visible voxels while maintaining stable performance for real-time interaction in virtual reality. Y1 - 2023 U6 - https://doi.org/10.1109/ICVR57957.2023.10169420 SP - 515 EP - 523 ER - TY - CHAP A1 - Siqueira Rodrigues, Lucas A1 - Nyakatura, John A1 - Zachow, Stefan A1 - Israel, Johann Habakuk T1 - Design Challenges and Opportunities of Fossil Preparation Tools and Methods T2 - Proceedings of the 20th International Conference on Culture and Computer Science: Code and Materiality N2 - Fossil preparation is the activity of processing paleontological specimens for research and exhibition purposes. In addition to traditional mechanical extraction of fossils, preparation presently comprises non-destructive digital methods that are part of a relatively new field, namely virtual paleontology. Despite significant technological advances, both traditional and digital preparation remain cumbersome and time-consuming endeavors. However, this field has received scarce attention from a human-computer interaction perspective. The present study aims to elucidate the state-of-the-art for paleontological fossil preparation in order to determine its main challenges and start a conversation regarding opportunities for creating novel designs that tackle the field's current issues. We conducted a qualitative study involving both technical preparators and virtual paleontologists. The study was divided into two parts: First, we assembled technical preparators and paleontology researchers in a focus group session to discuss their workflows, obtain a preliminary understanding of their issues, and ideate solutions based on their counterparts' workflows. Next, we conducted a series of contextual inquiries involving direct observation and semi-structured in-depth interviews. We transcribed our recordings and examined the data through theoretical and inductive thematic analysis, clustering emerging themes and applying concepts from human-computer interaction and related fields. Our findings report on challenges faced by traditional and digital fossil preparators and potential opportunities to improve their tools and workflows. We contribute with a novel analysis of fossil preparation from an HCI perspective. Y1 - 2023 U6 - https://doi.org/10.1145/3623462.3623470 PB - Association for Computing Machinery CY - New York, NY, USA ER - TY - JOUR A1 - Wagendorf, Oliver A1 - Nahles, Susanne A1 - Vach, Kirstin A1 - Kernen, Florian A1 - Zachow, Stefan A1 - Heiland, Max A1 - Flügge, Tabea T1 - The impact of teeth and dental restorations on gray value distribution in cone-beam computer tomography - a pilot study JF - International Journal of Implant Dentistry N2 - Purpose: To investigate the influence of teeth and dental restorations on the facial skeleton's gray value distributions in cone-beam computed tomography (CBCT). Methods: Gray value selection for the upper and lower jaw segmentation was performed in 40 patients. In total, CBCT data of 20 maxillae and 20 mandibles, ten partial edentulous and ten fully edentulous in each jaw, respectively, were evaluated using two different gray value selection procedures: manual lower threshold selection and automated lower threshold selection. Two sample t tests, linear regression models, linear mixed models, and Pearson's correlation coefficients were computed to evaluate the influence of teeth, dental restorations, and threshold selection procedures on gray value distributions. Results: Manual threshold selection resulted in significantly different gray values in the fully and partially edentulous mandible. (p = 0.015, difference 123). In automated threshold selection, only tendencies to different gray values in fully edentulous compared to partially edentulous jaws were observed (difference: 58–75). Significantly different gray values were evaluated for threshold selection approaches, independent of the dental situation of the analyzed jaw. No significant correlation between the number of teeth and gray values was assessed, but a trend towards higher gray values in patients with more teeth was noted. Conclusions: Standard gray values derived from CT imaging do not apply for threshold-based bone segmentation in CBCT. Teeth influence gray values and segmentation results. Inaccurate bone segmentation may result in ill-fitting surgical guides produced on CBCT data and misinterpreting bone density, which is crucial for selecting surgical protocols. Y1 - 2023 U6 - https://doi.org/10.1186/s40729-023-00493-z VL - 9 IS - 27 ER - TY - CHAP A1 - Manogue, Kevin A1 - Schang, Tomasz A1 - Kuş, Dilara A1 - Müller, Jonas A1 - Zachow, Stefan A1 - Sengupta, Agniva T1 - Generalizing Shape-from-Template to Topological Changes T2 - Smart Tools and Applications in Graphics - Eurographics Italian Chapter Conference N2 - Reconstructing the surfaces of deformable objects from correspondences between a 3D template and a 2D image is well studied under Shape-from-Template (SfT) methods; however, existing approaches break down when topological changes accompany the deformation. We propose a principled extension of SfT that enables reconstruction in the presence of such changes. Our approach is initialized with a classical SfT solution and iteratively adapts the template by partitioning its spatial domain so as to minimize an energy functional that jointly encodes physical plausibility and reprojection consistency. We demonstrate that the method robustly captures a wide range of practically relevant topological events including tears and cuts on bounded 2D surfaces, thereby establishing the first general framework for topological-change-aware SfT. Experiments on both synthetic and real data confirm that our approach consistently outperforms baseline methods. Y1 - 2025 SN - 978-3-03868-296-7 U6 - https://doi.org/10.2312/stag.20251322 PB - The Eurographics Association ER - TY - JOUR A1 - Li, Jianning A1 - Bitter, Kerstin A1 - Nguyen, Anh Duc A1 - Shemesh, Hagay A1 - Zaslansky, Paul A1 - Zachow, Stefan T1 - Computational Insights into Root Canal Treatment: A Survey of Selected Methods in Imaging, Segmentation, Morphological Analysis, and Clinical Management JF - dentistry journal N2 - Background/Objectives: Root canal treatment (RCT) is a common dental procedure performed to preserve teeth by removing infected or at-risk pulp tissue caused by caries, trauma, or other pulpal conditions. A successful outcome, among others, depends on accurate identification of the root canal anatomy, planning a suitable therapeutic strategy, and ensuring a bacteria-tight root canal filling. Despite advances in dental techniques, there remains limited integration of computational methods to support key stages of treatment. This review aims to provide a comprehensive overview of computational methods applied throughout the full workflow of RCT, examining their potential to support clinical decision-making, improve treatment planning and outcome assessment, and help bridge the interdisciplinary gap between dentistry and computational research. Methods: A comprehensive literature review was conducted to identify and analyze computational methods applied to different stages of RCT, including root canal segmentation, morphological analysis, treatment planning, quality evaluation, follow-up, and prognosis prediction. In addition, a taxonomy based on application was developed to categorize these methods based on their function within the treatment process. Insights from the authors’ own research experience were also incorporated to highlight implementation challenges and practical considerations. Results: The review identified a wide range of computational methods aimed at enhancing the consistency and efficiency of RCT. Key findings include the use of advanced image processing for segmentation, image analysis for diagnosis and treatment planning, machine learning for morphological classification, and predictive modeling for outcome estimation. While some methods demonstrate high sensitivity and specificity in diagnostic and planning tasks, many remain in experimental stages and lack clinical integration. There is also a noticeable absence of advanced computational techniques for micro-computed tomography and morphological analysis. Conclusions: Computational methods offer significant potential to improve decision-making and outcomes in RCT. However, greater focus on clinical translation and development of cross-modality methodology is needed. The proposed taxonomy provides a structured framework for organizing existing methods and identifying future research directions tailored to specific phases of treatment. This review serves as a resource for both dental professionals, computer scientists and researchers seeking to bridge the gap between clinical practice and computational innovation. Y1 - 2025 U6 - https://doi.org/https://doi.org/10.3390/dj13120579 VL - 13 IS - 12 PB - MDPI ER - TY - JOUR A1 - Siqueira Rodrigues, Lucas A1 - Schmidt, Timo Torsten A1 - Israel, Johann Habakuk A1 - Nyakatura, John A1 - Zachow, Stefan A1 - Kosch, Thomas T1 - Comparing the Effects of Visual, Haptic, and Visuohaptic Encoding on Memory Retention of Digital Objects in Virtual Reality JF - NordiCHI '24: Proceedings of the 13th Nordic Conference on Human-Computer Interaction N2 - Although Virtual Reality (VR) has undoubtedly improved human interaction with 3D data, users still face difficulties retaining important details of complex digital objects in preparation for physical tasks. To address this issue, we evaluated the potential of visuohaptic integration to improve the memorability of virtual objects in immersive visualizations. In a user study (N=20), participants performed a delayed match-to-sample task where they memorized stimuli of visual, haptic, or visuohaptic encoding conditions. We assessed performance differences between the conditions through error rates and response time. We found that visuohaptic encoding significantly improved memorization accuracy compared to unimodal visual and haptic conditions. Our analysis indicates that integrating haptics into immersive visualizations enhances the memorability of digital objects. We discuss its implications for the optimal encoding design in VR applications that assist professionals who need to memorize and recall virtual objects in their daily work. Y1 - 2024 U6 - https://doi.org/10.1145/3679318.3685349 SP - 1 EP - 13 ER - TY - JOUR A1 - Leskovar, Marko A1 - Heyland, Mark A1 - Trepczynski, Adam A1 - Zachow, Stefan T1 - Comparison of Global and Local Optimization Methods for Intensity-based 2D-3D Registration JF - Computers in Biology and Medicine Y1 - 2025 U6 - https://doi.org/10.1016/j.compbiomed.2024.109574 VL - 186 SP - 109574 PB - Elsevier ER - TY - JOUR A1 - Siqueira Rodrigues, Lucas A1 - Schmidt, Timo Torsten A1 - Nyakatura, John A1 - Zachow, Stefan A1 - Israel, Johann Habakuk A1 - Kosch, Thomas T1 - Assessing the Effects of Sensory Modality Conditions on Object Retention across Virtual Reality and Projected Surface Display Environments JF - Proceedings of the ACM on Human-Computer Interaction N2 - Haptic feedback reportedly enhances human interaction with 3D data, particularly improving the retention of mental representations of digital objects in immersive settings. However, the effectiveness of visuohaptic integration in promoting object retention across different display environments remains underexplored. Our study extends previous research on the retention effects of haptics from virtual reality to a projected surface display to assess whether earlier findings generalize to 2D environments. Participants performed a delayed match-to-sample task incorporating visual, haptic, and visuohaptic sensory feedback within a projected surface display environment. We compared error rates and response times across these sensory modalities and display environments. Our results reveal that visuohaptic integration significantly enhances object retention on projected surfaces, benefiting task performance across display environments. Our findings suggest that haptics can improve object retention without requiring fully immersive setups, offering insights for the design of interactive systems that assist professionals who rely on precise mental representations of digital objects. Y1 - 2024 U6 - https://doi.org/10.1145/3698137 VL - 8 IS - ISS SP - 255 EP - 282 ER - TY - CHAP A1 - Siqueira Rodrigues, Lucas A1 - Kosch, Thomas A1 - Nyakatura, John A1 - Zachow, Stefan A1 - Israel, Johann Habakuk T1 - MorphoHaptics: An Open-Source Tool for Visuohaptic Exploration of Morphological Image Datasets T2 - KUI '24: Proceedings of the 21th International Conference on Culture and Computer Science: from Humanism to Digital Humanities N2 - Although digital methods have significantly advanced morphology, practitioners are still challenged to understand and process tomographic data of specimens. As automated processing of fossil data is still insufficient, morphologists still engage in intensive manual work to digitally prepare fossils for research objectives. We present an open-source tool that enables morphologists to explore tomographic data similarly to the physical workflows that traditional fossil preparators experience in the field. Using questionnaires, we assessed the usability of our prototype for virtual fossil preparation and related common tasks in the digital preparation workflow. Our findings indicate that integrating haptics into the virtual preparation workflow enhances the understanding of the morphology and material properties of working specimens and that the visuohaptic sculpting of fossil volumes is straightforward and is an improvement over current digital specimen processing methods. Y1 - 2025 U6 - https://doi.org/10.1145/3719236.3719271 SP - 1 EP - 10 ER - TY - CHAP A1 - Siqueira Rodrigues, Lucas A1 - Nyakatura, John A1 - Zachow, Stefan A1 - Israel, Johann Habakuk A1 - Kosch, Thomas T1 - Evaluating Visuohaptic Integration on Memory Retention of Morphological Tomographic Images T2 - The 19th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry N2 - Scientific visualization and tomographic imaging techniques have created unprecedented possibilities for non-destructive analyses of digital specimens in morphology. However, practitioners encounter difficulties retaining critical information from complex tomographic volumes in their workflows. In light of this challenge, we investigated the effectiveness of visuohaptic integration in enhancing memory retention of morphological data. In a within-subjects user study (N=18), participants completed a delayed match-to-sample task, where we compared error rates and response times across visual and visuohaptic sensory modality conditions. Our results indicate that visuohaptic encoding improves the retention of tomographic images, producing significantly reduced error rates and faster response times than its unimodal visual counterpart. Our findings suggest that integrating haptics into scientific visualization interfaces may support professionals in fields such as morphology, where accurate retention of complex spatial data is essential for efficient analysis and decision-making within virtual environments. Y1 - 2024 U6 - https://doi.org/10.1145/3703619.3706055 SP - 1 EP - 10 PB - ACM CY - New York, NY, USA ER - TY - JOUR A1 - Sengupta, Agniva A1 - Zachow, Stefan T1 - Shape-from-Template with Generalised Camera JF - Image and Vision Computing N2 - This article presents a new method for non-rigidly registering a 3D shape to 2D keypoints observed by a constellation of multiple cameras. Non-rigid registration of a 3D shape to observed 2D keypoints, i.e., Shape-from-Template (SfT), has been widely studied using single images, but SfT with information from multiple-cameras jointly opens new directions for extending the scope of known use-cases such as 3D shape registration in medical imaging and registration from hand-held cameras, to name a few. We represent such multi-camera setup with the generalised camera model; therefore any collection of perspective or orthographic cameras observing any deforming object can be registered. We propose multiple approaches for such SfT: the first approach where the corresponded keypoints lie on a direction vector from a known 3D point in space, the second approach where the corresponded keypoints lie on a direction vector from an unknown 3D point in space but with known orientation w.r.t some local reference frame, and a third approach where, apart from correspondences, the silhouette of the imaged object is also known. Together, these form the first set of solutions to the SfT problem with generalised cameras. The key idea behind SfT with generalised camera is the improved reconstruction accuracy from estimating deformed shape while utilising the additional information from the mutual constraints between multiple views of a deformed object. The correspondence-based approaches are solved with convex programming while the silhouette-based approach is an iterative refinement of the results from the convex solutions. We demonstrate the accuracy of our proposed methods on many synthetic and real data. Y1 - 2025 U6 - https://doi.org/10.1016/j.imavis.2025.105579 VL - 162 ER - TY - JOUR A1 - Trepczynski, Adam A1 - Kneifel, Paul A1 - Heyland, Mark A1 - Leskovar, Marko A1 - Moewis, Philippe A1 - Damm, Philipp A1 - Taylor, William R. A1 - Zachow, Stefan A1 - Duda, Georg T1 - Impact of the External Knee Flexion Moment on Patello-Femoral Loading Derived from in vivo Loads and Kinematics JF - Frontiers in Bioengineering and Biotechnology N2 - Anterior knee pain and other patello-femoral (PF) complications frequently limit the success of total knee arthroplasty as the final treatment of end stage osteoarthritis. However, knowledge about the invivo loading conditions at the PF joint remains limited, as no direct measurements are available. We hypothesised that the external knee flexion moment (EFM) is highly predictive of the PF contact forces during activities with substantial flexion of the loaded knee.Six patients (65-80 years, 67-101 kg) with total knee arthroplasty (TKA) performed two activities of daily living: sit-stand-sit and squat. Tibio-femoral (TF) contact forces were measured in vivo using instrumented tibial components, while synchronously internal TF and PF kinematics were captured with mobile fluoroscopy. The measurements were used to compute PF contact forces using patient specific musculoskeletal models. The relationship between the EFM and the PF contact force was quantified using linear regression.Mean peak TF contact forces of 1.97 to 3.24 times body weight (BW) were found while peak PF forces reached 1.75 to 3.29 times body weight (BW). The peak EFM ranged from 3.2 to 5.9 %BW times body height, and was a good predictor of the PF contact force (R^2 = 0.95 and 0.88 for sit-standsit and squat, respectively).The novel combination of in vivo TF contact forces and internal patellar kinematics enabled a reliable assessment of PF contact forces. The results of the regression analysis suggest that PF forces can be estimated based solely on the EFM from quantitative gait analysis. Our study also demonstrates the relevance of PF contact forces, which reach magnitudes similar to TF forces during activities of daily living. Y1 - 2024 U6 - https://doi.org/10.3389/fbioe.2024.1473951 VL - 12 ER - TY - JOUR A1 - Deppe, Dominik A1 - Gabriele, Matteo A1 - Mazzoleni, Manuel Giovanni A1 - Ordas-Bayon, Alejandro A1 - Fidanza, Andrea A1 - Rozhko, Yuriy A1 - Şimşek, Ekin Kaya A1 - Keltz, Eran A1 - Osterhoff, Georg A1 - Damm, Philipp A1 - Duda, Georg N. A1 - Leskovar, Marko A1 - Zachow, Stefan A1 - Trepczynski, Adam A1 - Heyland, Mark T1 - Interobserver Reliability of the Modified Radiographic Union Score (mRUST) for Tibial and Femoral Fractures JF - Journal of Orthopaedic Trauma N2 - OBJECTIVES: To evaluate the reliability of the modified Radiographic Union Score for Tibial fractures (mRUST) as a reliable tool for monitoring lower limb fractures (femur, tibia) treated with various modalities (nail, plate). METHODS: Design: Retrospective analysis. Setting: Single center academic hospital in Germany. Patient Selection Criteria: Adult patients (≥18 years) with extra-articular long bone fractures of the lower extremities treated surgically between January 2005 and April 2022, requiring radiographs in two perpendicular planes and at least one follow-up visit, were included. Exclusion criteria were critical clinical conditions, inability to consent, joint articulation fractures, inadequate documentation, or insufficient imaging quality. Outcome Measures and Comparisons: Six international investigators (five orthopedic surgeons, one radiologist) independently assessed fracture line and callus growth per cortex (mRUST) at individualized follow-up time points based on clinical practice. To evaluate interrater reliability, intraclass correlation coefficients were calculated for the overall dataset, and for subsets of rated images, that were defined based on anatomical location (femur/tibia), treatment type (plate/nail fixation), and treatment combinations across locations. RESULTS: A total of 166 patients (63 femur fractures, 103 tibia fractures; 32.5% female, mean age 43.4 (18–84)) with 1136 follow-up time points were analyzed. Overall interrater reliability for mRUST was good (intraclass correlation coefficient 0.77), consistent across fixation methods (nail/plate fixation, 0.79) and anatomical locations (tibia, 0.78; femur, 0.81). Cortex-specific reliability varied, with highest agreement for the medial cortex (0.70–0.74) and lowest for the posterior cortex (0.65–0.74). CONCLUSIONS: The mRUST (radiographic score) demonstrated reliability for monitoring fracture healing in the femur and tibia, irrespective of fixation method, supporting its use as a generalizable tool across lower limb fractures. LEVEL OF EVIDENCE: Prognostic Level III. See Instructions for Authors for a complete description of levels of evidence. Y1 - 2025 U6 - https://doi.org/10.1097/BOT.0000000000003032 SN - 0890-5339 VL - 39 IS - 10 SP - 557 EP - 563 ER - TY - CHAP A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - Geodesic B-Score for Improved Assessment of Knee Osteoarthritis T2 - Proc. Information Processing in Medical Imaging (IPMI) N2 - Three-dimensional medical imaging enables detailed understanding of osteoarthritis structural status. However, there remains a vast need for automatic, thus, reader-independent measures that provide reliable assessment of subject-specific clinical outcomes. To this end, we derive a consistent generalization of the recently proposed B-score to Riemannian shape spaces. We further present an algorithmic treatment yielding simple, yet efficient computations allowing for analysis of large shape populations with several thousand samples. Our intrinsic formulation exhibits improved discrimination ability over its Euclidean counterpart, which we demonstrate for predictive validity on assessing risks of total knee replacement. This result highlights the potential of the geodesic B-score to enable improved personalized assessment and stratification for interventions. Y1 - 2021 U6 - https://doi.org/10.1007/978-3-030-78191-0_14 SP - 177 EP - 188 ER - TY - JOUR A1 - Hembus, Jessica A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - Bader, Rainer T1 - Establishment of a rolling-sliding test bench to analyze abrasive wear propagation of different bearing materials for knee implants JF - Applied Sciences N2 - Currently, new materials for knee implants need to be extensively and expensive tested in a knee wear simulator in a realized design. However, using a rolling-sliding test bench, these materials can be examined under the same test conditions but with simplified geometries. In the present study, the test bench was optimized, and forces were adapted to the physiological contact pressure in the knee joint using the available geometric parameters. Various polymers made of polyethylene and polyurethane articulating against test wheels made of cobalt-chromium and aluminum titanate were tested in the test bench using adapted forces based on ISO 14243-1. Polyurethane materials showed distinctly higher wear rates than polyethylene materials and showed inadequate wear resistance for use as knee implant material. Thus, the rolling-sliding test bench is an adaptable test setup for evaluating newly developed bearing materials for knee implants. It combines the advantages of screening and simulator tests and allows testing of various bearing materials under physiological load and tribological conditions of the human knee joint. The wear behavior of different material compositions and the influence of surface geometry and quality can be initially investigated without the need to produce complex implant prototypes of total knee endoprosthesis or interpositional spacers. Y1 - 2021 U6 - https://doi.org/10.3390/app11041886 VL - 11 IS - 4 ER - TY - GEN A1 - Tack, Alexander A1 - Ambellan, Felix A1 - Zachow, Stefan T1 - Towards novel osteoarthritis biomarkers: Multi-criteria evaluation of 46,996 segmented knee MRI data from the Osteoarthritis Initiative (Supplementary Material) T2 - PLOS One N2 - Convolutional neural networks (CNNs) are the state-of-the-art for automated assessment of knee osteoarthritis (KOA) from medical image data. However, these methods lack interpretability, mainly focus on image texture, and cannot completely grasp the analyzed anatomies’ shapes. In this study we assess the informative value of quantitative features derived from segmentations in order to assess their potential as an alternative or extension to CNN-based approaches regarding multiple aspects of KOA A fully automated method is employed to segment six anatomical structures around the knee (femoral and tibial bones, femoral and tibial cartilages, and both menisci) in 46,996 MRI scans. Based on these segmentations, quantitative features are computed, i.e., measurements such as cartilage volume, meniscal extrusion and tibial coverage, as well as geometric features based on a statistical shape encoding of the anatomies. The feature quality is assessed by investigating their association to the Kellgren-Lawrence grade (KLG), joint space narrowing (JSN), incident KOA, and total knee replacement (TKR). Using gold standard labels from the Osteoarthritis Initiative database the balanced accuracy (BA), the area under the Receiver Operating Characteristic curve (AUC), and weighted kappa statistics are evaluated. Features based on shape encodings of femur, tibia, and menisci plus the performed measurements showed most potential as KOA biomarkers. Differentiation between healthy and severely arthritic knees yielded BAs of up to 99%, 84% were achieved for diagnosis of early KOA. Substantial agreement with weighted kappa values of 0.73, 0.73, and 0.79 were achieved for classification of the grade of medial JSN, lateral JSN, and KLG, respectively. The AUC was 0.60 and 0.75 for prediction of incident KOA and TKR within 5 years, respectively. Quantitative features from automated segmentations yield excellent results for KLG and JSN classification and show potential for incident KOA and TKR prediction. The validity of these features as KOA biomarkers should be further evaluated, especially as extensions of CNN-based approaches. To foster such developments we make all segmentations publicly available together with this publication. Y1 - 2021 U6 - https://doi.org/10.12752/8328 N1 - 46,996 automated segmentations for data from the OAI database. VL - 16 IS - 10 ER - TY - JOUR A1 - Sekuboyina, Anjany A1 - Husseini, Malek E. A1 - Bayat, Amirhossein A1 - Löffler, Maximilian A1 - Liebl, Hans A1 - Li, Hongwei A1 - Tetteh, Giles A1 - Kukačka, Jan A1 - Payer, Christian A1 - Štern, Darko A1 - Urschler, Martin A1 - Chen, Maodong A1 - Cheng, Dalong A1 - Lessmann, Nikolas A1 - Hu, Yujin A1 - Wang, Tianfu A1 - Yang, Dong A1 - Xu, Daguang A1 - Ambellan, Felix A1 - Amiranashvili, Tamaz A1 - Ehlke, Moritz A1 - Lamecker, Hans A1 - Lehnert, Sebastian A1 - Lirio, Marilia A1 - de Olaguer, Nicolás Pérez A1 - Ramm, Heiko A1 - Sahu, Manish A1 - Tack, Alexander A1 - Zachow, Stefan A1 - Jiang, Tao A1 - Ma, Xinjun A1 - Angerman, Christoph A1 - Wang, Xin A1 - Brown, Kevin A1 - Kirszenberg, Alexandre A1 - Puybareau, Élodie A1 - Chen, Di A1 - Bai, Yiwei A1 - Rapazzo, Brandon H. A1 - Yeah, Timyoas A1 - Zhang, Amber A1 - Xu, Shangliang A1 - Hou, Feng A1 - He, Zhiqiang A1 - Zeng, Chan A1 - Xiangshang, Zheng A1 - Liming, Xu A1 - Netherton, Tucker J. A1 - Mumme, Raymond P. A1 - Court, Laurence E. A1 - Huang, Zixun A1 - He, Chenhang A1 - Wang, Li-Wen A1 - Ling, Sai Ho A1 - Huynh, Lê Duy A1 - Boutry, Nicolas A1 - Jakubicek, Roman A1 - Chmelik, Jiri A1 - Mulay, Supriti A1 - Sivaprakasam, Mohanasankar A1 - Paetzold, Johannes C. A1 - Shit, Suprosanna A1 - Ezhov, Ivan A1 - Wiestler, Benedikt A1 - Glocker, Ben A1 - Valentinitsch, Alexander A1 - Rempfler, Markus A1 - Menze, Björn H. A1 - Kirschke, Jan S. T1 - VerSe: A Vertebrae labelling and segmentation benchmark for multi-detector CT images JF - Medical Image Analysis N2 - Vertebral labelling and segmentation are two fundamental tasks in an automated spine processing pipeline. Reliable and accurate processing of spine images is expected to benefit clinical decision support systems for diagnosis, surgery planning, and population-based analysis of spine and bone health. However, designing automated algorithms for spine processing is challenging predominantly due to considerable variations in anatomy and acquisition protocols and due to a severe shortage of publicly available data. Addressing these limitations, the Large Scale Vertebrae Segmentation Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020, with a call for algorithms tackling the labelling and segmentation of vertebrae. Two datasets containing a total of 374 multi-detector CT scans from 355 patients were prepared and 4505 vertebrae have individually been annotated at voxel level by a human-machine hybrid algorithm (https://osf.io/nqjyw/, https://osf.io/t98fz/). A total of 25 algorithms were benchmarked on these datasets. In this work, we present the results of this evaluation and further investigate the performance variation at the vertebra level, scan level, and different fields of view. We also evaluate the generalisability of the approaches to an implicit domain shift in data by evaluating the top-performing algorithms of one challenge iteration on data from the other iteration. The principal takeaway from VerSe: the performance of an algorithm in labelling and segmenting a spine scan hinges on its ability to correctly identify vertebrae in cases of rare anatomical variations. The VerSe content and code can be accessed at: https://github.com/anjany/verse. Y1 - 2021 U6 - https://doi.org/10.1016/j.media.2021.102166 VL - 73 ER - TY - JOUR A1 - Picht, Thomas A1 - Le Calve, Maxime A1 - Tomasello, Rosario A1 - Fekonja, Lucius A1 - Gholami, Mohammad Fardin A1 - Bruhn, Matthias A1 - Zwick, Carola A1 - Rabe, Jürgen P. A1 - Müller-Birn, Claudia A1 - Vajkoczy, Peter A1 - Sauer, Igor M. A1 - Zachow, Stefan A1 - Nyakatura, John A. A1 - Ribault, Patricia A1 - Pulvermüller, Friedemann T1 - A note on neurosurgical resection and why we need to rethink cutting JF - Neurosurgery Y1 - 2021 U6 - https://doi.org/10.1093/neuros/nyab326 VL - 89 IS - 5 SP - 289 EP - 291 ER - TY - CHAP A1 - Siqueira Rodrigues, Lucas A1 - Nyakatura, John A1 - Zachow, Stefan A1 - Israel, Johann Habakuk T1 - An Immersive Virtual Paleontology Application T2 - 13th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2022 N2 - Virtual paleontology studies digital fossils through data analysis and visualization systems. The discipline is growing in relevance for the evident advantages of non-destructive imaging techniques over traditional paleontological methods, and it has made significant advancements during the last few decades. However, virtual paleontology still faces a number of technological challenges, amongst which are interaction shortcomings of image segmentation applications. Whereas automated segmentation methods are seldom applicable to fossil datasets, manual exploration of these specimens is extremely time-consuming as it impractically delves into three-dimensional data through two-dimensional visualization and interaction means. This paper presents an application that employs virtual reality and haptics to virtual paleontology in order to evolve its interaction paradigms and address some of its limitations. We provide a brief overview of the challenges faced by virtual paleontology practitioners, a description of our immersive virtual paleontology prototype, and the results of a heuristic evaluation of our design. Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-06249-0 SP - 478 EP - 481 ER - TY - GEN A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - Geodesic B-Score for Improved Assessment of Knee Osteoarthritis N2 - Three-dimensional medical imaging enables detailed understanding of osteoarthritis structural status. However, there remains a vast need for automatic, thus, reader-independent measures that provide reliable assessment of subject-specific clinical outcomes. To this end, we derive a consistent generalization of the recently proposed B-score to Riemannian shape spaces. We further present an algorithmic treatment yielding simple, yet efficient computations allowing for analysis of large shape populations with several thousand samples. Our intrinsic formulation exhibits improved discrimination ability over its Euclidean counterpart, which we demonstrate for predictive validity on assessing risks of total knee replacement. This result highlights the potential of the geodesic B-score to enable improved personalized assessment and stratification for interventions. T3 - ZIB-Report - 21-09 KW - Statistical shape analysis KW - Osteoarthritis KW - Geometric statistics KW - Riemannian manifolds Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-81930 SN - 1438-0064 ER - TY - JOUR A1 - Grewe, Carl Martin A1 - Liu, Tuo A1 - Kahl, Christoph A1 - Andrea, Hildebrandt A1 - Zachow, Stefan T1 - Statistical Learning of Facial Expressions Improves Realism of Animated Avatar Faces JF - Frontiers in Virtual Reality Y1 - 2021 U6 - https://doi.org/10.3389/frvir.2021.619811 VL - 2 SP - 1 EP - 13 PB - Frontiers ER - TY - JOUR A1 - Glatzeder, Korbinian A1 - Komnik, Igor A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - Potthast, Wolfgang T1 - Dynamic pressure analysis of novel interpositional knee spacer implants in 3D-printed human knee models JF - Scientific Reports N2 - Alternative treatment methods for knee osteoarthritis (OA) are in demand, to delay the young (< 50 Years) patient’s need for osteotomy or knee replacement. Novel interpositional knee spacers shape based on statistical shape model (SSM) approach and made of polyurethane (PU) were developed to present a minimally invasive method to treat medial OA in the knee. The implant should be supposed to reduce peak strains and pain, restore the stability of the knee, correct the malalignment of a varus knee and improve joint function and gait. Firstly, the spacers were tested in artificial knee models. It is assumed that by application of a spacer, a significant reduction in stress values and a significant increase in the contact area in the medial compartment of the knee will be registered. Biomechanical analysis of the effect of novel interpositional knee spacer implants on pressure distribution in 3D-printed knee model replicas: the primary purpose was the medial joint contact stress-related biomechanics. A secondary purpose was a better understanding of medial/lateral redistribution of joint loading. Six 3D printed knee models were reproduced from cadaveric leg computed tomography. Each of four spacer implants was tested in each knee geometry under realistic arthrokinematic dynamic loading conditions, to examine the pressure distribution in the knee joint. All spacers showed reduced mean stress values by 84–88% and peak stress values by 524–704% in the medial knee joint compartment compared to the non-spacer test condition. The contact area was enlarged by 462–627% as a result of the inserted spacers. Concerning the appreciable contact stress reduction and enlargement of the contact area in the medial knee joint compartment, the premises are in place for testing the implants directly on human knee cadavers to gain further insights into a possible tool for treating medial knee osteoarthritis. Y1 - 2022 U6 - https://doi.org/10.1038/s41598-022-20463-6 VL - 12 ER - TY - JOUR A1 - Amiranashvili, Tamaz A1 - Lüdke, David A1 - Li, Hongwei Bran A1 - Zachow, Stefan A1 - Menze, Bjoern T1 - Learning continuous shape priors from sparse data with neural implicit functions JF - Medical Image Analysis N2 - Statistical shape models are an essential tool for various tasks in medical image analysis, including shape generation, reconstruction and classification. Shape models are learned from a population of example shapes, which are typically obtained through segmentation of volumetric medical images. In clinical practice, highly anisotropic volumetric scans with large slice distances are prevalent, e.g., to reduce radiation exposure in CT or image acquisition time in MR imaging. For existing shape modeling approaches, the resolution of the emerging model is limited to the resolution of the training shapes. Therefore, any missing information between slices prohibits existing methods from learning a high-resolution shape prior. We propose a novel shape modeling approach that can be trained on sparse, binary segmentation masks with large slice distances. This is achieved through employing continuous shape representations based on neural implicit functions. After training, our model can reconstruct shapes from various sparse inputs at high target resolutions beyond the resolution of individual training examples. We successfully reconstruct high-resolution shapes from as few as three orthogonal slices. Furthermore, our shape model allows us to embed various sparse segmentation masks into a common, low-dimensional latent space — independent of the acquisition direction, resolution, spacing, and field of view. We show that the emerging latent representation discriminates between healthy and pathological shapes, even when provided with sparse segmentation masks. Lastly, we qualitatively demonstrate that the emerging latent space is smooth and captures characteristic modes of shape variation. We evaluate our shape model on two anatomical structures: the lumbar vertebra and the distal femur, both from publicly available datasets. Y1 - 2024 U6 - https://doi.org/10.1016/j.media.2024.103099 VL - 94 SP - 103099 ER - TY - CHAP A1 - Amiranashvili, Tamaz A1 - Lüdke, David A1 - Li, Hongwei A1 - Menze, Bjoern A1 - Zachow, Stefan T1 - Learning Shape Reconstruction from Sparse Measurements with Neural Implicit Functions T2 - Medical Imaging with Deep Learning N2 - Reconstructing anatomical shapes from sparse or partial measurements relies on prior knowledge of shape variations that occur within a given population. Such shape priors are learned from example shapes, obtained by segmenting volumetric medical images. For existing models, the resolution of a learned shape prior is limited to the resolution of the training data. However, in clinical practice, volumetric images are often acquired with highly anisotropic voxel sizes, e.g. to reduce image acquisition time in MRI or radiation exposure in CT imaging. The missing shape information between the slices prohibits existing methods to learn a high-resolution shape prior. We introduce a method for high-resolution shape reconstruction from sparse measurements without relying on high-resolution ground truth for training. Our method is based on neural implicit shape representations and learns a continuous shape prior only from highly anisotropic segmentations. Furthermore, it is able to learn from shapes with a varying field of view and can reconstruct from various sparse input configurations. We demonstrate its effectiveness on two anatomical structures: vertebra and femur, and successfully reconstruct high-resolution shapes from sparse segmentations, using as few as three orthogonal slices. Y1 - 2022 ER - TY - CHAP A1 - Lüdke, David A1 - Amiranashvili, Tamaz A1 - Ambellan, Felix A1 - Ezhov, Ivan A1 - Menze, Bjoern A1 - Zachow, Stefan T1 - Landmark-free Statistical Shape Modeling via Neural Flow Deformations T2 - Medical Image Computing and Computer Assisted Intervention - MICCAI 2022 N2 - Statistical shape modeling aims at capturing shape variations of an anatomical structure that occur within a given population. Shape models are employed in many tasks, such as shape reconstruction and image segmentation, but also shape generation and classification. Existing shape priors either require dense correspondence between training examples or lack robustness and topological guarantees. We present FlowSSM, a novel shape modeling approach that learns shape variability without requiring dense correspondence between training instances. It relies on a hierarchy of continuous deformation flows, which are parametrized by a neural network. Our model outperforms state-of-the-art methods in providing an expressive and robust shape prior for distal femur and liver. We show that the emerging latent representation is discriminative by separating healthy from pathological shapes. Ultimately, we demonstrate its effectiveness on two shape reconstruction tasks from partial data. Our source code is publicly available (https://github.com/davecasp/flowssm). Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-16434-7_44 VL - 13432 PB - Springer, Cham ER -