TY - CHAP A1 - Sahu, Manish A1 - Strömsdörfer, Ronja A1 - Mukhopadhyay, Anirban A1 - Zachow, Stefan T1 - Endo-Sim2Real: Consistency learning-based domain adaptation for instrument segmentation T2 - Proc. Medical Image Computing and Computer Assisted Intervention (MICCAI), Part III N2 - Surgical tool segmentation in endoscopic videos is an important component of computer assisted interventions systems. Recent success of image-based solutions using fully-supervised deep learning approaches can be attributed to the collection of big labeled datasets. However, the annotation of a big dataset of real videos can be prohibitively expensive and time consuming. Computer simulations could alleviate the manual labeling problem, however, models trained on simulated data do not generalize to real data. This work proposes a consistency-based framework for joint learning of simulated and real (unlabeled) endoscopic data to bridge this performance generalization issue. Empirical results on two data sets (15 videos of the Cholec80 and EndoVis'15 dataset) highlight the effectiveness of the proposed Endo-Sim2Real method for instrument segmentation. We compare the segmentation of the proposed approach with state-of-the-art solutions and show that our method improves segmentation both in terms of quality and quantity. Y1 - 2020 U6 - https://doi.org/https://doi.org/10.1007/978-3-030-59716-0_75 VL - 12263 PB - Springer Nature ER - TY - JOUR A1 - Sahu, Manish A1 - Szengel, Angelika A1 - Mukhopadhyay, Anirban A1 - Zachow, Stefan T1 - Surgical phase recognition by learning phase transitions JF - Current Directions in Biomedical Engineering (CDBME) N2 - Automatic recognition of surgical phases is an important component for developing an intra-operative context-aware system. Prior work in this area focuses on recognizing short-term tool usage patterns within surgical phases. However, the difference between intra- and inter-phase tool usage patterns has not been investigated for automatic phase recognition. We developed a Recurrent Neural Network (RNN), in particular a state-preserving Long Short Term Memory (LSTM) architecture to utilize the long-term evolution of tool usage within complete surgical procedures. For fully automatic tool presence detection from surgical video frames, a Convolutional Neural Network (CNN) based architecture namely ZIBNet is employed. Our proposed approach outperformed EndoNet by 8.1% on overall precision for phase detection tasks and 12.5% on meanAP for tool recognition tasks. Y1 - 2020 U6 - https://doi.org/https://doi.org/10.1515/cdbme-2020-0037 N1 - Nomination for the Best-Paper Award VL - 6 IS - 1 SP - 20200037 PB - De Gruyter ER - TY - GEN A1 - Sahu, Manish A1 - Szengel, Angelika A1 - Mukhopadhyay, Anirban A1 - Zachow, Stefan T1 - Analyzing laparoscopic cholecystectomy with deep learning: automatic detection of surgical tools and phases T2 - 28th International Congress of the European Association for Endoscopic Surgery (EAES) N2 - Motivation: The ever-rising volume of patients, high maintenance cost of operating rooms and time consuming analysis of surgical skills are fundamental problems that hamper the practical training of the next generation of surgeons. The hospitals prefer to keep the surgeons busy in real operations over training young surgeons for obvious economic reasons. One fundamental need in surgical training is the reduction of the time needed by the senior surgeon to review the endoscopic procedures performed by the young surgeon while minimizing the subjective bias in evaluation. The unprecedented performance of deep learning ushers the new age of data-driven automatic analysis of surgical skills. Method: Deep learning is capable of efficiently analyzing thousands of hours of laparoscopic video footage to provide an objective assessment of surgical skills. However, the traditional end-to-end setting of deep learning (video in, skill assessment out) is not explainable. Our strategy is to utilize the surgical process modeling framework to divide the surgical process into understandable components. This provides the opportunity to employ deep learning for superior yet automatic detection and evaluation of several aspects of laparoscopic cholecystectomy such as surgical tool and phase detection. We employ ZIBNet for the detection of surgical tool presence. ZIBNet employs pre-processing based on tool usage imbalance, a transfer learned 50-layer residual network (ResNet-50) and temporal smoothing. To encode the temporal evolution of tool usage (over the entire video sequence) that relates to the surgical phases, Long Short Term Memory (LSTM) units are employed with long-term dependency. Dataset: We used CHOLEC 80 dataset that consists of 80 videos of laparoscopic cholecystectomy performed by 13 surgeons, divided equally for training and testing. In these videos, up to three different tools (among 7 types of tools) can be present in a frame. Results: The mean average precision of the detection of all tools is 93.5 ranging between 86.8 and 99.3, a significant improvement (p <0.01) over the previous state-of-the-art. We observed that less frequent tools like Scissors, Irrigator, Specimen Bag etc. are more related to phase transitions. The overall precision (recall) of the detection of all surgical phases is 79.6 (81.3). Conclusion: While this is not the end goal for surgical skill analysis, the development of such a technological platform is essential toward a data-driven objective understanding of surgical skills. In future, we plan to investigate surgeon-in-the-loop analysis and feedback for surgical skill analysis. Y1 - 2020 UR - https://academy.eaes.eu/eaes/2020/28th/298882/manish.sahu.analyzing.laparoscopic.cholecystectomy.with.deep.learning.html?f=listing%3D0%2Abrowseby%3D8%2Asortby%3D2 ER - TY - JOUR A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - Rigid Motion Invariant Statistical Shape Modeling based on Discrete Fundamental Forms JF - Medical Image Analysis N2 - We present a novel approach for nonlinear statistical shape modeling that is invariant under Euclidean motion and thus alignment-free. By analyzing metric distortion and curvature of shapes as elements of Lie groups in a consistent Riemannian setting, we construct a framework that reliably handles large deformations. Due to the explicit character of Lie group operations, our non-Euclidean method is very efficient allowing for fast and numerically robust processing. This facilitates Riemannian analysis of large shape populations accessible through longitudinal and multi-site imaging studies providing increased statistical power. Additionally, as planar configurations form a submanifold in shape space, our representation allows for effective estimation of quasi-isometric surfaces flattenings. We evaluate the performance of our model w.r.t. shape-based classification of hippocampus and femur malformations due to Alzheimer's disease and osteoarthritis, respectively. In particular, we achieve state-of-the-art accuracies outperforming the standard Euclidean as well as a recent nonlinear approach especially in presence of sparse training data. To provide insight into the model's ability of capturing biological shape variability, we carry out an analysis of specificity and generalization ability. Y1 - 2021 U6 - https://doi.org/10.1016/j.media.2021.102178 VL - 73 ER - TY - JOUR A1 - Sahu, Manish A1 - Mukhopadhyay, Anirban A1 - Zachow, Stefan T1 - Simulation-to-Real domain adaptation with teacher-student learning for endoscopic instrument segmentation JF - International Journal of Computer Assisted Radiology and Surgery N2 - Purpose Segmentation of surgical instruments in endoscopic video streams is essential for automated surgical scene understanding and process modeling. However, relying on fully supervised deep learning for this task is challenging because manual annotation occupies valuable time of the clinical experts. Methods We introduce a teacher–student learning approach that learns jointly from annotated simulation data and unlabeled real data to tackle the challenges in simulation-to-real unsupervised domain adaptation for endoscopic image segmentation. Results Empirical results on three datasets highlight the effectiveness of the proposed framework over current approaches for the endoscopic instrument segmentation task. Additionally, we provide analysis of major factors affecting the performance on all datasets to highlight the strengths and failure modes of our approach. Conclusions We show that our proposed approach can successfully exploit the unlabeled real endoscopic video frames and improve generalization performance over pure simulation-based training and the previous state-of-the-art. This takes us one step closer to effective segmentation of surgical instrument in the annotation scarce setting. Y1 - 2021 U6 - https://doi.org/10.1007/s11548-021-02383-4 N1 - Honorary Mention: Machine Learning for Computer-Assisted Intervention (CAI) Award @IPCAI2021 N1 - Honorary Mention: Audience Award for Best Innovation @IPCAI2021 VL - 16 SP - 849 EP - 859 PB - Springer Nature ER - TY - CHAP A1 - Estacio, Laura A1 - Ehlke, Moritz A1 - Tack, Alexander A1 - Castro-Gutierrez, Eveling A1 - Lamecker, Hans A1 - Mora, Rensso A1 - Zachow, Stefan T1 - Unsupervised Detection of Disturbances in 2D Radiographs T2 - 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI) N2 - We present a method based on a generative model for detection of disturbances such as prosthesis, screws, zippers, and metals in 2D radiographs. The generative model is trained in an unsupervised fashion using clinical radiographs as well as simulated data, none of which contain disturbances. Our approach employs a latent space consistency loss which has the benefit of identifying similarities, and is enforced to reconstruct X-rays without disturbances. In order to detect images with disturbances, an anomaly score is computed also employing the Frechet distance between the input X-ray and the reconstructed one using our generative model. Validation was performed using clinical pelvis radiographs. We achieved an AUC of 0.77 and 0.83 with clinical and synthetic data, respectively. The results demonstrated a good accuracy of our method for detecting outliers as well as the advantage of utilizing synthetic data. Y1 - 2021 U6 - https://doi.org/10.1109/ISBI48211.2021.9434091 SP - 367 EP - 370 ER - TY - GEN A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - Geodesic B-Score for Improved Assessment of Knee Osteoarthritis N2 - Three-dimensional medical imaging enables detailed understanding of osteoarthritis structural status. However, there remains a vast need for automatic, thus, reader-independent measures that provide reliable assessment of subject-specific clinical outcomes. To this end, we derive a consistent generalization of the recently proposed B-score to Riemannian shape spaces. We further present an algorithmic treatment yielding simple, yet efficient computations allowing for analysis of large shape populations with several thousand samples. Our intrinsic formulation exhibits improved discrimination ability over its Euclidean counterpart, which we demonstrate for predictive validity on assessing risks of total knee replacement. This result highlights the potential of the geodesic B-score to enable improved personalized assessment and stratification for interventions. T3 - ZIB-Report - 21-09 KW - Statistical shape analysis KW - Osteoarthritis KW - Geometric statistics KW - Riemannian manifolds Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-81930 SN - 1438-0064 ER - TY - JOUR A1 - Tack, Alexander A1 - Preim, Bernhard A1 - Zachow, Stefan T1 - Fully automated Assessment of Knee Alignment from Full-Leg X-Rays employing a "YOLOv4 And Resnet Landmark regression Algorithm" (YARLA): Data from the Osteoarthritis Initiative JF - Computer Methods and Programs in Biomedicine N2 - We present a method for the quantification of knee alignment from full-leg X-Rays. A state-of-the-art object detector, YOLOv4, was trained to locate regions of interests (ROIs) in full-leg X-Ray images for the hip joint, the knee, and the ankle. Residual neural networks (ResNets) were trained to regress landmark coordinates for each ROI.Based on the detected landmarks the knee alignment, i.e., the hip-knee-ankle (HKA) angle, was computed. The accuracy of landmark detection was evaluated by a comparison to manually placed landmarks for 360 legs in 180 X-Rays. The accuracy of HKA angle computations was assessed on the basis of 2,943 X-Rays. Results of YARLA were compared to the results of two independent image reading studies(Cooke; Duryea) both publicly accessible via the Osteoarthritis Initiative. The agreement was evaluated using Spearman's Rho, and weighted kappa as well as regarding the correspondence of the class assignment (varus/neutral/valgus). The average difference between YARLA and manually placed landmarks was less than 2.0+- 1.5 mm for all structures (hip, knee, ankle). The average mismatch between HKA angle determinations of Cooke and Duryea was 0.09 +- 0.63°; YARLA resulted in a mismatch of 0.10 +- 0.74° compared to Cooke and of 0.18 +- 0.64° compared to Duryea. Cooke and Duryea agreed almost perfectly with respect to a weighted kappa value of 0.86, and showed an excellent reliability as measured by a Spearman's Rho value of 0.99. Similar values were achieved by YARLA, i.e., a weighted kappa value of0.83 and 0.87 and a Spearman's Rho value of 0.98 and 0.99 to Cooke and Duryea,respectively. Cooke and Duryea agreed in 92% of all class assignments and YARLA did so in 90% against Cooke and 92% against Duryea. In conclusion, YARLA achieved results comparable to those of human experts and thus provides a basis for an automated assessment of knee alignment in full-leg X-Rays. Y1 - 2021 U6 - https://doi.org/https://doi.org/10.1016/j.cmpb.2021.106080 VL - 205 IS - 106080 ER - TY - CHAP A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - Geodesic B-Score for Improved Assessment of Knee Osteoarthritis T2 - Proc. Information Processing in Medical Imaging (IPMI) N2 - Three-dimensional medical imaging enables detailed understanding of osteoarthritis structural status. However, there remains a vast need for automatic, thus, reader-independent measures that provide reliable assessment of subject-specific clinical outcomes. To this end, we derive a consistent generalization of the recently proposed B-score to Riemannian shape spaces. We further present an algorithmic treatment yielding simple, yet efficient computations allowing for analysis of large shape populations with several thousand samples. Our intrinsic formulation exhibits improved discrimination ability over its Euclidean counterpart, which we demonstrate for predictive validity on assessing risks of total knee replacement. This result highlights the potential of the geodesic B-score to enable improved personalized assessment and stratification for interventions. Y1 - 2021 U6 - https://doi.org/10.1007/978-3-030-78191-0_14 SP - 177 EP - 188 ER - TY - JOUR A1 - Hembus, Jessica A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - Bader, Rainer T1 - Establishment of a rolling-sliding test bench to analyze abrasive wear propagation of different bearing materials for knee implants JF - Applied Sciences N2 - Currently, new materials for knee implants need to be extensively and expensive tested in a knee wear simulator in a realized design. However, using a rolling-sliding test bench, these materials can be examined under the same test conditions but with simplified geometries. In the present study, the test bench was optimized, and forces were adapted to the physiological contact pressure in the knee joint using the available geometric parameters. Various polymers made of polyethylene and polyurethane articulating against test wheels made of cobalt-chromium and aluminum titanate were tested in the test bench using adapted forces based on ISO 14243-1. Polyurethane materials showed distinctly higher wear rates than polyethylene materials and showed inadequate wear resistance for use as knee implant material. Thus, the rolling-sliding test bench is an adaptable test setup for evaluating newly developed bearing materials for knee implants. It combines the advantages of screening and simulator tests and allows testing of various bearing materials under physiological load and tribological conditions of the human knee joint. The wear behavior of different material compositions and the influence of surface geometry and quality can be initially investigated without the need to produce complex implant prototypes of total knee endoprosthesis or interpositional spacers. Y1 - 2021 U6 - https://doi.org/10.3390/app11041886 VL - 11 IS - 4 ER - TY - JOUR A1 - Pimentel, Pedro A1 - Szengel, Angelika A1 - Ehlke, Moritz A1 - Lamecker, Hans A1 - Zachow, Stefan A1 - Estacio, Laura A1 - Doenitz, Christian A1 - Ramm, Heiko ED - Li, Jianning ED - Egger, Jan T1 - Automated Virtual Reconstruction of Large Skull Defects using Statistical Shape Models and Generative Adversarial Networks BT - First Challenge, AutoImplant 2020, Held in Conjunction with MICCAI 2020, Lima, Peru, October 8, 2020, Proceedings JF - Towards the Automatization of Cranial Implant Design in Cranioplasty N2 - We present an automated method for extrapolating missing regions in label data of the skull in an anatomically plausible manner. The ultimate goal is to design patient-speci� c cranial implants for correcting large, arbitrarily shaped defects of the skull that can, for example, result from trauma of the head. Our approach utilizes a 3D statistical shape model (SSM) of the skull and a 2D generative adversarial network (GAN) that is trained in an unsupervised fashion from samples of healthy patients alone. By � tting the SSM to given input labels containing the skull defect, a First approximation of the healthy state of the patient is obtained. The GAN is then applied to further correct and smooth the output of the SSM in an anatomically plausible manner. Finally, the defect region is extracted using morphological operations and subtraction between the extrapolated healthy state of the patient and the defective input labels. The method is trained and evaluated based on data from the MICCAI 2020 AutoImplant challenge. It produces state-of-the art results on regularly shaped cut-outs that were present in the training and testing data of the challenge. Furthermore, due to unsupervised nature of the approach, the method generalizes well to previously unseen defects of varying shapes that were only present in the hidden test dataset. Y1 - 2020 U6 - https://doi.org/10.1007/978-3-030-64327-0_3 N1 - Best Paper Award VL - 12439 SP - 16 EP - 27 PB - Springer International Publishing ET - 1 ER - TY - JOUR A1 - Oeltze-Jaffra, Steffen A1 - Meuschke, Monique A1 - Neugebauer, Mathias A1 - Saalfeld, Sylvia A1 - Lawonn, Kai A1 - Janiga, Gabor A1 - Hege, Hans-Christian A1 - Zachow, Stefan A1 - Preim, Bernhard T1 - Generation and Visual Exploration of Medical Flow Data: Survey, Research Trends, and Future Challenges JF - Computer Graphics Forum N2 - Simulations and measurements of blood and air flow inside the human circulatory and respiratory system play an increasingly important role in personalized medicine for prevention, diagnosis, and treatment of diseases. This survey focuses on three main application areas. (1) Computational Fluid Dynamics (CFD) simulations of blood flow in cerebral aneurysms assist in predicting the outcome of this pathologic process and of therapeutic interventions. (2) CFD simulations of nasal airflow allow for investigating the effects of obstructions and deformities and provide therapy decision support. (3) 4D Phase-Contrast (4D PC) Magnetic Resonance Imaging (MRI) of aortic hemodynamics supports the diagnosis of various vascular and valve pathologies as well as their treatment. An investigation of the complex and often dynamic simulation and measurement data requires the coupling of sophisticated visualization, interaction, and data analysis techniques. In this paper, we survey the large body of work that has been conducted within this realm. We extend previous surveys by incorporating nasal airflow, addressing the joint investigation of blood flow and vessel wall properties, and providing a more fine-granular taxonomy of the existing techniques. From the survey, we extract major research trends and identify open problems and future challenges. The survey is intended for researchers interested in medical flow but also more general, in the combined visualization of physiology and anatomy, the extraction of features from flow field data and feature-based visualization, the visual comparison of different simulation results, and the interactive visual analysis of the flow field and derived characteristics. Y1 - 2019 U6 - https://doi.org/10.1111/cgf.13394 VL - 38 IS - 1 SP - 87 EP - 125 PB - Wiley ER - TY - GEN A1 - Ambellan, Felix A1 - Lamecker, Hans A1 - von Tycowicz, Christoph A1 - Zachow, Stefan T1 - Statistical Shape Models - Understanding and Mastering Variation in Anatomy N2 - In our chapter we are describing how to reconstruct three-dimensional anatomy from medical image data and how to build Statistical 3D Shape Models out of many such reconstructions yielding a new kind of anatomy that not only allows quantitative analysis of anatomical variation but also a visual exploration and educational visualization. Future digital anatomy atlases will not only show a static (average) anatomy but also its normal or pathological variation in three or even four dimensions, hence, illustrating growth and/or disease progression. Statistical Shape Models (SSMs) are geometric models that describe a collection of semantically similar objects in a very compact way. SSMs represent an average shape of many three-dimensional objects as well as their variation in shape. The creation of SSMs requires a correspondence mapping, which can be achieved e.g. by parameterization with a respective sampling. If a corresponding parameterization over all shapes can be established, variation between individual shape characteristics can be mathematically investigated. We will explain what Statistical Shape Models are and how they are constructed. Extensions of Statistical Shape Models will be motivated for articulated coupled structures. In addition to shape also the appearance of objects will be integrated into the concept. Appearance is a visual feature independent of shape that depends on observers or imaging techniques. Typical appearances are for instance the color and intensity of a visual surface of an object under particular lighting conditions, or measurements of material properties with computed tomography (CT) or magnetic resonance imaging (MRI). A combination of (articulated) statistical shape models with statistical models of appearance lead to articulated Statistical Shape and Appearance Models (a-SSAMs).After giving various examples of SSMs for human organs, skeletal structures, faces, and bodies, we will shortly describe clinical applications where such models have been successfully employed. Statistical Shape Models are the foundation for the analysis of anatomical cohort data, where characteristic shapes are correlated to demographic or epidemiologic data. SSMs consisting of several thousands of objects offer, in combination with statistical methods ormachine learning techniques, the possibility to identify characteristic clusters, thus being the foundation for advanced diagnostic disease scoring. T3 - ZIB-Report - 19-13 Y1 - 2019 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-72699 SN - 1438-0064 ER - TY - CHAP A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - A Surface-Theoretic Approach for Statistical Shape Modeling T2 - Proc. Medical Image Computing and Computer Assisted Intervention (MICCAI), Part IV N2 - We present a novel approach for nonlinear statistical shape modeling that is invariant under Euclidean motion and thus alignment-free. By analyzing metric distortion and curvature of shapes as elements of Lie groups in a consistent Riemannian setting, we construct a framework that reliably handles large deformations. Due to the explicit character of Lie group operations, our non-Euclidean method is very efficient allowing for fast and numerically robust processing. This facilitates Riemannian analysis of large shape populations accessible through longitudinal and multi-site imaging studies providing increased statistical power. We evaluate the performance of our model w.r.t. shape-based classification of pathological malformations of the human knee and show that it outperforms the standard Euclidean as well as a recent nonlinear approach especially in presence of sparse training data. To provide insight into the model’s ability of capturing natural biological shape variability, we carry out an analysis of specificity and generalization ability. Y1 - 2019 U6 - https://doi.org/10.1007/978-3-030-32251-9_3 VL - 11767 SP - 21 EP - 29 PB - Springer ER - TY - JOUR A1 - Hildebrandt, Thomas A1 - Bruening, Jan Joris A1 - Schmidt, Nora Laura A1 - Lamecker, Hans A1 - Heppt, Werner A1 - Zachow, Stefan A1 - Goubergrits, Leonid T1 - The Healthy Nasal Cavity - Characteristics of Morphology and Related Airflow Based on a Statistical Shape Model Viewed from a Surgeon’s Perspective JF - Facial Plastic Surgery N2 - Functional surgery on the nasal framework requires referential criteria to objectively assess nasal breathing for indication and follow-up. Thismotivated us to generate amean geometry of the nasal cavity based on a statistical shape model. In this study, the authors could demonstrate that the introduced nasal cavity’s mean geometry features characteristics of the inner shape and airflow, which are commonly observed in symptom-free subjects. Therefore, the mean geometry might serve as a reference-like model when one considers qualitative aspects. However, to facilitate quantitative considerations and statistical inference, further research is necessary. Additionally, the authorswere able to obtain details about the importance of the isthmus nasi and the inferior turbinate for the intranasal airstream. KW - statistical shape model KW - nasal cavity KW - nasal breathing KW - nasal airflow KW - isthmus nasi KW - inferior turbinate Y1 - 2019 U6 - https://doi.org/10.1055/s-0039-1677721 VL - 35 IS - 1 SP - 9 EP - 13 ER - TY - JOUR A1 - Hildebrandt, Thomas A1 - Bruening, Jan Joris A1 - Lamecker, Hans A1 - Zachow, Stefan A1 - Heppt, Werner A1 - Schmidt, Nora A1 - Goubergrits, Leonid T1 - Digital Analysis of Nasal Airflow Facilitating Decision Support in Rhinosurgery JF - Facial Plastic Surgery N2 - Successful functional surgery on the nasal framework requires reliable and comprehensive diagnosis. In this regard, the authors introduce a new methodology: Digital Analysis of Nasal Airflow (diANA). It is based on computational fluid dynamics, a statistical shape model of the healthy nasal cavity and rhinologic expertise. diANA necessitates an anonymized tomographic dataset of the paranasal sinuses including the complete nasal cavity and, when available, clinical information. The principle of diANA is to compare the morphology and the respective airflow of an individual nose with those of a reference. This enablesmorphometric aberrations and consecutive flow field anomalies to localize and quantify within a patient’s nasal cavity. Finally, an elaborated expert opinion with instructive visualizations is provided. Using diANA might support surgeons in decision-making, avoiding unnecessary surgery, gaining more precision, and target-orientation for indicated operations. KW - nasal airflow simulation KW - nasal breathing KW - statistical shape model KW - diANA KW - nasal obstruction KW - rhinorespiratory homeostasis Y1 - 2019 U6 - https://doi.org/10.1055/s-0039-1677720 VL - 35 IS - 1 SP - 1 EP - 8 ER - TY - CHAP A1 - Ambellan, Felix A1 - Lamecker, Hans A1 - von Tycowicz, Christoph A1 - Zachow, Stefan ED - Rea, Paul M. T1 - Statistical Shape Models - Understanding and Mastering Variation in Anatomy T2 - Biomedical Visualisation N2 - In our chapter we are describing how to reconstruct three-dimensional anatomy from medical image data and how to build Statistical 3D Shape Models out of many such reconstructions yielding a new kind of anatomy that not only allows quantitative analysis of anatomical variation but also a visual exploration and educational visualization. Future digital anatomy atlases will not only show a static (average) anatomy but also its normal or pathological variation in three or even four dimensions, hence, illustrating growth and/or disease progression. Statistical Shape Models (SSMs) are geometric models that describe a collection of semantically similar objects in a very compact way. SSMs represent an average shape of many three-dimensional objects as well as their variation in shape. The creation of SSMs requires a correspondence mapping, which can be achieved e.g. by parameterization with a respective sampling. If a corresponding parameterization over all shapes can be established, variation between individual shape characteristics can be mathematically investigated. We will explain what Statistical Shape Models are and how they are constructed. Extensions of Statistical Shape Models will be motivated for articulated coupled structures. In addition to shape also the appearance of objects will be integrated into the concept. Appearance is a visual feature independent of shape that depends on observers or imaging techniques. Typical appearances are for instance the color and intensity of a visual surface of an object under particular lighting conditions, or measurements of material properties with computed tomography (CT) or magnetic resonance imaging (MRI). A combination of (articulated) statistical shape models with statistical models of appearance lead to articulated Statistical Shape and Appearance Models (a-SSAMs).After giving various examples of SSMs for human organs, skeletal structures, faces, and bodies, we will shortly describe clinical applications where such models have been successfully employed. Statistical Shape Models are the foundation for the analysis of anatomical cohort data, where characteristic shapes are correlated to demographic or epidemiologic data. SSMs consisting of several thousands of objects offer, in combination with statistical methods ormachine learning techniques, the possibility to identify characteristic clusters, thus being the foundation for advanced diagnostic disease scoring. Y1 - 2019 SN - 978-3-030-19384-3 SN - 978-3-030-19385-0 U6 - https://doi.org/10.1007/978-3-030-19385-0_5 VL - 3 IS - 1156 SP - 67 EP - 84 PB - Springer Nature Switzerland AG ET - 1 ER - TY - CHAP A1 - Ambellan, Felix A1 - Tack, Alexander A1 - Ehlke, Moritz A1 - Zachow, Stefan T1 - Automated Segmentation of Knee Bone and Cartilage combining Statistical Shape Knowledge and Convolutional Neural Networks: Data from the Osteoarthritis Initiative T2 - Medical Imaging with Deep Learning N2 - We present a method for the automated segmentation of knee bones and cartilage from magnetic resonance imaging, that combines a priori knowledge of anatomical shape with Convolutional Neural Networks (CNNs). The proposed approach incorporates 3D Statistical Shape Models (SSMs) as well as 2D and 3D CNNs to achieve a robust and accurate segmentation of even highly pathological knee structures. The method is evaluated on data of the MICCAI grand challenge "Segmentation of Knee Images 2010". For the first time an accuracy equivalent to the inter-observer variability of human readers has been achieved in this challenge. Moreover, the quality of the proposed method is thoroughly assessed using various measures for 507 manual segmentations of bone and cartilage, and 88 additional manual segmentations of cartilage. Our method yields sub-voxel accuracy. In conclusion, combining of anatomical knowledge using SSMs with localized classification via CNNs results in a state-of-the-art segmentation method. Y1 - 2018 ER - TY - GEN A1 - Sahu, Manish A1 - Dill, Sabrina A1 - Mukhopadyay, Anirban A1 - Zachow, Stefan T1 - Surgical Tool Presence Detection for Cataract Procedures N2 - This article outlines the submission to the CATARACTS challenge for automatic tool presence detection [1]. Our approach for this multi-label classification problem comprises labelset-based sampling, a CNN architecture and temporal smothing as described in [3], which we call ZIB-Res-TS. T3 - ZIB-Report - 18-28 Y1 - 2017 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-69110 SN - 1438-0064 ER - TY - JOUR A1 - Al Hajj, Hassan A1 - Sahu, Manish A1 - Lamard, Mathieu A1 - Conze, Pierre-Henri A1 - Roychowdhury, Soumali A1 - Hu, Xiaowei A1 - Marsalkaite, Gabija A1 - Zisimopoulos, Odysseas A1 - Dedmari, Muneer Ahmad A1 - Zhao, Fenqiang A1 - Prellberg, Jonas A1 - Galdran, Adrian A1 - Araujo, Teresa A1 - Vo, Duc My A1 - Panda, Chandan A1 - Dahiya, Navdeep A1 - Kondo, Satoshi A1 - Bian, Zhengbing A1 - Bialopetravicius, Jonas A1 - Qiu, Chenghui A1 - Dill, Sabrina A1 - Mukhopadyay, Anirban A1 - Costa, Pedro A1 - Aresta, Guilherme A1 - Ramamurthy, Senthil A1 - Lee, Sang-Woong A1 - Campilho, Aurelio A1 - Zachow, Stefan A1 - Xia, Shunren A1 - Conjeti, Sailesh A1 - Armaitis, Jogundas A1 - Heng, Pheng-Ann A1 - Vahdat, Arash A1 - Cochener, Beatrice A1 - Quellec, Gwenole T1 - CATARACTS: Challenge on Automatic Tool Annotation for cataRACT Surgery JF - Medical Image Analysis N2 - Surgical tool detection is attracting increasing attention from the medical image analysis community. The goal generally is not to precisely locate tools in images, but rather to indicate which tools are being used by the surgeon at each instant. The main motivation for annotating tool usage is to design efficient solutions for surgical workflow analysis, with potential applications in report generation, surgical training and even real-time decision support. Most existing tool annotation algorithms focus on laparoscopic surgeries. However, with 19 million interventions per year, the most common surgical procedure in the world is cataract surgery. The CATARACTS challenge was organized in 2017 to evaluate tool annotation algorithms in the specific context of cataract surgery. It relies on more than nine hours of videos, from 50 cataract surgeries, in which the presence of 21 surgical tools was manually annotated by two experts. With 14 participating teams, this challenge can be considered a success. As might be expected, the submitted solutions are based on deep learning. This paper thoroughly evaluates these solutions: in particular, the quality of their annotations are compared to that of human interpretations. Next, lessons learnt from the differential analysis of these solutions are discussed. We expect that they will guide the design of efficient surgery monitoring tools in the near future. Y1 - 2019 U6 - https://doi.org/10.1016/j.media.2018.11.008 N1 - Best paper award - Computer Graphics Night 2020 (TU Darmstadt) VL - 52 IS - 2 SP - 24 EP - 41 PB - Elsevier ER -