TY - JOUR A1 - Li, Jianning A1 - Pimentel, Pedro A1 - Szengel, Angelika A1 - Ehlke, Moritz A1 - Lamecker, Hans A1 - Zachow, Stefan A1 - Estacio, Laura A1 - Doenitz, Christian A1 - Ramm, Heiko A1 - Shi, Haochen A1 - Chen, Xiaojun A1 - Matzkin, Franco A1 - Newcombe, Virginia A1 - Ferrante, Enzo A1 - Jin, Yuan A1 - Ellis, David G. A1 - Aizenberg, Michele R. A1 - Kodym, Oldrich A1 - Spanel, Michal A1 - Herout, Adam A1 - Mainprize, James G. A1 - Fishman, Zachary A1 - Hardisty, Michael R. A1 - Bayat, Amirhossein A1 - Shit, Suprosanna A1 - Wang, Bomin A1 - Liu, Zhi A1 - Eder, Matthias A1 - Pepe, Antonio A1 - Gsaxner, Christina A1 - Alves, Victor A1 - Zefferer, Ulrike A1 - von Campe, Cord A1 - Pistracher, Karin A1 - Schäfer, Ute A1 - Schmalstieg, Dieter A1 - Menze, Bjoern H. A1 - Glocker, Ben A1 - Egger, Jan T1 - AutoImplant 2020 - First MICCAI Challenge on Automatic Cranial Implant Design JF - IEEE Transactions on Medical Imaging N2 - The aim of this paper is to provide a comprehensive overview of the MICCAI 2020 AutoImplant Challenge. The approaches and publications submitted and accepted within the challenge will be summarized and reported, highlighting common algorithmic trends and algorithmic diversity. Furthermore, the evaluation results will be presented, compared and discussed in regard to the challenge aim: seeking for low cost, fast and fully automated solutions for cranial implant design. Based on feedback from collaborating neurosurgeons, this paper concludes by stating open issues and post-challenge requirements for intra-operative use. Y1 - 2021 U6 - https://doi.org/10.1109/TMI.2021.3077047 SN - 0278-0062 VL - 40 IS - 9 SP - 2329 EP - 2342 ER - TY - THES A1 - Dill, Sabrina T1 - Joint Feature Learning and Classification - Deep Learning for Surgical Phase Detection N2 - In this thesis we investigate the task of automatically detecting phases in surgical workflow in endoscopic video data. For this, we employ deep learning approaches that solely rely on frame-wise visual information, instead of using additional signals or handcrafted features. While previous work has mainly focused on tool presence and temporal information for this task, we reason that additional global information about the context of a frame might benefit the phase detection task. We propose novel deep learning architectures: a convolutional neural network (CNN) based model for the tool detection task only, called Clf-Net, as well as a model which performs joint (context) feature learning and tool classification to incorporate information about the context, which we name Context-Clf-Net. For the phase detection task lower-dimensional feature vectors are extracted, which are used as input to recurrent neural networks in order to enforce temporal constraints. We compare the performance of an online model, which only considers previous frames up to the current time step, to that of an offline model that has access to past and future information. Experimental results indicate that the tool detection task benefits strongly from the introduction of context information, as we outperform both Clf-Net results and stateof-the-art methods. Regarding the phase detection task our results do not surpass state-of-the-art methods. Furthermore, no improvement of using features learned by the Context-Clf-Net is observed in the phase detection task for both online and offline versions Y1 - 2018 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-81745 ER - TY - JOUR A1 - Sahu, Manish A1 - Mukhopadhyay, Anirban A1 - Zachow, Stefan T1 - Simulation-to-Real domain adaptation with teacher-student learning for endoscopic instrument segmentation JF - International Journal of Computer Assisted Radiology and Surgery N2 - Purpose Segmentation of surgical instruments in endoscopic video streams is essential for automated surgical scene understanding and process modeling. However, relying on fully supervised deep learning for this task is challenging because manual annotation occupies valuable time of the clinical experts. Methods We introduce a teacher–student learning approach that learns jointly from annotated simulation data and unlabeled real data to tackle the challenges in simulation-to-real unsupervised domain adaptation for endoscopic image segmentation. Results Empirical results on three datasets highlight the effectiveness of the proposed framework over current approaches for the endoscopic instrument segmentation task. Additionally, we provide analysis of major factors affecting the performance on all datasets to highlight the strengths and failure modes of our approach. Conclusions We show that our proposed approach can successfully exploit the unlabeled real endoscopic video frames and improve generalization performance over pure simulation-based training and the previous state-of-the-art. This takes us one step closer to effective segmentation of surgical instrument in the annotation scarce setting. Y1 - 2021 U6 - https://doi.org/10.1007/s11548-021-02383-4 N1 - Honorary Mention: Machine Learning for Computer-Assisted Intervention (CAI) Award @IPCAI2021 N1 - Honorary Mention: Audience Award for Best Innovation @IPCAI2021 VL - 16 SP - 849 EP - 859 PB - Springer Nature ER - TY - JOUR A1 - Sekuboyina, Anjany A1 - Bayat, Amirhossein A1 - Husseini, Malek E. A1 - Löffler, Maximilian A1 - Li, Hongwei A1 - Tetteh, Giles A1 - Kukačka, Jan A1 - Payer, Christian A1 - Štern, Darko A1 - Urschler, Martin A1 - Chen, Maodong A1 - Cheng, Dalong A1 - Lessmann, Nikolas A1 - Hu, Yujin A1 - Wang, Tianfu A1 - Yang, Dong A1 - Xu, Daguang A1 - Ambellan, Felix A1 - Amiranashvili, Tamaz A1 - Ehlke, Moritz A1 - Lamecker, Hans A1 - Lehnert, Sebastian A1 - Lirio, Marilia A1 - de Olaguer, Nicolás Pérez A1 - Ramm, Heiko A1 - Sahu, Manish A1 - Tack, Alexander A1 - Zachow, Stefan A1 - Jiang, Tao A1 - Ma, Xinjun A1 - Angerman, Christoph A1 - Wang, Xin A1 - Wei, Qingyue A1 - Brown, Kevin A1 - Wolf, Matthias A1 - Kirszenberg, Alexandre A1 - Puybareau, Élodie A1 - Valentinitsch, Alexander A1 - Rempfler, Markus A1 - Menze, Björn H. A1 - Kirschke, Jan S. T1 - VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Images JF - arXiv Y1 - 2020 ER - TY - JOUR A1 - Pimentel, Pedro A1 - Szengel, Angelika A1 - Ehlke, Moritz A1 - Lamecker, Hans A1 - Zachow, Stefan A1 - Estacio, Laura A1 - Doenitz, Christian A1 - Ramm, Heiko ED - Li, Jianning ED - Egger, Jan T1 - Automated Virtual Reconstruction of Large Skull Defects using Statistical Shape Models and Generative Adversarial Networks BT - First Challenge, AutoImplant 2020, Held in Conjunction with MICCAI 2020, Lima, Peru, October 8, 2020, Proceedings JF - Towards the Automatization of Cranial Implant Design in Cranioplasty N2 - We present an automated method for extrapolating missing regions in label data of the skull in an anatomically plausible manner. The ultimate goal is to design patient-speci� c cranial implants for correcting large, arbitrarily shaped defects of the skull that can, for example, result from trauma of the head. Our approach utilizes a 3D statistical shape model (SSM) of the skull and a 2D generative adversarial network (GAN) that is trained in an unsupervised fashion from samples of healthy patients alone. By � tting the SSM to given input labels containing the skull defect, a First approximation of the healthy state of the patient is obtained. The GAN is then applied to further correct and smooth the output of the SSM in an anatomically plausible manner. Finally, the defect region is extracted using morphological operations and subtraction between the extrapolated healthy state of the patient and the defective input labels. The method is trained and evaluated based on data from the MICCAI 2020 AutoImplant challenge. It produces state-of-the art results on regularly shaped cut-outs that were present in the training and testing data of the challenge. Furthermore, due to unsupervised nature of the approach, the method generalizes well to previously unseen defects of varying shapes that were only present in the hidden test dataset. Y1 - 2020 U6 - https://doi.org/10.1007/978-3-030-64327-0_3 N1 - Best Paper Award VL - 12439 SP - 16 EP - 27 PB - Springer International Publishing ET - 1 ER - TY - JOUR A1 - Brüning, Jan A1 - Hildebrandt, Thomas A1 - Heppt, Werner A1 - Schmidt, Nora A1 - Lamecker, Hans A1 - Szengel, Angelika A1 - Amiridze, Natalja A1 - Ramm, Heiko A1 - Bindernagel, Matthias A1 - Zachow, Stefan A1 - Goubergrits, Leonid T1 - Characterization of the Airflow within an Average Geometry of the Healthy Human Nasal Cavity JF - Scientific Reports N2 - This study’s objective was the generation of a standardized geometry of the healthy nasal cavity. An average geometry of the healthy nasal cavity was generated using a statistical shape model based on 25 symptom-free subjects. Airflow within the average geometry and these geometries was calculated using fluid simulations. Integral measures of the nasal resistance, wall shear stresses (WSS) and velocities were calculated as well as cross-sectional areas (CSA). Furthermore, individual WSS and static pressure distributions were mapped onto the average geometry. The average geometry featured an overall more regular shape that resulted in less resistance, reduced wall shear stresses and velocities compared to the median of the 25 geometries. Spatial distributions of WSS and pressure of average geometry agreed well compared to the average distributions of all individual geometries. The minimal CSA of the average geometry was larger than the median of all individual geometries (83.4 vs. 74.7 mm²). The airflow observed within the average geometry of the healthy nasal cavity did not equal the average airflow of the individual geometries. While differences observed for integral measures were notable, the calculated values for the average geometry lay within the distributions of the individual parameters. Spatially resolved parameters differed less prominently. Y1 - 2020 UR - https://rdcu.be/b2irD U6 - https://doi.org/10.1038/s41598-020-60755-3 VL - 3755 IS - 10 ER - TY - THES A1 - Amiridze, Natalja T1 - Morphological indicators for limitations in nasal breathing T1 - Morphologische Indikatoren für Einschränkungen der Nasenatmung N2 - In order to better understand the relationship between shape of the nasal cavity and to find objective classification for breathing obstruction, a population of 25 cases of healthy nasal cavity and 27 cases with diagnosed nasal airway obstruction (NAO) was examined for correlations between morphological, clinical and CFD parameters. For this purpose a workflow was implemented in Tcl to perform automatic measurements of morphological parameters of nasal cavity surfaces in Amira, which has as output a table with all estimated values. Furthermore, the statistical analysis was designed using Python to find the most probable subset of parameters that are predictors of nasal cavity pathology and consisted of correlation analysis, the selection of the best possible subset of parameters that could be used as predictors of clinically stated pathology of the nasal cavity by a logistic regression classifier. As a result, 10 most promising parameters were identified: mean distance between the two isthmuses, left isthmus contour, area ratio between the two isthmuses, left isthmus height, height ratio between the two isthmuses, left isthmus width, right isthmus width, right isthmus hydraulic diameter, mean distance of septal curvature between the septum enclosing walls of the nasal cavity, velocities volume average by expiration. As it turns out, most parameters refer to the isthmus region. This was to be expected since this region plays an important role in the airflow system of the nasal cavity. Y1 - 2020 ER - TY - GEN A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - An as-invariant-as-possible GL+(3)-based Statistical Shape Model N2 - We describe a novel nonlinear statistical shape model basedon differential coordinates viewed as elements of GL+(3). We adopt an as-invariant-as possible framework comprising a bi-invariant Lie group mean and a tangent principal component analysis based on a unique GL+(3)-left-invariant, O(3)-right-invariant metric. Contrary to earlier work that equips the coordinates with a specifically constructed group structure, our method employs the inherent geometric structure of the group-valued data and therefore features an improved statistical power in identifying shape differences. We demonstrate this in experiments on two anatomical datasets including comparison to the standard Euclidean as well as recent state-of-the-art nonlinear approaches to statistical shape modeling. T3 - ZIB-Report - 19-46 KW - Statistical shape analysis KW - Tangent principal component analysis KW - Lie groups KW - Classification KW - Manifold valued statistics Y1 - 2019 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-74566 SN - 1438-0064 ER - TY - GEN A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - A Surface-Theoretic Approach for Statistical Shape Modeling N2 - We present a novel approach for nonlinear statistical shape modeling that is invariant under Euclidean motion and thus alignment-free. By analyzing metric distortion and curvature of shapes as elements of Lie groups in a consistent Riemannian setting, we construct a framework that reliably handles large deformations. Due to the explicit character of Lie group operations, our non-Euclidean method is very efficient allowing for fast and numerically robust processing. This facilitates Riemannian analysis of large shape populations accessible through longitudinal and multi-site imaging studies providing increased statistical power. We evaluate the performance of our model w.r.t. shape-based classification of pathological malformations of the human knee and show that it outperforms the standard Euclidean as well as a recent nonlinear approach especially in presence of sparse training data. To provide insight into the model's ability of capturing natural biological shape variability, we carry out an analysis of specificity and generalization ability. T3 - ZIB-Report - 19-20 KW - Statistical shape analysis KW - Principal geodesic analysis KW - Lie groups KW - Classification KW - Manifold valued statistics Y1 - 2019 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-74497 SN - 1438-0064 ER - TY - CHAP A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - An as-invariant-as-possible GL+(3)-based Statistical Shape Model T2 - Proc. 7th MICCAI workshop on Mathematical Foundations of Computational Anatomy (MFCA) N2 - We describe a novel nonlinear statistical shape model basedon differential coordinates viewed as elements of GL+(3). We adopt an as-invariant-as possible framework comprising a bi-invariant Lie group mean and a tangent principal component analysis based on a unique GL+(3)-left-invariant, O(3)-right-invariant metric. Contrary to earlier work that equips the coordinates with a specifically constructed group structure, our method employs the inherent geometric structure of the group-valued data and therefore features an improved statistical power in identifying shape differences. We demonstrate this in experiments on two anatomical datasets including comparison to the standard Euclidean as well as recent state-of-the-art nonlinear approaches to statistical shape modeling. Y1 - 2019 U6 - https://doi.org/10.1007/978-3-030-33226-6_23 VL - 11846 SP - 219 EP - 228 PB - Springer ER -