TY - GEN A1 - Ambellan, Felix A1 - Tack, Alexander A1 - Ehlke, Moritz A1 - Zachow, Stefan T1 - Automated Segmentation of Knee Bone and Cartilage combining Statistical Shape Knowledge and Convolutional Neural Networks: Data from the Osteoarthritis Initiative N2 - We present a method for the automated segmentation of knee bones and cartilage from magnetic resonance imaging (MRI) that combines a priori knowledge of anatomical shape with Convolutional Neural Networks (CNNs).The proposed approach incorporates 3D Statistical Shape Models (SSMs) as well as 2D and 3D CNNs to achieve a robust and accurate segmentation of even highly pathological knee structures.The shape models and neural networks employed are trained using data from the Osteoarthritis Initiative (OAI) and the MICCAI grand challenge "Segmentation of Knee Images 2010" (SKI10), respectively. We evaluate our method on 40 validation and 50 submission datasets from the SKI10 challenge.For the first time, an accuracy equivalent to the inter-observer variability of human readers is achieved in this challenge.Moreover, the quality of the proposed method is thoroughly assessed using various measures for data from the OAI, i.e. 507 manual segmentations of bone and cartilage, and 88 additional manual segmentations of cartilage. Our method yields sub-voxel accuracy for both OAI datasets. We make the 507 manual segmentations as well as our experimental setup publicly available to further aid research in the field of medical image segmentation.In conclusion, combining localized classification via CNNs with statistical anatomical knowledge via SSMs results in a state-of-the-art segmentation method for knee bones and cartilage from MRI data. T3 - ZIB-Report - 19-06 Y1 - 2019 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-72704 SN - 1438-0064 N1 - Innovation Excellence Award 2020 ER - TY - GEN A1 - Ambellan, Felix A1 - Tack, Alexander A1 - Ehlke, Moritz A1 - Zachow, Stefan T1 - Automated Segmentation of Knee Bone and Cartilage combining Statistical Shape Knowledge and Convolutional Neural Networks: Data from the Osteoarthritis Initiative (Supplementary Material) T2 - Medical Image Analysis N2 - We present a method for the automated segmentation of knee bones and cartilage from magnetic resonance imaging that combines a priori knowledge of anatomical shape with Convolutional Neural Networks (CNNs). The proposed approach incorporates 3D Statistical Shape Models (SSMs) as well as 2D and 3D CNNs to achieve a robust and accurate segmentation of even highly pathological knee structures. The shape models and neural networks employed are trained using data of the Osteoarthritis Initiative (OAI) and the MICCAI grand challenge "Segmentation of Knee Images 2010" (SKI10), respectively. We evaluate our method on 40 validation and 50 submission datasets of the SKI10 challenge. For the first time, an accuracy equivalent to the inter-observer variability of human readers has been achieved in this challenge. Moreover, the quality of the proposed method is thoroughly assessed using various measures for data from the OAI, i.e. 507 manual segmentations of bone and cartilage, and 88 additional manual segmentations of cartilage. Our method yields sub-voxel accuracy for both OAI datasets. We made the 507 manual segmentations as well as our experimental setup publicly available to further aid research in the field of medical image segmentation. In conclusion, combining statistical anatomical knowledge via SSMs with the localized classification via CNNs results in a state-of-the-art segmentation method for knee bones and cartilage from MRI data. Y1 - 2019 U6 - https://doi.org/10.12752/4.ATEZ.1.0 N1 - OAI-ZIB dataset VL - 52 IS - 2 SP - 109 EP - 118 ER - TY - JOUR A1 - Ambellan, Felix A1 - Tack, Alexander A1 - Ehlke, Moritz A1 - Zachow, Stefan T1 - Automated Segmentation of Knee Bone and Cartilage combining Statistical Shape Knowledge and Convolutional Neural Networks: Data from the Osteoarthritis Initiative JF - Medical Image Analysis N2 - We present a method for the automated segmentation of knee bones and cartilage from magnetic resonance imaging that combines a priori knowledge of anatomical shape with Convolutional Neural Networks (CNNs). The proposed approach incorporates 3D Statistical Shape Models (SSMs) as well as 2D and 3D CNNs to achieve a robust and accurate segmentation of even highly pathological knee structures. The shape models and neural networks employed are trained using data of the Osteoarthritis Initiative (OAI) and the MICCAI grand challenge "Segmentation of Knee Images 2010" (SKI10), respectively. We evaluate our method on 40 validation and 50 submission datasets of the SKI10 challenge. For the first time, an accuracy equivalent to the inter-observer variability of human readers has been achieved in this challenge. Moreover, the quality of the proposed method is thoroughly assessed using various measures for data from the OAI, i.e. 507 manual segmentations of bone and cartilage, and 88 additional manual segmentations of cartilage. Our method yields sub-voxel accuracy for both OAI datasets. We made the 507 manual segmentations as well as our experimental setup publicly available to further aid research in the field of medical image segmentation. In conclusion, combining statistical anatomical knowledge via SSMs with the localized classification via CNNs results in a state-of-the-art segmentation method for knee bones and cartilage from MRI data. Y1 - 2019 U6 - https://doi.org/10.1016/j.media.2018.11.009 VL - 52 IS - 2 SP - 109 EP - 118 ER - TY - CHAP A1 - Ambellan, Felix A1 - Tack, Alexander A1 - Wilson, Dave A1 - Anglin, Carolyn A1 - Lamecker, Hans A1 - Zachow, Stefan T1 - Evaluating two methods for Geometry Reconstruction from Sparse Surgical Navigation Data T2 - Proceedings of the Jahrestagung der Deutschen Gesellschaft für Computer- und Roboterassistierte Chirurgie (CURAC) N2 - In this study we investigate methods for fitting a Statistical Shape Model (SSM) to intraoperatively acquired point cloud data from a surgical navigation system. We validate the fitted models against the pre-operatively acquired Magnetic Resonance Imaging (MRI) data from the same patients. We consider a cohort of 10 patients who underwent navigated total knee arthroplasty. As part of the surgical protocol the patients’ distal femurs were partially digitized. All patients had an MRI scan two months pre-operatively. The MRI data were manually segmented and the reconstructed bone surfaces used as ground truth against which the fit was compared. Two methods were used to fit the SSM to the data, based on (1) Iterative Closest Points (ICP) and (2) Gaussian Mixture Models (GMM). For both approaches, the difference between model fit and ground truth surface averaged less than 1.7 mm and excellent correspondence with the distal femoral morphology can be demonstrated. KW - Total Knee Arthoplasty KW - Sparse Geometry Reconstruction KW - Statistical Shape Models Y1 - 2017 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-65339 VL - 16 SP - 24 EP - 30 ER - TY - GEN A1 - Ambellan, Felix A1 - Tack, Alexander A1 - Wilson, Dave A1 - Anglin, Carolyn A1 - Lamecker, Hans A1 - Zachow, Stefan T1 - Evaluating two methods for Geometry Reconstruction from Sparse Surgical Navigation Data N2 - In this study we investigate methods for fitting a Statistical Shape Model (SSM) to intraoperatively acquired point cloud data from a surgical navigation system. We validate the fitted models against the pre-operatively acquired Magnetic Resonance Imaging (MRI) data from the same patients. We consider a cohort of 10 patients who underwent navigated total knee arthroplasty. As part of the surgical protocol the patients’ distal femurs were partially digitized. All patients had an MRI scan two months pre-operatively. The MRI data were manually segmented and the reconstructed bone surfaces used as ground truth against which the fit was compared. Two methods were used to fit the SSM to the data, based on (1) Iterative Closest Points (ICP) and (2) Gaussian Mixture Models (GMM). For both approaches, the difference between model fit and ground truth surface averaged less than 1.7 mm and excellent correspondence with the distal femoral morphology can be demonstrated. T3 - ZIB-Report - 17-71 KW - Knee Arthroplasty KW - Sparse Geometry Reconstruction KW - Statistical Shape Models Y1 - 2017 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-66052 SN - 1438-0064 ER - TY - CHAP A1 - Ambellan, Felix A1 - Tack, Alexander A1 - Ehlke, Moritz A1 - Zachow, Stefan T1 - Automated Segmentation of Knee Bone and Cartilage combining Statistical Shape Knowledge and Convolutional Neural Networks: Data from the Osteoarthritis Initiative T2 - Medical Imaging with Deep Learning N2 - We present a method for the automated segmentation of knee bones and cartilage from magnetic resonance imaging, that combines a priori knowledge of anatomical shape with Convolutional Neural Networks (CNNs). The proposed approach incorporates 3D Statistical Shape Models (SSMs) as well as 2D and 3D CNNs to achieve a robust and accurate segmentation of even highly pathological knee structures. The method is evaluated on data of the MICCAI grand challenge "Segmentation of Knee Images 2010". For the first time an accuracy equivalent to the inter-observer variability of human readers has been achieved in this challenge. Moreover, the quality of the proposed method is thoroughly assessed using various measures for 507 manual segmentations of bone and cartilage, and 88 additional manual segmentations of cartilage. Our method yields sub-voxel accuracy. In conclusion, combining of anatomical knowledge using SSMs with localized classification via CNNs results in a state-of-the-art segmentation method. Y1 - 2018 ER - TY - JOUR A1 - Sekuboyina, Anjany A1 - Bayat, Amirhossein A1 - Husseini, Malek E. A1 - Löffler, Maximilian A1 - Li, Hongwei A1 - Tetteh, Giles A1 - Kukačka, Jan A1 - Payer, Christian A1 - Štern, Darko A1 - Urschler, Martin A1 - Chen, Maodong A1 - Cheng, Dalong A1 - Lessmann, Nikolas A1 - Hu, Yujin A1 - Wang, Tianfu A1 - Yang, Dong A1 - Xu, Daguang A1 - Ambellan, Felix A1 - Amiranashvili, Tamaz A1 - Ehlke, Moritz A1 - Lamecker, Hans A1 - Lehnert, Sebastian A1 - Lirio, Marilia A1 - de Olaguer, Nicolás Pérez A1 - Ramm, Heiko A1 - Sahu, Manish A1 - Tack, Alexander A1 - Zachow, Stefan A1 - Jiang, Tao A1 - Ma, Xinjun A1 - Angerman, Christoph A1 - Wang, Xin A1 - Wei, Qingyue A1 - Brown, Kevin A1 - Wolf, Matthias A1 - Kirszenberg, Alexandre A1 - Puybareau, Élodie A1 - Valentinitsch, Alexander A1 - Rempfler, Markus A1 - Menze, Björn H. A1 - Kirschke, Jan S. T1 - VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Images JF - arXiv Y1 - 2020 ER - TY - JOUR A1 - Wilson, David A1 - Anglin, Carolyn A1 - Ambellan, Felix A1 - Grewe, Carl Martin A1 - Tack, Alexander A1 - Lamecker, Hans A1 - Dunbar, Michael A1 - Zachow, Stefan T1 - Validation of three-dimensional models of the distal femur created from surgical navigation point cloud data for intraoperative and postoperative analysis of total knee arthroplasty JF - International Journal of Computer Assisted Radiology and Surgery N2 - Purpose: Despite the success of total knee arthroplasty there continues to be a significant proportion of patients who are dissatisfied. One explanation may be a shape mismatch between pre and post-operative distal femurs. The purpose of this study was to investigate a method to match a statistical shape model (SSM) to intra-operatively acquired point cloud data from a surgical navigation system, and to validate it against the pre-operative magnetic resonance imaging (MRI) data from the same patients. Methods: A total of 10 patients who underwent navigated total knee arthroplasty also had an MRI scan less than 2 months pre-operatively. The standard surgical protocol was followed which included partial digitization of the distal femur. Two different methods were employed to fit the SSM to the digitized point cloud data, based on (1) Iterative Closest Points (ICP) and (2) Gaussian Mixture Models (GMM). The available MRI data were manually segmented and the reconstructed three-dimensional surfaces used as ground truth against which the statistical shape model fit was compared. Results: For both approaches, the difference between the statistical shape model-generated femur and the surface generated from MRI segmentation averaged less than 1.7 mm, with maximum errors occurring in less clinically important areas. Conclusion: The results demonstrated good correspondence with the distal femoral morphology even in cases of sparse data sets. Application of this technique will allow for measurement of mismatch between pre and post-operative femurs retrospectively on any case done using the surgical navigation system and could be integrated into the surgical navigation unit to provide real-time feedback. Y1 - 2017 UR - https://link.springer.com/content/pdf/10.1007%2Fs11548-017-1630-5.pdf U6 - https://doi.org/10.1007/s11548-017-1630-5 VL - 12 IS - 12 SP - 2097 EP - 2105 PB - Springer ER - TY - JOUR A1 - Tack, Alexander A1 - Ambellan, Felix A1 - Zachow, Stefan T1 - Towards novel osteoarthritis biomarkers: Multi-criteria evaluation of 46,996 segmented knee MRI data from the Osteoarthritis Initiative JF - PLOS One N2 - Convolutional neural networks (CNNs) are the state-of-the-art for automated assessment of knee osteoarthritis (KOA) from medical image data. However, these methods lack interpretability, mainly focus on image texture, and cannot completely grasp the analyzed anatomies’ shapes. In this study we assess the informative value of quantitative features derived from segmentations in order to assess their potential as an alternative or extension to CNN-based approaches regarding multiple aspects of KOA. Six anatomical structures around the knee (femoral and tibial bones, femoral and tibial cartilages, and both menisci) are segmented in 46,996 MRI scans. Based on these segmentations, quantitative features are computed, i.e., measurements such as cartilage volume, meniscal extrusion and tibial coverage, as well as geometric features based on a statistical shape encoding of the anatomies. The feature quality is assessed by investigating their association to the Kellgren-Lawrence grade (KLG), joint space narrowing (JSN), incident KOA, and total knee replacement (TKR). Using gold standard labels from the Osteoarthritis Initiative database the balanced accuracy (BA), the area under the Receiver Operating Characteristic curve (AUC), and weighted kappa statistics are evaluated. Features based on shape encodings of femur, tibia, and menisci plus the performed measurements showed most potential as KOA biomarkers. Differentiation between non-arthritic and severely arthritic knees yielded BAs of up to 99%, 84% were achieved for diagnosis of early KOA. Weighted kappa values of 0.73, 0.72, and 0.78 were achieved for classification of the grade of medial JSN, lateral JSN, and KLG, respectively. The AUC was 0.61 and 0.76 for prediction of incident KOA and TKR within one year, respectively. Quantitative features from automated segmentations provide novel biomarkers for KLG and JSN classification and show potential for incident KOA and TKR prediction. The validity of these features should be further evaluated, especially as extensions of CNN- based approaches. To foster such developments we make all segmentations publicly available together with this publication. Y1 - 2021 U6 - https://doi.org/10.1371/journal.pone.0258855 VL - 16 IS - 10 ER - TY - GEN A1 - Tack, Alexander A1 - Ambellan, Felix A1 - Zachow, Stefan T1 - Towards novel osteoarthritis biomarkers: Multi-criteria evaluation of 46,996 segmented knee MRI data from the Osteoarthritis Initiative (Supplementary Material) T2 - PLOS One N2 - Convolutional neural networks (CNNs) are the state-of-the-art for automated assessment of knee osteoarthritis (KOA) from medical image data. However, these methods lack interpretability, mainly focus on image texture, and cannot completely grasp the analyzed anatomies’ shapes. In this study we assess the informative value of quantitative features derived from segmentations in order to assess their potential as an alternative or extension to CNN-based approaches regarding multiple aspects of KOA A fully automated method is employed to segment six anatomical structures around the knee (femoral and tibial bones, femoral and tibial cartilages, and both menisci) in 46,996 MRI scans. Based on these segmentations, quantitative features are computed, i.e., measurements such as cartilage volume, meniscal extrusion and tibial coverage, as well as geometric features based on a statistical shape encoding of the anatomies. The feature quality is assessed by investigating their association to the Kellgren-Lawrence grade (KLG), joint space narrowing (JSN), incident KOA, and total knee replacement (TKR). Using gold standard labels from the Osteoarthritis Initiative database the balanced accuracy (BA), the area under the Receiver Operating Characteristic curve (AUC), and weighted kappa statistics are evaluated. Features based on shape encodings of femur, tibia, and menisci plus the performed measurements showed most potential as KOA biomarkers. Differentiation between healthy and severely arthritic knees yielded BAs of up to 99%, 84% were achieved for diagnosis of early KOA. Substantial agreement with weighted kappa values of 0.73, 0.73, and 0.79 were achieved for classification of the grade of medial JSN, lateral JSN, and KLG, respectively. The AUC was 0.60 and 0.75 for prediction of incident KOA and TKR within 5 years, respectively. Quantitative features from automated segmentations yield excellent results for KLG and JSN classification and show potential for incident KOA and TKR prediction. The validity of these features as KOA biomarkers should be further evaluated, especially as extensions of CNN-based approaches. To foster such developments we make all segmentations publicly available together with this publication. Y1 - 2021 U6 - https://doi.org/10.12752/8328 N1 - 46,996 automated segmentations for data from the OAI database. VL - 16 IS - 10 ER - TY - JOUR A1 - Sekuboyina, Anjany A1 - Husseini, Malek E. A1 - Bayat, Amirhossein A1 - Löffler, Maximilian A1 - Liebl, Hans A1 - Li, Hongwei A1 - Tetteh, Giles A1 - Kukačka, Jan A1 - Payer, Christian A1 - Štern, Darko A1 - Urschler, Martin A1 - Chen, Maodong A1 - Cheng, Dalong A1 - Lessmann, Nikolas A1 - Hu, Yujin A1 - Wang, Tianfu A1 - Yang, Dong A1 - Xu, Daguang A1 - Ambellan, Felix A1 - Amiranashvili, Tamaz A1 - Ehlke, Moritz A1 - Lamecker, Hans A1 - Lehnert, Sebastian A1 - Lirio, Marilia A1 - de Olaguer, Nicolás Pérez A1 - Ramm, Heiko A1 - Sahu, Manish A1 - Tack, Alexander A1 - Zachow, Stefan A1 - Jiang, Tao A1 - Ma, Xinjun A1 - Angerman, Christoph A1 - Wang, Xin A1 - Brown, Kevin A1 - Kirszenberg, Alexandre A1 - Puybareau, Élodie A1 - Chen, Di A1 - Bai, Yiwei A1 - Rapazzo, Brandon H. A1 - Yeah, Timyoas A1 - Zhang, Amber A1 - Xu, Shangliang A1 - Hou, Feng A1 - He, Zhiqiang A1 - Zeng, Chan A1 - Xiangshang, Zheng A1 - Liming, Xu A1 - Netherton, Tucker J. A1 - Mumme, Raymond P. A1 - Court, Laurence E. A1 - Huang, Zixun A1 - He, Chenhang A1 - Wang, Li-Wen A1 - Ling, Sai Ho A1 - Huynh, Lê Duy A1 - Boutry, Nicolas A1 - Jakubicek, Roman A1 - Chmelik, Jiri A1 - Mulay, Supriti A1 - Sivaprakasam, Mohanasankar A1 - Paetzold, Johannes C. A1 - Shit, Suprosanna A1 - Ezhov, Ivan A1 - Wiestler, Benedikt A1 - Glocker, Ben A1 - Valentinitsch, Alexander A1 - Rempfler, Markus A1 - Menze, Björn H. A1 - Kirschke, Jan S. T1 - VerSe: A Vertebrae labelling and segmentation benchmark for multi-detector CT images JF - Medical Image Analysis N2 - Vertebral labelling and segmentation are two fundamental tasks in an automated spine processing pipeline. Reliable and accurate processing of spine images is expected to benefit clinical decision support systems for diagnosis, surgery planning, and population-based analysis of spine and bone health. However, designing automated algorithms for spine processing is challenging predominantly due to considerable variations in anatomy and acquisition protocols and due to a severe shortage of publicly available data. Addressing these limitations, the Large Scale Vertebrae Segmentation Challenge (VerSe) was organised in conjunction with the International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI) in 2019 and 2020, with a call for algorithms tackling the labelling and segmentation of vertebrae. Two datasets containing a total of 374 multi-detector CT scans from 355 patients were prepared and 4505 vertebrae have individually been annotated at voxel level by a human-machine hybrid algorithm (https://osf.io/nqjyw/, https://osf.io/t98fz/). A total of 25 algorithms were benchmarked on these datasets. In this work, we present the results of this evaluation and further investigate the performance variation at the vertebra level, scan level, and different fields of view. We also evaluate the generalisability of the approaches to an implicit domain shift in data by evaluating the top-performing algorithms of one challenge iteration on data from the other iteration. The principal takeaway from VerSe: the performance of an algorithm in labelling and segmenting a spine scan hinges on its ability to correctly identify vertebrae in cases of rare anatomical variations. The VerSe content and code can be accessed at: https://github.com/anjany/verse. Y1 - 2021 U6 - https://doi.org/10.1016/j.media.2021.102166 VL - 73 ER -