Refine
Document Type
- Article (9)
- In Proceedings (5)
- Research data (3)
- Doctoral Thesis (1)
- Master's Thesis (1)
- Poster (1)
Has Fulltext
- no (20) (remove)
Is part of the Bibliography
- no (20)
Keywords
- 4D-CT (1)
- Deep learning (1)
- Gruppenweise Registrierung (1)
- Sparse Geometry Reconstruction (1)
- Statistical Shape Models (1)
- Total Knee Arthoplasty (1)
- cartilage (1)
- classification (1)
- hip-knee-ankle angle (1)
- incident osteoarthritis (1)
Institute
We present a novel and computationally efficient method for the detection of meniscal tears in Magnetic Resonance Imaging (MRI) data. Our method is based on a Convolutional Neural Network (CNN) that operates on a complete 3D MRI scan. Our approach detects the presence of meniscal tears in three anatomical sub-regions (anterior horn, meniscal body, posterior horn) for both the Medial Meniscus (MM) and the Lateral Meniscus (LM) individually.
For optimal performance of our method, we investigate how to preprocess the MRI data or how to train the CNN such that only relevant information within a Region of Interest (RoI) of the data volume is taken into account for meniscal tear detection.
We propose meniscal tear detection combined with a bounding box regressor in a multi-task deep learning framework to let the CNN implicitly consider the corresponding RoIs of the menisci.
We evaluate the accuracy of our CNN-based meniscal tear detection approach on 2,399 Double Echo Steady-State (DESS) MRI scans from the Osteoarthritis Initiative database. In addition, to show that our method is capable of generalizing to other MRI sequences, we also adapt our model to Intermediate-Weighted Turbo Spin-Echo (IW TSE) MRI scans. To judge the quality of our approaches, Receiver Operating Characteristic (ROC) curves and Area Under the Curve (AUC) values are evaluated for both MRI sequences.
For the detection of tears in DESS MRI, our method reaches AUC values of 0.94, 0.93, 0.93 (anterior horn, body, posterior horn) in MM and 0.96, 0.94, 0.91 in LM. For the detection of tears in IW TSE MRI data, our method yields AUC values of 0.84, 0.88, 0.86 in MM and 0.95, 0.91, 0.90 in LM.
In conclusion, the presented method achieves high accuracy for detecting meniscal tears in both DESS and IW TSE MRI data. Furthermore, our method can be easily trained and applied to other MRI sequences.
Volumetry of cartilage of the knee is needed for knee osteoarthritis (KOA) assessment. It is typically performed manually in a tedious and subjective process. We developed a method for an automated, segmentation-based quantification of cartilage volume by employing 3D Convolutional Neural Networks (CNNs). CNNs were trained in a supervised manner using magnetic resonance imaging data and cartilage volumetry readings performed by clinical experts for 1378 subjects provided by the Osteoarthritis Initiative. It was shown that 3D CNNs are able to achieve volume measures comparable to the magnitude of variation between expert readings and
the real in vivo situation. In the future, accurate automated cartilage volumetry might support both, diagnosis of KOA as well as longitudinal analysis of KOA progression.
We present a method for the automated segmentation of knee bones and cartilage from magnetic resonance imaging, that combines a priori knowledge of anatomical shape with Convolutional Neural Networks (CNNs). The proposed approach incorporates 3D Statistical Shape Models (SSMs) as well as 2D and 3D CNNs to achieve a robust and accurate segmentation of even highly pathological knee structures. The method is evaluated on data of the MICCAI grand challenge "Segmentation of Knee Images 2010". For the first time an accuracy equivalent to the inter-observer variability of human readers has been achieved in this challenge. Moreover, the quality of the proposed method is thoroughly assessed using various measures for 507 manual segmentations of bone and cartilage, and 88 additional manual segmentations of cartilage. Our method yields sub-voxel accuracy. In conclusion, combining of anatomical knowledge using SSMs with localized classification via CNNs results in a state-of-the-art segmentation method.
We present a method for the automated segmentation of knee bones and cartilage from magnetic resonance imaging that combines a priori knowledge of anatomical shape with Convolutional Neural Networks (CNNs). The proposed approach incorporates 3D Statistical Shape Models (SSMs) as well as 2D and 3D CNNs to achieve a robust and accurate segmentation of even highly pathological knee structures. The shape models and neural networks employed are trained using data of the Osteoarthritis Initiative (OAI) and the MICCAI grand challenge "Segmentation of Knee Images 2010" (SKI10), respectively. We evaluate our method on 40 validation and 50 submission datasets of the SKI10 challenge. For the first time, an accuracy equivalent to the inter-observer variability of human readers has been achieved in this challenge. Moreover, the quality of the proposed method is thoroughly assessed using various measures for data from the OAI, i.e. 507 manual segmentations of bone and cartilage, and 88 additional manual segmentations of cartilage. Our method yields sub-voxel accuracy for both OAI datasets. We made the 507 manual segmentations as well as our experimental setup publicly available to further aid research in the field of medical image segmentation. In conclusion, combining statistical anatomical knowledge via SSMs with the localized classification via CNNs results in a state-of-the-art segmentation method for knee bones and cartilage from MRI data.
We present a method for the automated segmentation of knee bones and cartilage from magnetic resonance imaging that combines a priori knowledge of anatomical shape with Convolutional Neural Networks (CNNs). The proposed approach incorporates 3D Statistical Shape Models (SSMs) as well as 2D and 3D CNNs to achieve a robust and accurate segmentation of even highly pathological knee structures. The shape models and neural networks employed are trained using data of the Osteoarthritis Initiative (OAI) and the MICCAI grand challenge "Segmentation of Knee Images 2010" (SKI10), respectively. We evaluate our method on 40 validation and 50 submission datasets of the SKI10 challenge. For the first time, an accuracy equivalent to the inter-observer variability of human readers has been achieved in this challenge. Moreover, the quality of the proposed method is thoroughly assessed using various measures for data from the OAI, i.e. 507 manual segmentations of bone and cartilage, and 88 additional manual segmentations of cartilage. Our method yields sub-voxel accuracy for both OAI datasets. We made the 507 manual segmentations as well as our experimental setup publicly available to further aid research in the field of medical image segmentation. In conclusion, combining statistical anatomical knowledge via SSMs with the localized classification via CNNs results in a state-of-the-art segmentation method for knee bones and cartilage from MRI data.
In der Strahlentherapie von Lungentumoren kann mittels Dosisakkumulation der Einfluss von Atembewegungen auf statisch geplante Dosisverteilungen abgeschätzt werden. Grundlage sind 4D-CT-Daten des Patienten, aus denen mittels nicht-linearer Bildregistrierung eine Sequenz von Bewegungsfeldern berechnet wird. Typischerweise werden Methoden der paarweisen Bildregistrierung eingesetzt, d.h. konsekutiv zwei Atemphasen aufeinander registriert. Hierbei erfolgt i.d.R. eine physiologisch nicht plausible Anpassung der Felder an CT-Bewegungsartefakte. Gruppenweise Registrierungsansätze berücksichtigen hingegen gleichzeitig sämtliche Bilddaten des 4D-CT-Scans und ermöglichen die Integration von zeitlichen Konsistenzbetrachtungen. In diesem Beitrag wird der potentielle Vorteil der gruppen- im Vergleich zur paarweisen Registrierung in artefaktbehafteten 4D-CT-Daten untersucht.
In this study we investigate methods for fitting a Statistical Shape Model (SSM) to intraoperatively acquired point cloud data from a surgical navigation system. We validate the fitted models against the pre-operatively acquired Magnetic Resonance Imaging (MRI) data from the same patients.
We consider a cohort of 10 patients who underwent navigated total knee arthroplasty. As part of the surgical protocol the patients’ distal femurs were partially digitized. All patients had an MRI scan two months pre-operatively. The MRI data were manually segmented and the reconstructed bone surfaces used as ground truth against which the fit was compared. Two methods were used to fit the SSM to the data, based on (1) Iterative Closest Points (ICP) and (2) Gaussian Mixture Models (GMM).
For both approaches, the difference between model fit and ground truth surface averaged less than 1.7 mm and excellent correspondence with the distal femoral morphology can be demonstrated.
Precise voxel trajectory estimation in 4D CT images is a prerequisite for reliable dose accumulation during 4D treatment planning. 4D CT image data is, however, often affected by motion artifacts and applying standard pairwise registration to such data sets bears the risk of aligning anatomical structures to artifacts – with physiologically unrealistic trajectories being the consequence. In this work, the potential of a novel non-linear hybrid intensity- and feature-based groupwise registration method for robust motion field estimation in artifact-affected 4D CT image data is investigated. The overall registration performance is evaluated on the DIR-lab datasets; Its robustness if applied to artifact-affected data sets is analyzed using clinically acquired data sets with and without artifacts. The proposed registration approach achieves an accuracy comparable to the state-of-the-art (subvoxel accuracy), but smoother voxel trajectories compared to pairwise registration. Even more important: it maintained accuracy and trajectory smoothness in the presence of image artifacts – in contrast to standard pairwise registration, which yields higher landmark-based registration errors and a loss of trajectory smoothness when applied to artifact-affected data sets.
Gruppenweise Registrierung zur robusten Bewegungsfeldschätzung in artefaktbehafteten 4D-CT-Bilddaten
(2015)
Das Ziel der Strahlentherapie ist, eine möglichst hohe Dosis in den Tumor zu applizieren und zeitgleich die Strahlenexposition des Normalgewebes zu minimieren. Insbesondere bei thorakalen und abdominalen Tumoren treten aufgrund der Atmung während der Bestrahlung große, komplexe und patientenspezifisch unterschiedliche Bewegungen der Gewebe auf. Um den Einfluss dieser Bewegung auf die i.d.R. statisch geplante Dosisverteilung abzuschätzen, können unter Verwendung der nicht-linearen Bildregistrierung anhand von 3D-CT-Aufnahmen eines Atmungszyklus - also 4D-CT-Daten - zunächst die Bewegungsfelder für die strahlentherapeutisch relevanten Strukturen, beispielsweise für die Lunge, berechnet werden. Diese Informationen bilden die Grundlage für sogenannte 4D-Dosisberechnungs- oder Dosisakkumulationsverfahren. Deren Genauigkeit hängt aber wesentlich von der Genauigkeit der Bewegungsfeldschätzung ab.
Klassisch erfolgt die Berechnung der Bewegungsfelder mittels paarweiser Bildregistrierung, womit für die Berechnung des Bewegungsfeldes zwischen zwei Bildern im Allgemeinen eine sehr hohe Genauigkeit erreicht wird. Auch für CT-Bilder, die Bewegungsartefakte, wie beispielsweise doppelte oder unvollständige Strukturen, enthalten, wird unter Verwendung der paarweisen Bildregistrierung im Kontext der Registrierung eine exakte Abbildung der anatomischen Strukturen zwischen den beiden Bildern erreicht. Dabei erfolgt aber eine physiologisch unplausible Anpassung der Felder an die Artefakte. Bei Verwendung der paarweisen Bildregistrierung müssen weiterhin für einen Atemzyklus die Voxel-Trajektorien aus Bewegungsfeldern zwischen mehreren dreidimensionalen Bildern zusammengesetzt werden. Durch Bewegungsartefakte entsprechen diese Trajektorien dann teilweise keiner natürlichen Bewegung der anatomischen Strukturen. Diese Ungenauigkeit stellt in der klinischen Anwendung ein Problem dar; dies gilt umso mehr, wenn Bewegungsartefakte im Bereich eines Tumors vorliegen.
Im Gegensatz zu der paarweisen Registrierung kann mit der gruppenweisen Registrierung das Problem der durch Bewegungsartefakte hervorgerufenen ungenauen Abbildung der physiologischen Gegebenheiten dadurch reduziert werden, dass im Registrierungsprozess Bildinformationen aller Bilder, also in diesem Kontext der CT-Daten zu unterschiedlichen Atemphasen, gleichzeitig genutzt werden. Es kann bereits im Registrierungsprozess eine zeitliche Glattheit der Voxel-Trajektorien gefordert werden.
In dieser Arbeit wird eine Methode zur B-Spline-basierten zeitlich regularisierten gruppenweisen Registrierung entwickelt. Die Genauigkeit der entwickelten Methode wird für frei zugängliche klinische Datensätze landmarkenbasiert evaluiert. Dabei wird mit dem Target Registration Error (TRE) die durchschnittliche dreidimensionale euklidische Distanz zwischen den korrespondierenden Landmarken nach Transformation der Landmarken bezeichnet. Eine Genauigkeit in der Größenordnung von aktuellen paarweisen Registrierungen verdeutlicht die Qualität des vorgestellten Registrierungs-Algorithmus. Anschließend werden die Vorteile der gruppenweisen Registrierung durch Experimente an einem Lungenphantom und an manipulierten, artefaktbehafteten klinischen 4D-CT-Bilddaten demonstriert. Dabei werden unter Verwendung der gruppenweisen Registrierung im Vergleich zu der paarweisen Registrierung glattere Trajektorien berechnet, die der realen Bewegung der anatomischen Strukturen stärker entsprechen. Für die Patientendaten wird außerdem anhand von automatisch detektierten Landmarken der TRE ausgewertet. Der TRE verschlechterte sich für die paarweise Bildregistrierung unter Vorliegen von Bewegungsartefakten von durchschnittlich 1,30 mm auf 3,94 mm. Auch hier zeigte sich für die gruppenweise Registrierung die Robustheit gegenüber Bewegungsartefakten und der TRE verschlechterte sich nur geringfügig von 1,45 mm auf 1,71 mm.
Abstract: Objective: To present a novel method for automated segmentation of knee menisci from MRIs. To evaluate quantitative meniscal biomarkers for osteoarthritis (OA) estimated thereof.
Method: A segmentation method employing convolutional neural networks in combination with statistical shape models was developed. Accuracy was evaluated on 88 manual segmentations. Meniscal volume, tibial coverage, and meniscal extrusion were computed and tested for differences between groups of OA, joint space narrowing (JSN), and WOMAC pain. Correlation between computed meniscal extrusion and MOAKS experts' readings was evaluated for 600 subjects. Suitability of biomarkers for predicting incident radiographic OA from baseline to 24 months was tested on a group of 552 patients (184 incident OA, 386 controls) by performing conditional logistic regression.
Results: Segmentation accuracy measured as Dice Similarity Coefficient was 83.8% for medial menisci (MM) and 88.9% for lateral menisci (LM) at baseline, and 83.1% and 88.3% at 12-month follow-up. Medial tibial coverage was significantly lower for arthritic cases compared to non-arthritic ones. Medial meniscal extrusion was significantly higher for arthritic knees. A moderate correlation between automatically computed medial meniscal extrusion and experts' readings was found (ρ=0.44). Mean medial meniscal extrusion was significantly greater for incident OA cases compared to controls (1.16±0.93 mm vs. 0.83±0.92 mm; p<0.05).
Conclusion: Especially for medial menisci an excellent segmentation accuracy was achieved. Our meniscal biomarkers were validated by comparison to experts' readings as well as analysis of differences w.r.t groups of OA, JSN, and WOMAC pain. It was confirmed that medial meniscal extrusion is a predictor for incident OA.