Refine
Year of publication
- 2021 (4) (remove)
Document Type
- conference proceeding (presentation, abstract) (4) (remove)
Has Fulltext
- no (4)
Is part of the Bibliography
- no (4)
Keywords
- Deep Learning (3)
- Bildbasierte Verfahren (1)
- Bildgebendes Verfahren (1)
- Blutdruck (1)
- Blutgefäß (1)
- Celiac Disease (1)
- Endoscopy (1)
- Eosinophilic Esophagitis (1)
- Hämodynamik (1)
Institute
Begutachtungsstatus
- peer-reviewed (2)
Aims
Eosinophilic esophagitis (EoE) is easily missed during endoscopy, either because physicians are not familiar with its endoscopic features or the morphologic changes are too subtle. In this preliminary paper, we present the first attempt to detect EoE in endoscopic white light (WL) images using a deep learning network (EoE-AI).
Methods
401 WL images of eosinophilic esophagitis and 871 WL images of normal esophageal mucosa were evaluated. All images were assessed for the Endoscopic Reference score (EREFS) (edema, rings, exudates, furrows, strictures). Images with strictures were excluded. EoE was defined as the presence of at least 15 eosinophils per high power field on biopsy. A convolutional neural network based on the ResNet architecture with several five-fold cross-validation runs was used. Adding auxiliary EREFS-classification branches to the neural network allowed the inclusion of the scores as optimization criteria during training. EoE-AI was evaluated for sensitivity, specificity, and F1-score. In addition, two human endoscopists evaluated the images.
Results
EoE-AI showed a mean sensitivity, specificity, and F1 of 0.759, 0.976, and 0.834 respectively, averaged over the five distinct cross-validation runs. With the EREFS-augmented architecture, a mean sensitivity, specificity, and F1-score of 0.848, 0.945, and 0.861 could be demonstrated respectively. In comparison, the two human endoscopists had an average sensitivity, specificity, and F1-score of 0.718, 0.958, and 0.793.
Conclusions
To the best of our knowledge, this is the first application of deep learning to endoscopic images of EoE which were also assessed after augmentation with the EREFS-score. The next step is the evaluation of EoE-AI using an external dataset. We then plan to assess the EoE-AI tool on endoscopic videos, and also in real-time. This preliminary work is encouraging regarding the ability for AI to enhance physician detection of EoE, and potentially to do a true “optical biopsy” but more work is needed.
Einleitung:
Blutdruck gilt als sogenannter Vitalparameter als einer der grundlegenden Indikatoren für den Gesundheitszustand einer Person. Sowohl zu niedriger als auch zu hoher Blutdruck kann lebensbedrohend sein, letzerer ist darüber hinaus ein Risikofaktor insbesondere für Herz-Kreislauferkrankungen, die trotz wichtiger Fortschritte in der Behandlung immer noch die häufigste Todesursache in Deutschland darstellen. Die Hämodynamik, also die raumzeitliche Dynamik des Blutflusses, und der Gefäßzustand sind eng verbunden mit dem Blutdruck und ebenfalls von hoher klinischer Relevanz, u.a. zur Identifikation von Durchblutungsstörungen und ungünstigen Druckverteilungen der Gefäßwand. Innovationen in der Messtechnik als auch in der Datenanalyse bieten heute neue Möglichkeiten der Erfassung und Bewertung von Blutdruck, Hämodynamik und Gefäßzustand [1], [2], [3], [4].
Methodik:
In einer gemeinsamen Workshopserie der AG Medizinische Bild- und Signalverarbeitung der GMDS und des Fachausschusses Biosignale der DGBMT werden wir neue Ansätze und Lösungen für Mess- und Analyseverfahren zu Blutdruck und -fluss sowie zum Gefäßzustand vorstellen und diskutieren. Dabei stehen im ersten Workshop auf der GMDS Jahrestagung Bildbasierte Verfahren im Zentrum, während der zweite Workshop auf der DGBMT Jahrestagung den Fokus auf Biosignalbasierten Verfahren legt. Es werden aktuelle Forschungsergebnisse vorgestellt und diskutiert. Es sind jeweils mehrere Vorträge geplant mit ausreichend Zeit zur Diskussion. Folgende Vorträge sind geplant (Arbeitstitel):
Sebastian Zaunseder: Videobasierte Erfassung des Blutdrucks
Anja Hennemuth: A Visualization Toolkit for the Analysis of Aortic Anatomy and Pressure Distribution
Lars Krenkel: Numerische Analyse der Rupturwahrscheinlichkeit zerebraler Aneurysmata
Susanne Schnell: Messung des Blutflusses und hämodynamischer Parameter mit 4D flow MRI: Möglichkeiten und Herausforderungen
Ergebnisse:
Ziel des Workshops ist die Identifikation von innovativen Ansätzen und neuen Methoden zur qualitativen und quantitativen Bestimmung von hämodynamischen Parametern sowie deren kritische Bewertung durch die Community für die Eignung in der klinischen Entscheidungsunterstützung.
Diskussion:
Der Workshop leistet inhaltlich einen Beitrag zu zentralen Aspekten für die Herz-Kreislauf-Medizin. Er bringt dabei Expertise aus verschiedenen Bereichen zusammen und schlägt die Brücke zwischen Kardiologie, Medizininformatik und Medizintechnik.
Schlussfolgerung:
Innovative Technologien aus Medizintechnik und Informatik ermöglichen zunehmend einfache und raumzeitlich aufgelöste Erfassung und Bewertung wichtiger Informationen zur Unterstützung von Diagnose und Therapieverfolgung.
[1] Zaunseder S, Trumpp A, Wedekind D, Malberg H. Cardiovascular assessment by imaging photoplethysmography - a review. Biomed Tech (Berl). 2018 Oct 25;63(5):617–34.
[2] Huellebrand M, Messroghli D, Tautz L, Kuehne T, Hennemuth A. An extensible software platform for interdisciplinary cardiovascular imaging research. Comput Methods Programs Biomed. 2020 Feb;184:105277.
[3] Schmitter S, Adriany G, Waks M, Moeller S, Aristova M, Vali A, et al. Bilateral Multiband 4D Flow MRI of the Carotid Arteries at 7T. Magn Reson Med. 2020 Oct;84(4):1947–60.
[4] Birkenmaier C, and Krenkel, L. Flow in Artificial Lungs. In: New Results in Numerical and Experimental Fluid Mechanics XIII. Contributions to the 22nd STAB/DGLR Symposium. Springer; 2021.
Aims
Celiac disease (CD) is a complex condition caused by an autoimmune reaction to ingested gluten. Due to its polymorphic manifestation and subtle endoscopic presentation, the diagnosis is difficult and thus the disorder is underreported. We aimed to use deep learning to identify celiac disease on endoscopic images of the small bowel.
Methods
Patients with small intestinal histology compatible with CD (MARSH classification I-III) were extracted retrospectively from the database of Augsburg University hospital. They were compared to patients with no clinical signs of CD and histologically normal small intestinal mucosa. In a first step MARSH III and normal small intestinal mucosa were differentiated with the help of a deep learning algorithm. For this, the endoscopic white light images were divided into five equal-sized subsets. We avoided splitting the images of one patient into several subsets. A ResNet-50 model was trained with the images from four subsets and then validated with the remaining subset. This process was repeated for each subset, such that each subset was validated once. Sensitivity, specificity, and harmonic mean (F1) of the algorithm were determined.
Results
The algorithm showed values of 0.83, 0.88, and 0.84 for sensitivity, specificity, and F1, respectively. Further data showing a comparison between the detection rate of the AI model and that of experienced endoscopists will be available at the time of the upcoming conference.
Conclusions
We present the first clinical report on the use of a deep learning algorithm for the detection of celiac disease using endoscopic images. Further evaluation on an external data set, as well as in the detection of CD in real-time, will follow. However, this work at least suggests that AI can assist endoscopists in the endoscopic diagnosis of CD, and ultimately may be able to do a true optical biopsy in live-time.
Pixel-level classification is an essential part of computer vision. For learning from labeled data, many powerful deep learning models have been developed recently. In this work, we augment such supervised segmentation models by allowing them to learn from unlabeled data. Our semi-supervised approach, termed Error-Correcting Supervision, leverages a collaborative strategy. Apart from the supervised training on the labeled data, the segmentation network is judged by an additional network.