Refine
Year of publication
Document Type
- conference proceeding (article) (52)
- Article (50)
- conference proceeding (presentation, abstract) (33)
- Preprint (3)
- Book (1)
- Part of a Book (1)
Has Fulltext
- no (140) (remove)
Is part of the Bibliography
- no (140)
Keywords
- Bildgebendes Verfahren (17)
- Deep Learning (14)
- Diagnose (13)
- Gehirn (11)
- Künstliche Intelligenz (11)
- Maschinelles Lernen (11)
- Artificial Intelligence (9)
- Kernspintomografie (9)
- Dreidimensionale Bildverarbeitung (8)
- Registrierung <Bildverarbeitung> (8)
- Speiseröhrenkrankheit (8)
- Lernprogramm (7)
- Schnittdarstellung (7)
- Bildsegmentierung (6)
- Handchirurgie (6)
- Speiseröhrenkrebs (6)
- Adenocarcinoma (5)
- Bildverarbeitung (5)
- Deep learning (5)
- Machine learning (5)
- Osteosynthese (5)
- Polarisiertes Licht (5)
- Barrett's esophagus (4)
- Farbkonstanz (4)
- Gehirnkarte (4)
- Histologie (4)
- ICP-Massenspektrometrie (4)
- Image analysis (4)
- Image processing (4)
- Laryngoskopie (4)
- Medizin (4)
- Metalle (4)
- Positronen-Emissions-Tomografie (4)
- Schwächung (4)
- 3D-Druck (3)
- Automatische Klassifikation (3)
- Barrett-Ösophagus (3)
- Endoscopy (3)
- Endoskopie (3)
- Hirntumor (3)
- Magnetic Resonance Imaging (3)
- Metallproteide (3)
- Neuronales Netz (3)
- Simulation (3)
- Adenocarcinom (2)
- Anomalie (2)
- Barrett’s esophagus (2)
- Bilderkennung (2)
- Bilderzeugung (2)
- Brain (2)
- Computed tomography (2)
- Computertomographie (2)
- Computerunterstützte Medizin (2)
- Computerunterstütztes Verfahren (2)
- Convolutional neural networks (2)
- Dichromatisches Reflexionsmodell (2)
- Dreidimensionale Rekonstruktion (2)
- Dual-material 3D printing (2)
- Elektrophorese (2)
- Generative adversarial networks (2)
- HaptiVisT (2)
- Image classification (2)
- Image fusion (2)
- Image registration (2)
- Image segmentation (2)
- Konturverfolgung (2)
- Laser ablation inductively coupled plasma mass spectrometry (2)
- Literaturbericht (2)
- MRI (2)
- Machine Learning (2)
- Maschinelles Sehen (2)
- Medical Image Computing (2)
- Medical imaging (2)
- Mustererkennung (2)
- Objekterkennung (2)
- Operationstechnik (2)
- PET/CT (2)
- Segmentation (2)
- Snakes (2)
- Third-Space Endoscopy (2)
- Ultrastruktur (2)
- Video (2)
- Visualization (2)
- Zilie (2)
- artificial intelligence (2)
- dichromatisches Reflexionsmodell (2)
- 3D analysis (1)
- 3D breast scan registration (1)
- 3D image processing (1)
- 3D imaging (1)
- 3D reconstruction (1)
- 3D segmentation (1)
- 3D surface imaging (1)
- 4FC (1)
- A1 adenosine receptor (1)
- Adenokarzinom (1)
- Adenosinrezeptor (1)
- Aktives Konturmodell (1)
- Algorithmus (1)
- Alloplastik (1)
- Amino acid transport (1)
- Aminosäuren (1)
- Analytical models (1)
- Anatomy (1)
- Antiangiogenese (1)
- Antiangiogenic treatment (1)
- Arthrodese (1)
- Artificial intelligence (1)
- Attenuation correction (1)
- Aufnahme (1)
- Ausrichtung (1)
- Autogene Transplantation (1)
- Balloon Model (1)
- Barrett (1)
- Barrett's Carcinoma (1)
- Barrett's Esophagus (1)
- Barrett's esphagus (1)
- Barrett’s Esophagus (1)
- Barrett’s cancer (1)
- Barrett’s esophagus detection (1)
- Beryllium (1)
- Bewegungsanalyse (1)
- Bewegungsschatzung (1)
- Bildbasierte Verfahren (1)
- Bioimaging (1)
- Bioimaging of metals (1)
- Biomarker (1)
- Biomaterial (1)
- Biomedical imaging (1)
- Biopsy (1)
- Blood–brain barrier (1)
- Blut-Hirn-Schranke (1)
- Blutdruck (1)
- Blutgefäß (1)
- Boltzmann-Maschine (1)
- Brain Segmentation (1)
- Brain modeling (1)
- Brain tissue (1)
- Brain tumour (1)
- Breast imaging (1)
- Breast reconstruction (1)
- Breast symmetry (1)
- Brustkorb (1)
- Celiac Disease (1)
- Chest X-Ray (1)
- Co-occurrence Matrices (1)
- Co-occurrence matrix (1)
- Cochlea-Implantat (1)
- Color Texture (1)
- Color texture (1)
- Colorconstancy (1)
- Computer aided diagnosis and therapy (1)
- Computer-aided diagnosis (1)
- Computerassistierte Chirurgie (1)
- Computertomografie (1)
- Connectome (1)
- Contour Detection (1)
- Convex optimization (1)
- Cooccurrence Matrix (1)
- Data acquisition (1)
- Data models (1)
- Data privacy (1)
- Datenfusion (1)
- Datenschutz (1)
- Diagnosis (1)
- Diagnostik (1)
- Diffusion-weighted imaging (1)
- Digital anthropometry (1)
- Digital endoscopy (1)
- Dokument (1)
- Electron microscopy (1)
- Encoder-Decoder Network (1)
- Endobrachyösophagus (1)
- Eosinophilic Esophagitis (1)
- Farbanalyse (1)
- Farbbild (1)
- Farbbildverarbeitung (1)
- Farbenraum (1)
- Fehlerbehandlung (1)
- Felsenbein (1)
- Fluorescence imaging (1)
- Force-feedback haptic (1)
- Fräsen (1)
- GBM (1)
- Gabor Filter (1)
- Gamification in der Medizin (1)
- Gastroenterologie (1)
- General Purpose Graphic Processing Unit (1)
- Glanzlichtelimination (1)
- Gliom (1)
- Graphical user interface (1)
- Graphische Benutzeroberfläche (1)
- Graustufe (1)
- Hand surgery training (1)
- Haptische Feedback-Technologie (1)
- Haptisches Feedback (1)
- Hierarchische Wasserscheiden-Transformation (1)
- High-grade glioma (1)
- High-resolution imaging (1)
- Hochschuldidaktik (1)
- Human brain (1)
- Humans (1)
- Hämodynamik (1)
- Image processing (1)
- Image Processing (1)
- Image generation (1)
- Image resolution (1)
- Implantatwerkstoff (1)
- In vitro testing (1)
- In vivo imaging (1)
- Indexierung <Inhaltserschließung> (1)
- Inductively Couple Plasma Mass Spectrometry (1)
- Infinity Restricted Boltzmann Machines (1)
- Information Retrieval (1)
- Integrative features (1)
- Inverse registration consistency (1)
- K-wire drilling (1)
- Klassifikation (1)
- Kmeans algorithm (1)
- KolmogKorov distance (1)
- Komponentenanalyse (1)
- Konvexe Optimierung (1)
- Krankheitsverlauf (1)
- LA-ICP-MS (1)
- Laryngoscopy (1)
- Laser Ablation Inductively Couple Plasma Mass Spectrometry (1)
- Laser microdissection inductively coupled plasma mass spectrometry (1)
- Literaturdatenbank (1)
- MPTP (1)
- MPTP Treatment (1)
- Magnetic resonance imaging (1)
- Mammoplastik (1)
- Massenspektrometrie (1)
- Materialprüfung (1)
- Medical diagnostic imaging (1)
- Medical training system (1)
- Meta-heuristics (1)
- Metaheuristik (1)
- Metallomics (1)
- Metals (1)
- Metamaterial (1)
- Method (1)
- Minimally invasive hand surgery (1)
- Model-based imaging (1)
- Multi-modal imaging (1)
- Multimodal Imaging (1)
- Multimodal response assessment (1)
- Multimodales Verfahren (1)
- Multiskalenbilder (1)
- Multispektralbilder (1)
- Multistep training (1)
- NMDA receptors (1)
- Nano-LA-ICP-MS (1)
- Neoplasms (1)
- Nervenfaser (1)
- Neuroimaging (1)
- Neuronale Netze (1)
- Nichtlineare Optimierung (1)
- Non-rigid surface registration (1)
- Object detector (1)
- Optical Flow (1)
- Optimierung (1)
- PET (1)
- PET/MRI (1)
- Parallel Execution (1)
- Parallelverarbeitung (1)
- Parametric serial MR image registration (1)
- Pathologische Anatomie (1)
- Pattern recognition (1)
- Pflanzen (1)
- Point Distribution Model (1)
- Polarized light imaging (1)
- Positron emission tomography (1)
- Pradikatenlogik (1)
- Quantitative Image analysis (1)
- Receptor autoradiography (1)
- Referenzdaten (1)
- Reflexion (1)
- SLAC wrist (1)
- SNAC wrist (1)
- Schnittpräparat (1)
- Segmentierung (1)
- Segmentierung der Lippen (1)
- Sehrinde (1)
- Semi-Supervised Learning (1)
- Semi-automated segmentation (1)
- Senile Makuladegeneration (1)
- Signaltrennung (1)
- Signalverarbeitung (1)
- Smart ESD (1)
- Statistical shape mode (1)
- Stroboscopic Images (1)
- Substantia Nigra (1)
- Suchmaschine (1)
- Support material (1)
- Surgical instrument segmentation (1)
- Surgical outcome simulation (1)
- Systems biology (1)
- Table lookup (1)
- Texture Analysis (1)
- Texturerkennung (1)
- Tissue-imitating hand phantom (1)
- Tractography (1)
- Tumor disease progression (1)
- Tumour (1)
- Vascular Malformations (1)
- Vascular malformation (1)
- Vektorbilder (1)
- Vesicle membrane analysis (1)
- Vibration Profile (1)
- Virtual fixtures (1)
- Virtual reality (1)
- Virtualisierung (1)
- Virtuelle Realität (1)
- Virtuelles Training (1)
- Visualisierung (1)
- Vizualization (1)
- Voxel Spacing (1)
- Zielverfolgung (1)
- attenuation (1)
- camera calibration (1)
- celiac disease (1)
- combined imaging (1)
- correction (1)
- d/l-serine (1)
- deep learning (1)
- diagnostic laryngoscopy (1)
- digital anthropometry (1)
- electronic imaging (1)
- endoscopy (1)
- endoscopy detection (1)
- hand surgery training (1)
- healthcare (1)
- herbarium specimens (1)
- image co-registration (1)
- image distortion (1)
- magnetic resonance imaging (1)
- medizinische Bildverarbeitung (1)
- metal distribution (1)
- metallomics (1)
- metamaterial (1)
- multiple regression analysis (1)
- neoplastic larynx disease (1)
- neurodegenerative diseases (1)
- object detection (1)
- quantitative Farbmessung (1)
- real-time (1)
- reconstructive surgery (1)
- robot-assisted surgery (1)
- smoke simulation (1)
- submucosal invasion (1)
- tissue imitating phantom hand (1)
- unpaired image-to-image translation (1)
- villous atrophy (1)
- visual recognition (1)
- Ähnlichkeitssuche (1)
Institute
- Fakultät Informatik und Mathematik (140) (remove)
Begutachtungsstatus
- peer-reviewed (69)
- begutachtet (1)
Aims
AI has proven great potential in assisting endoscopists in diagnostics, however its role in therapeutic endoscopy remains unclear. Endoscopic submucosal dissection (ESD) is a technically demanding intervention with a slow learning curve and relevant risks like bleeding and perforation. Therefore, we aimed to develop an algorithm for the real-time detection and delineation of relevant structures during third-space endoscopy.
Methods
5470 still images from 59 full length videos (47 ESD, 12 POEM) were annotated. 179681 additional unlabeled images were added to the training dataset. Consequently, a DeepLabv3+ neural network architecture was trained with the ECMT semi-supervised algorithm (under review elsewhere). Evaluation of vessel detection was performed on a dataset of 101 standardized video clips from 15 separate third-space endoscopy videos with 200 predefined blood vessels.
Results
Internal validation yielded an overall mean Dice score of 85% (68% for blood vessels, 86% for submucosal layer, 88% for muscle layer). On the video test data, the overall vessel detection rate (VDR) was 94% (96% for ESD, 74% for POEM). The median overall vessel detection time (VDT) was 0.32 sec (0.3 sec for ESD, 0.62 sec for POEM).
Conclusions
Evaluation of the developed algorithm on a video test dataset showed high VDR and quick VDT, especially for ESD. Further research will focus on a possible clinical benefit of the AI application for VDR and VDT during third-space endoscopy.
Aims
Recent evidence suggests the possibility of intraprocedural phase recognition in surgical operations as well as endoscopic interventions such as peroral endoscopic myotomy and endoscopic submucosal dissection (ESD) by AI-algorithms. The intricate measurement of intraprocedural phase distribution may deepen the understanding of the procedure. Furthermore, real-time quality assessment as well as automation of reporting may become possible. Therefore, we aimed to develop an AI-algorithm for intraprocedural phase recognition during ESD.
Methods
A training dataset of 364385 single images from 9 full-length ESD videos was compiled. Each frame was classified into one procedural phase. Phases included scope manipulation, marking, injection, application of electrical current and bleeding. Allocation of each frame was only possible to one category. This training dataset was used to train a Video Swin transformer to recognize the phases. Temporal information was included via logarithmic frame sampling. Validation was performed using two separate ESD videos with 29801 single frames.
Results
The validation yielded sensitivities of 97.81%, 97.83%, 95.53%, 85.01% and 87.55% for scope manipulation, marking, injection, electric application and bleeding, respectively. Specificities of 77.78%, 90.91%, 95.91%, 93.65% and 84.76% were measured for the same parameters.
Conclusions
The developed algorithm was able to classify full-length ESD videos on a frame-by-frame basis into the predefined classes with high sensitivities and specificities. Future research will aim at the development of quality metrics based on single-operator phase distribution.
Even though artificial intelligence and machine learning have demonstrated remarkable performances in medical image computing, their accountability and transparency level must be improved to transfer this success into clinical practice. The reliability of machine learning decisions must be explained and interpreted, especially for supporting the medical diagnosis.For this task, the deep learning techniques’ black-box nature must somehow be lightened up to clarify its promising results. Hence, we aim to investigate the impact of the ResNet-50 deep convolutional design for Barrett’s esophagus and adenocarcinoma classification. For such a task, and aiming at proposing a two-step learning technique, the output of each convolutional layer that composes the ResNet-50 architecture was trained and classified for further definition of layers that would provide more impact in the architecture. We showed that local information and high-dimensional features are essential to improve the classification for our task. Besides, we observed a significant improvement when the most discriminative layers expressed more impact in the training and classification of ResNet-50 for Barrett’s esophagus and adenocarcinoma classification, demonstrating that both human knowledge and computational processing may influence the correct learning of such a problem.
Aims
Artificial Intelligence (AI) systems in gastrointestinal endoscopy are narrow because they are trained to solve only one specific task. Unlike Narrow-AI, general AI systems may be able to solve multiple and unrelated tasks. We aimed to understand whether an AI system trained to detect, characterize, and segment early Barrett’s neoplasia (Barrett’s AI) is only capable of detecting this pathology or can also detect and segment other diseases like early squamous cell cancer (SCC).
Methods
120 white light (WL) and narrow-band endoscopic images (NBI) from 60 patients (1 WL and 1 NBI image per patient) were extracted from the endoscopic database of the University Hospital Augsburg. Images were annotated by three expert endoscopists with extensive experience in the diagnosis and endoscopic resection of early esophageal neoplasias. An AI system based on DeepLabV3+architecture dedicated to early Barrett’s neoplasia was tested on these images. The AI system was neither trained with SCC images nor had it seen the test images prior to evaluation. The overlap between the three expert annotations („expert-agreement“) was the ground truth for evaluating AI performance.
Results
Barrett’s AI detected early SCC with a mean intersection over reference (IoR) of 92% when at least 1 pixel of the AI prediction overlapped with the expert-agreement. When the threshold was increased to 5%, 10%, and 20% overlap with the expert-agreement, the IoR was 88%, 85% and 82%, respectively. The mean Intersection Over Union (IoU) – a metric according to segmentation quality between the AI prediction and the expert-agreement – was 0.45. The mean expert IoU as a measure of agreement between the three experts was 0.60.
Conclusions
In the context of this pilot study, the predictions of SCC by a Barrett’s dedicated AI showed some overlap to the expert-agreement. Therefore, features learned from Barrett’s cancer-related training might be helpful also for SCC prediction. Our results allow different possible explanations. On the one hand, some Barrett’s cancer features generalize toward the related task of assessing early SCC. On the other hand, the Barrett’s AI is less specific to Barrett’s cancer than a general predictor of pathological tissue. However, we expect to enhance the detection quality significantly by extending the training to SCC-specific data. The insight of this study opens the way towards a transfer learning approach for more efficient training of AI to solve tasks in other domains.
Aims
While AI has been successfully implemented in detecting and characterizing colonic polyps, its role in therapeutic endoscopy remains to be elucidated. Especially third space endoscopy procedures like ESD and peroral endoscopic myotomy (POEM) pose a technical challenge and the risk of operator-dependent complications like intraprocedural bleeding and perforation. Therefore, we aimed at developing an AI-algorithm for intraprocedural real time vessel detection during ESD and POEM.
Methods
A training dataset consisting of 5470 annotated still images from 59 full-length videos (47 ESD, 12 POEM) and 179681 unlabeled images was used to train a DeepLabV3+neural network with the ECMT semi-supervised learning method. Evaluation for vessel detection rate (VDR) and time (VDT) of 19 endoscopists with and without AI-support was performed using a testing dataset of 101 standardized video clips with 200 predefined blood vessels. Endoscopists were stratified into trainees and experts in third space endoscopy.
Results
The AI algorithm had a mean VDR of 93.5% and a median VDT of 0.32 seconds. AI support was associated with a statistically significant increase in VDR from 54.9% to 73.0% and from 59.0% to 74.1% for trainees and experts, respectively. VDT significantly decreased from 7.21 sec to 5.09 sec for trainees and from 6.10 sec to 5.38 sec for experts in the AI-support group. False positive (FP) readings occurred in 4.5% of frames. FP structures were detected significantly shorter than true positives (0.71 sec vs. 5.99 sec).
Conclusions
AI improved VDR and VDT of trainees and experts in third space endoscopy and may reduce performance variability during training. Further research is needed to evaluate the clinical impact of this new technology.
Aims
Endoscopic retrograde cholangiopancreaticography (ERCP) is the gold standard in the diagnosis as well as treatment of diseases of the pancreatobiliary tract. However, it is technically complex and has a relatively high complication rate. In particular, cannulation of the papillary ostium remains challenging. The aim of this study is to examine whether a deep-learning algorithm can be used to detect the major duodenal papilla and in particular the papillary ostium reliably and could therefore be a valuable tool for inexperienced endoscopists, particularly in training situation.
Methods
We analyzed a total of 654 retrospectively collected images of 85 patients. Both the major duodenal papilla and the ostium were then segmented. Afterwards, a neural network was trained using a deep-learning algorithm. A 5-fold cross-validation was performed. Subsequently, we ran the algorithm on 5 prospectively collected videos of ERCPs.
Results
5-fold cross-validation on the 654 labeled data resulted in an F1 value of 0.8007, a sensitivity of 0.8409 and a specificity of 0.9757 for the class papilla, and an F1 value of 0.5724, a sensitivity of 0.5456 and a specificity of 0.9966 for the class ostium. Regardless of the class, the average F1 value (class papilla and class ostium) was 0.6866, the sensitivity 0.6933 and the specificity 0.9861. In 100% of cases the AI-detected localization of the papillary ostium in the prospectively collected videos corresponded to the localization of the cannulation performed by the endoscopist.
Conclusions
In the present study, the neural network was able to identify the major duodenal papilla with a high sensitivity and high specificity. In detecting the papillary ostium, the sensitivity was notably lower. However, when used on videos, the AI was able to identify the location of the subsequent cannulation with 100% accuracy. In the future, the neural network will be trained with more data. Thus, a suitable tool for ERCP could be established, especially in the training situation.
Barrett's esophagus denotes a disorder in the digestive system that affects the esophagus' mucosal cells, causing reflux, and showing potential convergence to esophageal adenocarcinoma if not treated in initial stages. Thus, fast and reliable computer-aided diagnosis becomes considerably welcome. Nevertheless, such approaches usually suffer from imbalanced datasets, which can be addressed through Generative Adversarial Networks (GANs). Such techniques generate realistic images based on observed samples, even though at the cost of a proper selection of its hyperparameters. Many works employed a class of nature-inspired algorithms called metaheuristics to tackle the problem considering distinct deep learning approaches. Therefore, this paper's main contribution is to introduce metaheuristic techniques to fine-tune GANs in the context of Barrett's esophagus identification, as well as to investigate the feasibility of generating high-quality synthetic images for early-cancer assisted identification.
Aims:
The delineation of outer margins of early Barrett's cancer can be challenging even for experienced endoscopists. Artificial intelligence (AI) could assist endoscopists faced with this task. As of date, there is very limited experience in this domain. In this study, we demonstrate the measure of overlap (Dice coefficient = D) between highly experienced Barrett endoscopists and an AI system in the delineation of cancer margins (segmentation task).
Methods:
An AI system with a deep convolutional neural network (CNN) was trained and tested on high-definition endoscopic images of early Barrett's cancer (n = 33) and normal Barrett's mucosa (n = 41). The reference standard for the segmentation task were the manual delineations of tumor margins by three highly experienced Barrett endoscopists. Training of the AI system included patch generation, patch augmentation and adjustment of the CNN weights. Then, the segmentation results from patch classification and thresholding of the class probabilities. Segmentation results were evaluated using the Dice coefficient (D).
Results:
The Dice coefficient (D) which can range between 0 (no overlap) and 1 (complete overlap) was computed only for images correctly classified by the AI-system as cancerous. At a threshold of t = 0.5, a mean value of D = 0.72 was computed.
Conclusions:
AI with CNN performed reasonably well in the segmentation of the tumor region in Barrett's cancer, at least when compared with expert Barrett's endoscopists. AI holds a lot of promise as a tool for better visualization of tumor margins but may need further improvement and enhancement especially in real-time settings.
The growing number of publications on the application of artificial intelligence (AI) in medicine underlines the enormous importance and potential of this emerging field of research.
In gastrointestinal endoscopy, AI has been applied to all segments of the gastrointestinal tract most importantly in the detection and characterization of colorectal polyps. However, AI research has been published also in the stomach and esophagus for both neoplastic and non-neoplastic disorders.
The various technical as well as medical aspects of AI, however, remain confusing especially for non-expert physicians.
This physician-engineer co-authored review explains the basic technical aspects of AI and provides a comprehensive overview of recent publications on AI in gastrointestinal endoscopy. Finally, a basic insight is offered into understanding publications on AI in gastrointestinal endoscopy.
Based on previous work by our group with manual annotation of visible Barrett oesophagus (BE) cancer images, a real-time deep learning artificial intelligence (AI) system was developed. While an expert endoscopist conducts the endoscopic assessment of BE, our AI system captures random images from the real-time camera livestream and provides a global prediction (classification), as well as a dense prediction (segmentation) differentiating accurately between normal BE and early oesophageal adenocarcinoma (EAC). The AI system showed an accuracy of 89.9% on 14 cases with neoplastic BE.