TY - GEN A1 - Ebigbo, Alanna A1 - Mendel, Robert A1 - Probst, Andreas A1 - Manzeneder, Johannes A1 - Souza Jr., Luis Antonio de A1 - Papa, João Paulo A1 - Palm, Christoph A1 - Messmann, Helmut T1 - Artificial Intelligence in Early Barrett's Cancer: The Segmentation Task T2 - Endoscopy N2 - Aims: The delineation of outer margins of early Barrett's cancer can be challenging even for experienced endoscopists. Artificial intelligence (AI) could assist endoscopists faced with this task. As of date, there is very limited experience in this domain. In this study, we demonstrate the measure of overlap (Dice coefficient = D) between highly experienced Barrett endoscopists and an AI system in the delineation of cancer margins (segmentation task). Methods: An AI system with a deep convolutional neural network (CNN) was trained and tested on high-definition endoscopic images of early Barrett's cancer (n = 33) and normal Barrett's mucosa (n = 41). The reference standard for the segmentation task were the manual delineations of tumor margins by three highly experienced Barrett endoscopists. Training of the AI system included patch generation, patch augmentation and adjustment of the CNN weights. Then, the segmentation results from patch classification and thresholding of the class probabilities. Segmentation results were evaluated using the Dice coefficient (D). Results: The Dice coefficient (D) which can range between 0 (no overlap) and 1 (complete overlap) was computed only for images correctly classified by the AI-system as cancerous. At a threshold of t = 0.5, a mean value of D = 0.72 was computed. Conclusions: AI with CNN performed reasonably well in the segmentation of the tumor region in Barrett's cancer, at least when compared with expert Barrett's endoscopists. AI holds a lot of promise as a tool for better visualization of tumor margins but may need further improvement and enhancement especially in real-time settings. KW - Speiseröhrenkrankheit KW - Maschinelles Lernen KW - Barrett's esphagus KW - Deep Learning KW - Segmentation Y1 - 2019 U6 - https://doi.org/10.1055/s-0039-1681187 VL - 51 IS - 04 SP - 6 PB - Georg Thieme Verlag CY - Stuttgart ER - TY - CHAP A1 - Palm, Christoph A1 - Lehmann, Thomas M. A1 - Bredno, J. A1 - Neuschaefer-Rube, C. A1 - Klajman, S. A1 - Spitzer, Klaus T1 - Automated Analysis of Stroboscopic Image Sequences by Vibration Profiles T2 - Advances in Quantitative Laryngoscopy, Voice and Speech Research, Procs. 5th International Workshop N2 - A method for automated segmentation of vocal cords in stroboscopic video sequences is presented. In contrast to earlier approaches, the inner and outer contours of the vocal cords are independently delineated. Automatic segmentation of the low contrasted images is carried out by connecting the shape constraint of a point distribution model to a multi-channel regionbased balloon model. This enables us to robustly compute a vibration profile that is used as a new diagnostic tool to visualize several vibration parameters in only one graphic. The vibration profiles are studied in two cases: one physiological vibration and one functional pathology. KW - Vibration Profile KW - Stroboscopic Images KW - Contour Detection KW - Balloon Model KW - Point Distribution Model Y1 - 2001 UR - https://www.researchgate.net/publication/242439073_Automated_Analysis_of_Stroboscopic_Image_Sequences_by_Vibration_Profiles ER - TY - CHAP A1 - Palm, Christoph A1 - Fischer, B. A1 - Lehmann, Thomas M. A1 - Spitzer, Klaus T1 - Hierarchische Wasserscheiden-Transformation zur Lippensegmentierung in Farbbildern T2 - Bildverarbeitung für die Medizin 2000 N2 - Zur Lösung komplexer Segmentierungsprobleme wird eine hierarchische und farbbasierte Wasserscheidentransformation vorgestellt. Geringe Modifikationen bezüglich Startpunktwahl und Flutungsprozess resultieren in signifikanten Verbesserungen der Segmentierung. Das Verfahren wurde zur Lippendetektion in Farbbildsequenzen eingesetzt, die zur quantitativen Beschreibung von Sprechbewegungsabläufen automatisch ausgewertet werden. Die Experimente mit 245 Bildern aus 6 Sequenzen zeigten eine Fehlerrate von 13%. KW - Hierarchische Wasserscheiden-Transformation KW - Segmentierung der Lippen KW - Bewegungsanalyse KW - Farbbildverarbeitung Y1 - 2000 U6 - https://doi.org/10.1007/978-3-642-59757-2_20 SP - 106 EP - 110 PB - Springer CY - Berlin ER - TY - CHAP A1 - Palm, Christoph A1 - Lehmann, Thomas M. A1 - Spitzer, Klaus T1 - Color Texture Analysis of Moving Vocal Cords Using Approaches from Statistics and Signal Theory T2 - Advances in Quantitative Laryngoscopy, Voice and Speech Research, Procs. 4th International Workshop, Friedrich Schiller University, Jena N2 - Textural features are applied for detection of morphological pathologies of vocal cords. Cooccurrence matrices as statistical features are presented as well as filter bank analysis by Gabor filters. Both methods are extended to handle color images. Their robustness against camera movement and vibration of vocal cords is evaluated. Classification results due to three in vivo sequences are in between 94.4 % and 98.9%. The classification errors decrease if color features are used instead of grayscale features for both statistical and Fourier features KW - Color Texture KW - Gabor Filter KW - Cooccurrence Matrix KW - Image Processing Y1 - 2000 SP - 49 EP - 56 ER - TY - JOUR A1 - Neuschaefer-Rube, C. A1 - Lehmann, Thomas M. A1 - Palm, Christoph A1 - Bredno, J. A1 - Klajman, S. A1 - Spitzer, Klaus T1 - 3D-Visualisierung glottaler Abduktionsbewegungen JF - Aktuelle phoniatrisch-pädaudiologische Aspekte Y1 - 2001 SN - 3-922766-76-5 VL - 2001/2002 IS - 9 SP - 58 EP - 61 PB - Median ER - TY - CHAP A1 - Fischer, B. A1 - Palm, Christoph A1 - Lehmann, Thomas M. A1 - Spitzer, Klaus T1 - Selektion von Farbtexturmerkmalen zur Tumorklassifikation dermatoskopischer Fotografien T2 - Bildverarbeitung für die Medizin 2002 Y1 - 2002 SP - 238 EP - 241 PB - Springer CY - Berlin ER - TY - BOOK A1 - Palm, Christoph T1 - Integrative Auswertung von Farbe und Textur Y1 - 2003 UR - http://publications.rwth-aachen.de/record/58707/files/Palm_Christoph.pdf PB - Der Andere Verlag ER - TY - JOUR A1 - Palm, Christoph A1 - Dehnhardt, Markus A1 - Vieten, Andrea A1 - Pietrzyk, Uwe A1 - Bauer, Andreas A1 - Zilles, Karl T1 - 3D rat brain tumors JF - Naunyn-Schmiedebergs Archives of Pharmacology Y1 - 2005 VL - 371 IS - R103 ER - TY - CHAP A1 - Palm, Christoph A1 - Scholl, Ingrid A1 - Lehmann, Thomas M. A1 - Spitzer, Klaus ED - Greiser, E. ED - Wischnewsky, M. T1 - Nutzung eines Farbkonstanz-Algorithmus zur Entfernung von Glanzlichtern in laryngoskopischen Bildern T2 - Methoden der Medizinischen Informatik, Biometrie und Epidemiologie in der modernen Informationsgesellschaft N2 - 1 Einführung Funktionelle und organische Störungen im Larynx beeinträchtigen die Ausdrucksfähigkeit des Menschen. Zur Diagnostik und Verlaufkontrolle werden die Stimmlippen im Larynx mit Hilfe der Video-Laryngoskopie aufgenommen. Zur optimalen Farbmessung wird dazu an das Lupenendoskop eine 3-Chip-CCD-Kamera angeschlossen, die eine unabhängige Aufnahme der drei Farbkanäle erlaubt. Die bisherige subjektive Befundung ist von der Erfahrung des Untersuchers abhängig und läßt nur eine grobe Klassifikation der Krankheitsbilder zu. Zur Objektivierung werden daher quantitative Parameter für Farbe, Textur und Schwingung entwickelt. Neben dem Einfluß der wechselnden Lichtquellenfarbe auf den Farbeindruck ist die Sekretauflage auf den Stimmlippen ein Problem bei der Farb-und Texturanalyse. Sie kann zu ausgedehnten Glanzlichtern führen und so weite Bereiche der Stimmlippen für die Farb-und Texturanalyse unbrauchbar machen. Dieser Beitrag stellt einen Farbkonstanz-Algorithmus vor, der unabhängig von der Lichtquelle quantitative Farbwerte des Gewebes liefert und die Glanzlichtdetektion und -elimination ermöglicht. 2 Methodik Ziel des Farbkonstanz-Algorithmus ist die Trennung von Lichtquellen-und Gewebefarbe. Unter Verwendung des dichromatischen Reflexionsmodells [1] kann die Oberflächenreflexion mit der Farbe der Lichtquelle und die Körperreflexion mit der Gewebefarbe identifiziert werden. Der Farbeindruck entsteht aus der Linearkombination beider Farbkomponenten. Ihre Gewichtung ist von der Aufnahmegeometrie abhängig, insbesondere vom Winkel zwischen Oberflächennormalen und dem Positionsvektor der Lichtquelle. In einem zweistufigen Verfahren wird zunächst die Lichtquellenfarbe geschätzt, dann die Gewebefarbe ermittelt. Hieraus können beide Farbanteile durch die Berechnung der Gewichtsfaktoren pixelweise getrennt werden. KW - Farbkonstanz KW - Glanzlichtelimination KW - medizinische Bildverarbeitung KW - dichromatisches Reflexionsmodell Y1 - 1998 SN - 9783820813357 SP - 300 EP - 303 PB - MMV Medien und Medizin CY - München ER - TY - CHAP A1 - Chang, Ching-Sheng A1 - Lin, Jin-Fa A1 - Lee, Ming-Ching A1 - Palm, Christoph ED - Tolxdorff, Thomas ED - Deserno, Thomas M. ED - Handels, Heinz ED - Maier, Andreas ED - Maier-Hein, Klaus H. ED - Palm, Christoph T1 - Semantic Lung Segmentation Using Convolutional Neural Networks T2 - Bildverarbeitung für die Medizin 2020. Algorithmen - Systeme - Anwendungen. Proceedings des Workshops vom 15. bis 17. März 2020 in Berlin N2 - Chest X-Ray (CXR) images as part of a non-invasive diagnosis method are commonly used in today’s medical workflow. In traditional methods, physicians usually use their experience to interpret CXR images, however, there is a large interobserver variance. Computer vision may be used as a standard for assisted diagnosis. In this study, we applied an encoder-decoder neural network architecture for automatic lung region detection. We compared a three-class approach (left lung, right lung, background) and a two-class approach (lung, background). The differentiation of left and right lungs as direct result of a semantic segmentation on basis of neural nets rather than post-processing a lung-background segmentation is done here for the first time. Our evaluation was done on the NIH Chest X-ray dataset, from which 1736 images were extracted and manually annotated. We achieved 94:9% mIoU and 92% mIoU as segmentation quality measures for the two-class-model and the three-class-model, respectively. This result is very promising for the segmentation of lung regions having the simultaneous classification of left and right lung in mind. KW - Neuronales Netz KW - Segmentierung KW - Brustkorb KW - Deep Learning KW - Encoder-Decoder Network KW - Chest X-Ray Y1 - 2020 SN - 978-3-658-29266-9 U6 - https://doi.org/10.1007/978-3-658-29267-6_17 SP - 75 EP - 80 PB - Springer Vieweg CY - Wiesbaden ER - TY - CHAP A1 - Souza Jr., Luis Antonio de A1 - Ebigbo, Alanna A1 - Probst, Andreas A1 - Messmann, Helmut A1 - Papa, João Paulo A1 - Mendel, Robert A1 - Palm, Christoph T1 - Barrett's Esophagus Identification Using Color Co-occurrence Matrices T2 - 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Parana, 2018 N2 - In this work, we propose the use of single channel Color Co-occurrence Matrices for texture description of Barrett’sEsophagus (BE)and adenocarcinoma images. Further classification using supervised learning techniques, such as Optimum-Path Forest (OPF), Support Vector Machines with Radial Basisunction (SVM-RBF) and Bayesian classifier supports the contextof automatic BE and adenocarcinoma diagnosis. We validated three approaches of classification based on patches, patients and images in two datasets (MICCAI 2015 and Augsburg) using the color-and-texture descriptors and the machine learning techniques. Concerning MICCAI 2015 dataset, the best results were obtained using the blue channel for the descriptors and the supervised OPF for classification purposes in the patch-based approach, with sensitivity nearly to 73% for positive adenocarcinoma identification and specificity close to 77% for BE (non-cancerous) patch classification. Regarding the Augsburg dataset, the most accurate results were also obtained using both OPF classifier and blue channel descriptor for the feature extraction, with sensitivity close to 67% and specificity around to76%. Our work highlights new advances in the related research area and provides a promising technique that combines color and texture information, allied to three different approaches of dataset pre-processing aiming to configure robust scenarios for the classification step. KW - Barrett’s Esophagus KW - Co-occurrence Matrices KW - Machine learning KW - Texture Analysis Y1 - 2018 U6 - https://doi.org/10.1109/SIBGRAPI.2018.00028 SP - 166 EP - 173 ER - TY - CHAP A1 - Middel, Luise A1 - Palm, Christoph A1 - Erdt, Marius T1 - Synthesis of Medical Images Using GANs T2 - Uncertainty for safe utilization of machine learning in medical imaging and clinical image-based procedures. First International Workshop, UNSURE 2019, and 8th International Workshop, CLIP 2019, held in conjunction with MICCAI 2019, Shenzhen, China, October 17, 2019 N2 - The success of artificial intelligence in medicine is based on the need for large amounts of high quality training data. Sharing of medical image data, however, is often restricted by laws such as doctor-patient confidentiality. Although there are publicly available medical datasets, their quality and quantity are often low. Moreover, datasets are often imbalanced and only represent a fraction of the images generated in hospitals or clinics and can thus usually only be used as training data for specific problems. The introduction of generative adversarial networks (GANs) provides a mean to generate artificial images by training two convolutional networks. This paper proposes a method which uses GANs trained on medical images in order to generate a large number of artificial images that could be used to train other artificial intelligence algorithms. This work is a first step towards alleviating data privacy concerns and being able to publicly share data that still contains a substantial amount of the information in the original private data. The method has been evaluated on several public datasets and quantitative and qualitative tests showing promising results. KW - Neuronale Netze KW - Deep Learning KW - Generative adversarial networks KW - Machine Learning KW - Artificial Intelligence KW - Data privacy KW - Deep Learning KW - Bilderzeugung KW - Datenschutz Y1 - 2019 SN - 978-3-030-32688-3 U6 - https://doi.org/10.1007/978-3-030-32689-0_13 SN - 0302-9743 SP - 125 EP - 134 PB - Springer Nature CY - Cham ER - TY - CHAP A1 - Palm, Christoph A1 - Lehmann, Thomas M. A1 - Spitzer, Klaus T1 - Bestimmung der Lichtquellenfarbe bei der Endoskopie mikrotexturierter Oberflächen des Kehlkopfes T2 - 5. Workshop Farbbildverarbeitung, Ilmenau, 1999 N2 - Zur Unterstützung der Diagnose von Stimmlippenerkrankungen werden innerhalb des Forschungsprojektes Quantitative Digitale Laryngoskopie objektive Parameter zur Beschreibung der Bewegung, der Farbe sowie der Form der Stimmlippen entwickelt und klinisch evaluiert. Während die Bewegungsanalyse Aufschluß über funktionelle Stimmstörungen gibt, beschreiben Parameter der Farb- und Formanalyse morphologische Veränderungen des Stimmlippengewebes. In diesem Beitrag werden die Methoden und bisherigen Ergebnisse zur Bewegungs- und Farbanalyse vorgestellt. Die Bewegungsanalyse wurde mit einem erweiterten Konturmodell (Snakes) durchgeführt. Aufgrund des modifizierten Konturmodells konnten die Konturen der Stimmlippen automatisch über die gesmate Bildsequenz zuverlässig detektiert werden. Die Vermssung der Konturen liefert neue quantitative Parameter zur Befundung von laryngoskopischen Stimmlippenaufnahmen. Um die Farbeigenschaften der Stimmlippen zu bestimmen, wurde ausgehend vom RGB-Bild die Objektfarbe unabhängig von der Farbe der Lichtquelle durch Verwendung von Clusterverfahren und der Viertelkreisanalyse berechnet. Mit dieser Farbanalyse konnte die Farbe der Lichtquelle ermittelt und das beleuchtungsunabhängige Farbbild berechnet werden. Die Quanitifizierung der Rötung der Stimmlippen ist z.B. ein entscheidendes Kriterium zur Diagnostik der akuten Laryngitis. KW - Konturverfolgung KW - Snakes KW - Dichromatisches Reflexionsmodell KW - Farbkonstanz KW - Laryngoskopie Y1 - 1999 UR - http://www.germancolorgroup.de/html/Vortr_99_pdf/01_Palm.pdf SP - 3 EP - 10 ER - TY - CHAP A1 - Weiherer, Maximilian A1 - Zorn, Martin A1 - Wittenberg, Thomas A1 - Palm, Christoph ED - Tolxdorff, Thomas ED - Deserno, Thomas M. ED - Handels, Heinz ED - Maier, Andreas ED - Maier-Hein, Klaus H. ED - Palm, Christoph T1 - Retrospective Color Shading Correction for Endoscopic Images T2 - Bildverarbeitung für die Medizin 2020. Algorithmen - Systeme - Anwendungen. Proceedings des Workshops vom 15. bis 17. März 2020 in Berlin N2 - In this paper, we address the problem of retrospective color shading correction. An extension of the established gray-level shading correction algorithm based on signal envelope (SE) estimation to color images is developed using principal color components. Compared to the probably most general shading correction algorithm based on entropy minimization, SE estimation does not need any computationally expensive optimization and thus can be implemented more effciently. We tested our new shading correction scheme on artificial as well as real endoscopic images and observed promising results. Additionally, an indepth analysis of the stop criterion used in the SE estimation algorithm is provided leading to the conclusion that a fixed, user-defined threshold is generally not feasible. Thus, we present new ideas how to develop a non-parametric version of the SE estimation algorithm using entropy. KW - Endoskopie KW - Bildgebendes Verfahren KW - Farbenraum KW - Graustufe Y1 - 2020 SN - 978-3-658-29266-9 U6 - https://doi.org/10.1007/978-3-658-29267-6 SP - 14 EP - 19 PB - Springer Vieweg CY - Wiesbaden ER - TY - CHAP A1 - Palm, Christoph A1 - Keysers, Daniel A1 - Lehmann, Thomas M. A1 - Spitzer, Klaus T1 - Gabor Filtering of Complex Hue/Saturation Images for Color Texture Classification T2 - Proceedings of the 5th Joint Conference on Information Science (JCIS) 2, The Association for Intelligent Machinery, Atlantic City, NJ, 2000 N2 - Objective: Complex hue/saturation images as a new approach for color texture classification using Gabor filters are introduced and compared with common techniques. Method: The interpretation of hue and saturationas polar coordinates allows direct use of the HSV-colorspace for Fourier transform. This technique is applied for Gabor feature extraction of color textures. In contrast to other color features based on the RGB-colorspace [1] the combination of color bands is done previous to the filtering. Results: The performance of the new HS-featuresis compared with that of RGB based as well as grayscale Gabor features by evaluating the classifi-cation of 30 natural textures. The new HS-featuresshow same results like the best RGB features but allow a more compact representation. On the averagethe color features improve the results of grayscale features. Conclusion: The consideration of the color information enhances the classification of color texture. The choice of colorspace cannot be adjudged finally, but the introduced features suggest the use of the HSV-colorspace with less features than RGB. Y1 - 2000 UR - http://www.keysers.net/daniel/files/JCIS2000_palm.pdf SP - 45 EP - 49 ER - TY - JOUR A1 - Ebigbo, Alanna A1 - Mendel, Robert A1 - Probst, Andreas A1 - Manzeneder, Johannes A1 - Prinz, Friederike A1 - Souza Jr., Luis Antonio de A1 - Papa, João Paulo A1 - Palm, Christoph A1 - Messmann, Helmut T1 - Real-time use of artificial intelligence in the evaluation of cancer in Barrett’s oesophagus JF - Gut N2 - Based on previous work by our group with manual annotation of visible Barrett oesophagus (BE) cancer images, a real-time deep learning artificial intelligence (AI) system was developed. While an expert endoscopist conducts the endoscopic assessment of BE, our AI system captures random images from the real-time camera livestream and provides a global prediction (classification), as well as a dense prediction (segmentation) differentiating accurately between normal BE and early oesophageal adenocarcinoma (EAC). The AI system showed an accuracy of 89.9% on 14 cases with neoplastic BE. KW - Speiseröhrenkrankheit KW - Diagnose KW - Maschinelles Lernen KW - Barrett's esophagus KW - Deep learning KW - real-time Y1 - 2020 U6 - https://doi.org/10.1136/gutjnl-2019-319460 VL - 69 IS - 4 SP - 615 EP - 616 PB - BMJ CY - London ER - TY - JOUR A1 - Palm, Christoph A1 - Lehmann, Thomas M. T1 - Classification of Color Textures by Gabor Filtering JF - Machine GRAPHICS & VISION Y1 - 2002 VL - 11 IS - 2/3 SP - 195 EP - 219 ER - TY - JOUR A1 - Arribas, Julia A1 - Antonelli, Giulio A1 - Frazzoni, Leonardo A1 - Fuccio, Lorenzo A1 - Ebigbo, Alanna A1 - van der Sommen, Fons A1 - Ghatwary, Noha A1 - Palm, Christoph A1 - Coimbra, Miguel A1 - Renna, Francesco A1 - Bergman, Jacques J.G.H.M. A1 - Sharma, Prateek A1 - Messmann, Helmut A1 - Hassan, Cesare A1 - Dinis-Ribeiro, Mario J. T1 - Standalone performance of artificial intelligence for upper GI neoplasia: a meta-analysis JF - Gut N2 - Objective: Artificial intelligence (AI) may reduce underdiagnosed or overlooked upper GI (UGI) neoplastic and preneoplastic conditions, due to subtle appearance and low disease prevalence. Only disease-specific AI performances have been reported, generating uncertainty on its clinical value. Design: We searched PubMed, Embase and Scopus until July 2020, for studies on the diagnostic performance of AI in detection and characterisation of UGI lesions. Primary outcomes were pooled diagnostic accuracy, sensitivity and specificity of AI. Secondary outcomes were pooled positive (PPV) and negative (NPV) predictive values. We calculated pooled proportion rates (%), designed summary receiving operating characteristic curves with respective area under the curves (AUCs) and performed metaregression and sensitivity analysis. Results: Overall, 19 studies on detection of oesophageal squamous cell neoplasia (ESCN) or Barrett's esophagus-related neoplasia (BERN) or gastric adenocarcinoma (GCA) were included with 218, 445, 453 patients and 7976, 2340, 13 562 images, respectively. AI-sensitivity/specificity/PPV/NPV/positive likelihood ratio/negative likelihood ratio for UGI neoplasia detection were 90% (CI 85% to 94%)/89% (CI 85% to 92%)/87% (CI 83% to 91%)/91% (CI 87% to 94%)/8.2 (CI 5.7 to 11.7)/0.111 (CI 0.071 to 0.175), respectively, with an overall AUC of 0.95 (CI 0.93 to 0.97). No difference in AI performance across ESCN, BERN and GCA was found, AUC being 0.94 (CI 0.52 to 0.99), 0.96 (CI 0.95 to 0.98), 0.93 (CI 0.83 to 0.99), respectively. Overall, study quality was low, with high risk of selection bias. No significant publication bias was found. Conclusion: We found a high overall AI accuracy for the diagnosis of any neoplastic lesion of the UGI tract that was independent of the underlying condition. This may be expected to substantially reduce the miss rate of precancerous lesions and early cancer when implemented in clinical practice. KW - Artificial Intelligence Y1 - 2021 U6 - https://doi.org/10.1136/gutjnl-2020-321922 VL - 70 IS - 8 SP - 1458 EP - 1468 PB - BMJ CY - London ER - TY - JOUR A1 - Ebigbo, Alanna A1 - Mendel, Robert A1 - Rückert, Tobias A1 - Schuster, Laurin A1 - Probst, Andreas A1 - Manzeneder, Johannes A1 - Prinz, Friederike A1 - Mende, Matthias A1 - Steinbrück, Ingo A1 - Faiss, Siegbert A1 - Rauber, David A1 - Souza Jr., Luis Antonio de A1 - Papa, João Paulo A1 - Deprez, Pierre A1 - Oyama, Tsuneo A1 - Takahashi, Akiko A1 - Seewald, Stefan A1 - Sharma, Prateek A1 - Byrne, Michael F. A1 - Palm, Christoph A1 - Messmann, Helmut T1 - Endoscopic prediction of submucosal invasion in Barrett’s cancer with the use of Artificial Intelligence: A pilot Study JF - Endoscopy N2 - Background and aims: The accurate differentiation between T1a and T1b Barrett’s cancer has both therapeutic and prognostic implications but is challenging even for experienced physicians. We trained an Artificial Intelligence (AI) system on the basis of deep artificial neural networks (deep learning) to differentiate between T1a and T1b Barrett’s cancer white-light images. Methods: Endoscopic images from three tertiary care centres in Germany were collected retrospectively. A deep learning system was trained and tested using the principles of cross-validation. A total of 230 white-light endoscopic images (108 T1a and 122 T1b) was evaluated with the AI-system. For comparison, the images were also classified by experts specialized in endoscopic diagnosis and treatment of Barrett’s cancer. Results: The sensitivity, specificity, F1 and accuracy of the AI-system in the differentiation between T1a and T1b cancer lesions was 0.77, 0.64, 0.73 and 0.71, respectively. There was no statistically significant difference between the performance of the AI-system and that of human experts with sensitivity, specificity, F1 and accuracy of 0.63, 0.78, 0.67 and 0.70 respectively. Conclusion: This pilot study demonstrates the first multicenter application of an AI-based system in the prediction of submucosal invasion in endoscopic images of Barrett’s cancer. AI scored equal to international experts in the field, but more work is necessary to improve the system and apply it to video sequences and in a real-life setting. Nevertheless, the correct prediction of submucosal invasion in Barret´s cancer remains challenging for both experts and AI. KW - Maschinelles Lernen KW - Neuronales Netz KW - Speiseröhrenkrebs KW - Diagnose KW - Artificial Intelligence KW - Machine learning KW - Adenocarcinoma KW - Barrett’s cancer KW - submucosal invasion Y1 - 2021 U6 - https://doi.org/10.1055/a-1311-8570 VL - 53 IS - 09 SP - 878 EP - 883 PB - Thieme CY - Stuttgart ER - TY - JOUR A1 - Souza Jr., Luis Antonio de A1 - Passos, Leandro A. A1 - Mendel, Robert A1 - Ebigbo, Alanna A1 - Probst, Andreas A1 - Messmann, Helmut A1 - Palm, Christoph A1 - Papa, João Paulo T1 - Assisting Barrett's esophagus identification using endoscopic data augmentation based on Generative Adversarial Networks JF - Computers in Biology and Medicine N2 - Barrett's esophagus figured a swift rise in the number of cases in the past years. Although traditional diagnosis methods offered a vital role in early-stage treatment, they are generally time- and resource-consuming. In this context, computer-aided approaches for automatic diagnosis emerged in the literature since early detection is intrinsically related to remission probabilities. However, they still suffer from drawbacks because of the lack of available data for machine learning purposes, thus implying reduced recognition rates. This work introduces Generative Adversarial Networks to generate high-quality endoscopic images, thereby identifying Barrett's esophagus and adenocarcinoma more precisely. Further, Convolution Neural Networks are used for feature extraction and classification purposes. The proposed approach is validated over two datasets of endoscopic images, with the experiments conducted over the full and patch-split images. The application of Deep Convolutional Generative Adversarial Networks for the data augmentation step and LeNet-5 and AlexNet for the classification step allowed us to validate the proposed methodology over an extensive set of datasets (based on original and augmented sets), reaching results of 90% of accuracy for the patch-based approach and 85% for the image-based approach. Both results are based on augmented datasets and are statistically different from the ones obtained in the original datasets of the same kind. Moreover, the impact of data augmentation was evaluated in the context of image description and classification, and the results obtained using synthetic images outperformed the ones over the original datasets, as well as other recent approaches from the literature. Such results suggest promising insights related to the importance of proper data for the accurate classification concerning computer-assisted Barrett's esophagus and adenocarcinoma detection. KW - Maschinelles Lernen KW - Barrett's esophagus KW - Machine learning KW - Adenocarcinoma KW - Generative adversarial networks KW - Neuronales Netz KW - Adenocarcinom KW - Speiseröhrenkrebs KW - Diagnose Y1 - 2020 U6 - https://doi.org/10.1016/j.compbiomed.2020.104029 VL - 126 IS - November PB - Elsevier ER - TY - INPR A1 - Weiherer, Maximilian A1 - Eigenberger, Andreas A1 - Brébant, Vanessa A1 - Prantl, Lukas A1 - Palm, Christoph T1 - Learning the shape of female breasts: an open-access 3D statistical shape model of the female breast built from 110 breast scans N2 - We present the Regensburg Breast Shape Model (RBSM) – a 3D statistical shape model of the female breast built from 110 breast scans, and the first ever publicly available. Together with the model, a fully automated, pairwise surface registration pipeline used to establish correspondence among 3D breast scans is introduced. Our method is computationally efficient and requires only four landmarks to guide the registration process. In order to weaken the strong coupling between breast and thorax, we propose to minimize the variance outside the breast region as much as possible. To achieve this goal, a novel concept called breast probability masks (BPMs) is introduced. A BPM assigns probabilities to each point of a 3D breast scan, telling how likely it is that a particular point belongs to the breast area. During registration, we use BPMs to align the template to the target as accurately as possible inside the breast region and only roughly outside. This simple yet effective strategy significantly reduces the unwanted variance outside the breast region, leading to better statistical shape models in which breast shapes are quite well decoupled from the thorax. The RBSM is thus able to produce a variety of different breast shapes as independently as possible from the shape of the thorax. Our systematic experimental evaluation reveals a generalization ability of 0.17 mm and a specificity of 2.8 mm for the RBSM. Ultimately, our model is seen as a first step towards combining physically motivated deformable models of the breast and statistical approaches in order to enable more realistic surgical outcome simulation. KW - Statistical shape mode KW - Surgical outcome simulation KW - 3D breast scan registration KW - Non-rigid surface registration KW - Breast imaging Y1 - 2021 ER - TY - CHAP A1 - Palm, Christoph A1 - Metzler, V. A1 - Moham, B. A1 - Dieker, O. A1 - Lehmann, Thomas M. A1 - Spitzer, Klaus ED - Evers, H. ED - Glombitza, G. ED - Lehmann, Thomas M. ED - Meinzer, H.-P. T1 - Co-Occurrence Matrizen zur Texturklassifikation in Vektorbildern T2 - Bildverarbeitung für die Medizin N2 - Statistische Eigenschaften natürlicher Grauwerttexturen werden mit Co-Occurrence Matrizen, basierend auf der Grauwertstatistik zweiter Ordnung, modelliert. Die Matrix gibt dann die apriori Wahrscheinlichkeiten aller Grauwertpaare an. Da in der medizinischen Bildverarbeitung verstärkt Multispektralbilder ausgewertet werden, wird das bekannte Konzept hier auf beliebige Vektorbilder erweitert. Dadurch kann bei der Texturklassifikation die zur Verfügung stehende Information vollständig genutzt werden. Insbesondere zur Detektion von Farbtexturen ist dieser Ansatz geeignet, da Wertepaare unterschiedlicher Spektralebenen ausgewertet werden können. Ebenso kann die Methode auch bei der Multiskalendekomposition von Intensitätsbildern zur Verbesserung der Texturerkennung beitragen. Die in den Matrizen entstehenden Muster lassen dann über die Extraktion geeigneter Texturdeskriptoren Rückschlüsse auf die Texturen des Bildes zu. KW - Texturerkennung KW - Vektorbilder KW - Multispektralbilder KW - Multiskalenbilder KW - Klassifikation Y1 - 1999 U6 - https://doi.org/10.1007/978-3-642-60125-5_69 SP - 367 EP - 371 PB - Springer CY - Berlin ER - TY - CHAP A1 - Palm, Christoph A1 - Pelkmann, Annegret A1 - Lehmann, Thomas M. A1 - Spitzer, Klaus T1 - Distortion Correction of Laryngoscopic Images T2 - Advances in quantitative laryngoscopy, voice and speech research, Proceedings of the 3rd international workshop Aachen, RWTH N2 - Laryngoscopic images of the vocal tract are used for diagnostic purposes. Quantitative mea-surements like changes of the glottis size or the surface of the vocal cords during an image sequence can be helpful to describe the healing process or to compare the findings of diffe-rent patients. Typically the endoscopic images are circulary symmetric distorted (barrel di-stortion). Therefore measurements of geometric dimensions depend on the object´s position in the image. In this paper an algorithm is presented which allows the computation of the translational invariant "real" object size by correcting the image distortion without using additional calibration of the optical environment. KW - image distortion KW - camera calibration KW - multiple regression analysis Y1 - 1998 UR - https://pdfs.semanticscholar.org/e9d8/eb27af24bd79f482821441c2bf0eee7b3fe6.pdf?_ga=2.183754286.985176231.1591560247-1467258391.1581026068 SP - 117 EP - 125 ER -