TY - CHAP A1 - Hassan, H. A1 - Ilgner, Justus F. R. A1 - Palm, Christoph A1 - Lehmann, Thomas M. A1 - Spitzer, Klaus A1 - Westhofen, Martin ED - Lehmann, Thomas M. ED - Spitzer, Klaus ED - Tolxdorff, Thomas T1 - Objective Judgement of Endoscopic Laryngeal Images T2 - Advances in Quantitative Laryngoscopy, Voice and Speech Research, Proceedings of the 3rd International Workshop, RWTH Aachen N2 - Video Documentation of endoscopic findings simplifies diagnostic counseling of the patient and aids pre-operative discussion among the medical team. Judgment of such images is still subjective and can not give a quantitative evaluation of the disease process regarding diagnosis or response to treatment. Modern treatment of early laryngeal cancer with laserablation requires intensive follow up and frequent direct laryngoscopy under general anesthesia with blind biopsies to detect any tumor residual or recurrence. Inflammatory conditions of the larynx are frequently confused with other causes of dysphonia. Mapping anddigital analysis of the documented image will suggest the tumor site and avoids undue blind biopsies under anesthesia. However, varying illumination results in different colors reflected from the same object. To achieve quantitative analysis, color constancy has to be assured. Inthis paper, the environment is presented which allow the objective judgment of larngoscopies. KW - Laryngoscopy KW - Diagnosis KW - Image processing KW - Quantitative Image analysis KW - Colorconstancy Y1 - 1998 UR - https://citeseerx.ist.psu.edu/doc_view/pid/caf5bedf5cf68ed3be68054b140a1241f4f278e2 SP - 135 EP - 142 ER - TY - CHAP A1 - Scholl, Ingrid A1 - Palm, Christoph A1 - Sovakar, Abhijit A1 - Lehmann, Thomas M. A1 - Spitzer, Klaus ED - Arnolds, B. ED - Mueller, H. ED - Saupe, D. ED - Tolxdorff, Thomas T1 - Quantitative Analyse der Stimmlippen T2 - 5. Workshop Digitale Bildverarbeitung in der Medizin, Universität Freiburg, 10.-11. März 1997 KW - Konturverfolgung KW - Snakes KW - Farbanalyse KW - Dichromatisches Reflexionsmodell KW - Farbkonstanz KW - Laryngoskopie Y1 - 1997 UR - https://pdfs.semanticscholar.org/9a0c/9e7dc883ccf6e8a8a686c28422238adb5f35.pdf SP - 81 EP - 86 ER - TY - GEN A1 - Krefting, Dagmar A1 - Zaunseder, Sebastian A1 - Säring, Dennis A1 - Wittenberg, Thomas A1 - Palm, Christoph A1 - Schiecke, Karin A1 - Krenkel, Lars A1 - Hennemuth, Anja A1 - Schnell, Susanne A1 - Spicher, Nicolai T1 - Blutdruck, Hämodynamik und Gefäßzustand: Innovative Erfassung und Bewertung – Schwerpunkt bildbasierte Verfahren T2 - 66. Jahrestagung der Deutschen Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie e. V. (GMDS), 12. Jahreskongress der Technologie- und Methodenplattform für die vernetzte medizinische Forschung e. V. (TMF), 26. - 30.09.2021, online N2 - Einleitung: Blutdruck gilt als sogenannter Vitalparameter als einer der grundlegenden Indikatoren für den Gesundheitszustand einer Person. Sowohl zu niedriger als auch zu hoher Blutdruck kann lebensbedrohend sein, letzerer ist darüber hinaus ein Risikofaktor insbesondere für Herz-Kreislauferkrankungen, die trotz wichtiger Fortschritte in der Behandlung immer noch die häufigste Todesursache in Deutschland darstellen. Die Hämodynamik, also die raumzeitliche Dynamik des Blutflusses, und der Gefäßzustand sind eng verbunden mit dem Blutdruck und ebenfalls von hoher klinischer Relevanz, u.a. zur Identifikation von Durchblutungsstörungen und ungünstigen Druckverteilungen der Gefäßwand. Innovationen in der Messtechnik als auch in der Datenanalyse bieten heute neue Möglichkeiten der Erfassung und Bewertung von Blutdruck, Hämodynamik und Gefäßzustand [1], [2], [3], [4]. Methodik: In einer gemeinsamen Workshopserie der AG Medizinische Bild- und Signalverarbeitung der GMDS und des Fachausschusses Biosignale der DGBMT werden wir neue Ansätze und Lösungen für Mess- und Analyseverfahren zu Blutdruck und -fluss sowie zum Gefäßzustand vorstellen und diskutieren. Dabei stehen im ersten Workshop auf der GMDS Jahrestagung Bildbasierte Verfahren im Zentrum, während der zweite Workshop auf der DGBMT Jahrestagung den Fokus auf Biosignalbasierten Verfahren legt. Es werden aktuelle Forschungsergebnisse vorgestellt und diskutiert. Es sind jeweils mehrere Vorträge geplant mit ausreichend Zeit zur Diskussion. Folgende Vorträge sind geplant (Arbeitstitel): Sebastian Zaunseder: Videobasierte Erfassung des Blutdrucks Anja Hennemuth: A Visualization Toolkit for the Analysis of Aortic Anatomy and Pressure Distribution Lars Krenkel: Numerische Analyse der Rupturwahrscheinlichkeit zerebraler Aneurysmata Susanne Schnell: Messung des Blutflusses und hämodynamischer Parameter mit 4D flow MRI: Möglichkeiten und Herausforderungen Ergebnisse: Ziel des Workshops ist die Identifikation von innovativen Ansätzen und neuen Methoden zur qualitativen und quantitativen Bestimmung von hämodynamischen Parametern sowie deren kritische Bewertung durch die Community für die Eignung in der klinischen Entscheidungsunterstützung. Diskussion: Der Workshop leistet inhaltlich einen Beitrag zu zentralen Aspekten für die Herz-Kreislauf-Medizin. Er bringt dabei Expertise aus verschiedenen Bereichen zusammen und schlägt die Brücke zwischen Kardiologie, Medizininformatik und Medizintechnik. Schlussfolgerung: Innovative Technologien aus Medizintechnik und Informatik ermöglichen zunehmend einfache und raumzeitlich aufgelöste Erfassung und Bewertung wichtiger Informationen zur Unterstützung von Diagnose und Therapieverfolgung. [1] Zaunseder S, Trumpp A, Wedekind D, Malberg H. Cardiovascular assessment by imaging photoplethysmography - a review. Biomed Tech (Berl). 2018 Oct 25;63(5):617–34. [2] Huellebrand M, Messroghli D, Tautz L, Kuehne T, Hennemuth A. An extensible software platform for interdisciplinary cardiovascular imaging research. Comput Methods Programs Biomed. 2020 Feb;184:105277. [3] Schmitter S, Adriany G, Waks M, Moeller S, Aristova M, Vali A, et al. Bilateral Multiband 4D Flow MRI of the Carotid Arteries at 7T. Magn Reson Med. 2020 Oct;84(4):1947–60. [4] Birkenmaier C, and Krenkel, L. Flow in Artificial Lungs. In: New Results in Numerical and Experimental Fluid Mechanics XIII. Contributions to the 22nd STAB/DGLR Symposium. Springer; 2021. KW - Bildbasierte Verfahren KW - Blutdruck KW - Hämodynamik KW - Blutgefäß KW - Bildgebendes Verfahren Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0183-21gmds0167 ER - TY - JOUR A1 - Graßmann, Felix A1 - Mengelkamp, Judith A1 - Brandl, Caroline A1 - Harsch, Sebastian A1 - Zimmermann, Martina E. A1 - Linkohr, Birgit A1 - Peters, Annette A1 - Heid, Iris M. A1 - Palm, Christoph A1 - Weber, Bernhard H. F. T1 - A Deep Learning Algorithm for Prediction of Age-Related Eye Disease Study Severity Scale for Age-Related Macular Degeneration from Color Fundus Photography JF - Ophtalmology N2 - Purpose Age-related macular degeneration (AMD) is a common threat to vision. While classification of disease stages is critical to understanding disease risk and progression, several systems based on color fundus photographs are known. Most of these require in-depth and time-consuming analysis of fundus images. Herein, we present an automated computer-based classification algorithm. Design Algorithm development for AMD classification based on a large collection of color fundus images. Validation is performed on a cross-sectional, population-based study. Participants. We included 120 656 manually graded color fundus images from 3654 Age-Related Eye Disease Study (AREDS) participants. AREDS participants were >55 years of age, and non-AMD sight-threatening diseases were excluded at recruitment. In addition, performance of our algorithm was evaluated in 5555 fundus images from the population-based Kooperative Gesundheitsforschung in der Region Augsburg (KORA; Cooperative Health Research in the Region of Augsburg) study. Methods. We defined 13 classes (9 AREDS steps, 3 late AMD stages, and 1 for ungradable images) and trained several convolution deep learning architectures. An ensemble of network architectures improved prediction accuracy. An independent dataset was used to evaluate the performance of our algorithm in a population-based study. Main Outcome Measures. κ Statistics and accuracy to evaluate the concordance between predicted and expert human grader classification. Results. A network ensemble of 6 different neural net architectures predicted the 13 classes in the AREDS test set with a quadratic weighted κ of 92% (95% confidence interval, 89%–92%) and an overall accuracy of 63.3%. In the independent KORA dataset, images wrongly classified as AMD were mainly the result of a macular reflex observed in young individuals. By restricting the KORA analysis to individuals >55 years of age and prior exclusion of other retinopathies, the weighted and unweighted κ increased to 50% and 63%, respectively. Importantly, the algorithm detected 84.2% of all fundus images with definite signs of early or late AMD. Overall, 94.3% of healthy fundus images were classified correctly. Conclusions Our deep learning algoritm revealed a weighted κ outperforming human graders in the AREDS study and is suitable to classify AMD fundus images in other datasets using individuals >55 years of age. KW - Senile Makuladegeneration KW - Krankheitsverlauf KW - Mustererkennung KW - Maschinelles Lernen Y1 - 2018 U6 - https://doi.org/10.1016/j.ophtha.2018.02.037 N1 - Corresponding authors: Bernhard H. F. Weber, University of Regensburg, and Christoph Palm VL - 125 IS - 9 SP - 1410 EP - 1420 PB - Elsevier ER - TY - JOUR A1 - Hartmann, Robin A1 - Weiherer, Maximilian A1 - Nieberle, Felix A1 - Palm, Christoph A1 - Brébant, Vanessa A1 - Prantl, Lukas A1 - Lamby, Philipp A1 - Reichert, Torsten E. A1 - Taxis, Jürgen A1 - Ettl, Tobias T1 - Evaluating smartphone-based 3D imaging techniques for clinical application in oral and maxillofacial surgery: A comparative study with the vectra M5 JF - Oral and Maxillofacial Surgery N2 - PURPOSE This study aimed to clarify the applicability of smartphone-based three-dimensional (3D) surface imaging for clinical use in oral and maxillofacial surgery, comparing two smartphone-based approaches to the gold standard. METHODS Facial surface models (SMs) were generated for 30 volunteers (15 men, 15 women) using the Vectra M5 (Canfield Scientific, USA), the TrueDepth camera of the iPhone 14 Pro (Apple Inc., USA), and the iPhone 14 Pro with photogrammetry. Smartphone-based SMs were superimposed onto Vectra-based SMs. Linear measurements and volumetric evaluations were performed to evaluate surface-to-surface deviation. To assess inter-observer reliability, all measurements were performed independently by a second observer. Statistical analyses included Bland-Altman analyses, the Wilcoxon signed-rank test for paired samples, and Intraclass correlation coefficients. RESULTS Photogrammetry-based SMs exhibited an overall landmark-to-landmark deviation of M = 0.8 mm (SD =  ± 0.58 mm, n = 450), while TrueDepth-based SMs displayed a deviation of M = 1.1 mm (SD =  ± 0.72 mm, n = 450). The mean volumetric difference for photogrammetry-based SMs was M = 1.8 cc (SD =  ± 2.12 cc, n = 90), and M = 3.1 cc (SD =  ± 2.64 cc, n = 90) for TrueDepth-based SMs. When comparing the two approaches, most landmark-to-landmark measurements demonstrated 95% Bland-Altman limits of agreement (LoA) of ≤ 2 mm. Volumetric measurements revealed LoA > 2 cc. Photogrammetry-based measurements demonstrated higher inter-observer reliability for overall landmark-to-landmark deviation. CONCLUSION Both approaches for smartphone-based 3D surface imaging exhibit potential in capturing the face. Photogrammetry-based SMs demonstrated superior alignment and volumetric accuracy with Vectra-based SMs than TrueDepth-based SMs. KW - Three-dimensional Surface Imaging KW - Smartphone-based Surface Imaging TrueDepth Stereophotogrammetry Oral and Maxillofacial Surgery KW - TrueDepth KW - Stereophotogrammetry KW - Oral and Maxillofacial Surgery Y1 - 2025 U6 - https://doi.org/10.1007/s10006-024-01322-2 VL - 29 PB - Springer Nature ER - TY - JOUR A1 - Maier, Johannes A1 - Perret, Jerome A1 - Simon, Martina A1 - Schmitt-Rüth, Stephanie A1 - Wittenberg, Thomas A1 - Palm, Christoph T1 - Force-feedback assisted and virtual fixtures based K-wire drilling simulation JF - Computers in Biology and Medicine N2 - One common method to fix fractures of the human hand after an accident is an osteosynthesis with Kirschner wires (K-wires) to stabilize the bone fragments. The insertion of K-wires is a delicate minimally invasive surgery, because surgeons operate almost without a sight. Since realistic training methods are time consuming, costly and insufficient, a virtual-reality (VR) based training system for the placement of K-wires was developed. As part of this, the current work deals with the real-time bone drilling simulation using a haptic force-feedback device. To simulate the drilling, we introduce a virtual fixture based force-feedback drilling approach. By decomposition of the drilling task into individual phases, each phase can be handled individually to perfectly control the drilling procedure. We report about the related finite state machine (FSM), describe the haptic feedback of each state and explain, how to avoid jerking of the haptic force-feedback during state transition. The usage of the virtual fixture approach results in a good haptic performance and a stable drilling behavior. This was confirmed by 26 expert surgeons, who evaluated the virtual drilling on the simulator and rated it as very realistic. To make the system even more convincing, we determined real drilling feed rates through experimental pig bone drilling and transferred them to our system. Due to a constant simulation thread we can guarantee a precise drilling motion. Virtual fixtures based force-feedback calculation is able to simulate force-feedback assisted bone drilling with high quality and, thus, will have a great potential in developing medical applications. KW - Handchirurgie KW - Osteosynthese KW - Operationstechnik KW - Lernprogramm KW - Virtuelle Realität KW - Medical training system KW - Virtual fixtures KW - Virtual reality KW - Force-feedback haptic KW - Minimally invasive hand surgery KW - K-wire drilling Y1 - 2019 U6 - https://doi.org/10.1016/j.compbiomed.2019.103473 N1 - Corresponding author: Christoph Palm VL - 114 SP - 1 EP - 10 PB - Elsevier ER - TY - CHAP A1 - Souza, Luis A. A1 - Pacheco, André G.C. A1 - de Angelo, Gabriel G. A1 - Oliveira-Santos, Thiago A1 - Palm, Christoph A1 - Papa, João Paulo T1 - LiwTERM: A Lightweight Transformer-Based Model for Dermatological Multimodal Lesion Detection T2 - 2024 37th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Manaus, Brazil, 9/30/2024 - 10/3/2024 N2 - Skin cancer is the most common type of cancer in the world, accounting for approximately 30% of all diagnosed tumors. Early diagnosis reduces mortality rates and prevents disfiguring effects in different body regions. In recent years, machine learning techniques, particularly deep learning, have shown promising results in this task, presenting studies that have demonstrated that combining a patient’s clinical information with images of the lesion is crucial for improving the classification of skin lesions. Despite that, meaningful use of clinical information with multiple images is mandatory, requiring further investigation. Thus, this project aims to contribute to developing multimodal machine learning-based models to cope with the skin lesion classification task employing a lightweight transformer model. As a main hypothesis, models can take multiple images from different sources as input, along with clinical information from the patient’s history, leading to a more reliable diagnosis. Our model deals with the not-trivial task of combining images and clinical information (from anamneses) concerning the skin lesions in a lightweight transformer architecture that does not demand high computation resources but still presents competitive classification results. KW - Lightweight Architectures KW - Trans- formers KW - Skin Lesion Detection KW - Deep learning Y1 - 2024 SN - 979-8-3503-7603-6 U6 - https://doi.org/10.1109/SIBGRAPI62404.2024.10716324 SP - 1 EP - 6 PB - IEEE ER - TY - CHAP A1 - Souza Jr., Luis Antonio de A1 - Passos, Leandro A. A1 - Mendel, Robert A1 - Ebigbo, Alanna A1 - Probst, Andreas A1 - Messmann, Helmut A1 - Palm, Christoph A1 - Papa, João Paulo T1 - Fine-tuning Generative Adversarial Networks using Metaheuristics BT - A Case Study on Barrett's Esophagus Identification T2 - Bildverarbeitung für die Medizin 2021. Proceedings, German Workshop on Medical Image Computing, Regensburg, March 7-9, 2021 N2 - Barrett's esophagus denotes a disorder in the digestive system that affects the esophagus' mucosal cells, causing reflux, and showing potential convergence to esophageal adenocarcinoma if not treated in initial stages. Thus, fast and reliable computer-aided diagnosis becomes considerably welcome. Nevertheless, such approaches usually suffer from imbalanced datasets, which can be addressed through Generative Adversarial Networks (GANs). Such techniques generate realistic images based on observed samples, even though at the cost of a proper selection of its hyperparameters. Many works employed a class of nature-inspired algorithms called metaheuristics to tackle the problem considering distinct deep learning approaches. Therefore, this paper's main contribution is to introduce metaheuristic techniques to fine-tune GANs in the context of Barrett's esophagus identification, as well as to investigate the feasibility of generating high-quality synthetic images for early-cancer assisted identification. KW - Endoskopie KW - Computerunterstützte Medizin KW - Deep Learning Y1 - 2021 SN - 978-3-658-33197-9 U6 - https://doi.org/10.1007/978-3-658-33198-6_50 SP - 205 EP - 210 PB - Springer Vieweg CY - Wiesbaden ER - TY - CHAP A1 - Szalo, Alexander Eduard A1 - Zehner, Alexander A1 - Palm, Christoph T1 - GraphMIC: Medizinische Bildverarbeitung in der Lehre T2 - Bildverarbeitung für die Medizin 2015; Algorithmen - Systeme - Anwendungen; Proceedings des Workshops vom 15. bis 17. März 2015 in Lübeck N2 - Die Lehre der medizinischen Bildverarbeitung vermittelt Kenntnisse mit einem breiten Methodenspektrum. Neben den Grundlagen der Verfahren soll ein Gefühl für eine geeignete Ausführungsreihenfolge und ihrer Wirkung auf medizinische Bilddaten entwickelt werden. Die Komplexität der Methoden erfordert vertiefte Programmierkenntnisse, sodass bereits einfache Operationen mit großem Programmieraufwand verbunden sind. Die Software GraphMIC stellt Bildverarbeitungsoperationen in Form interaktiver Knoten zur Verfügung und erlaubt das Arrangieren, Parametrisieren und Ausführen komplexer Verarbeitungssequenzen in einem Graphen. Durch den Fokus auf das Design einer Pipeline, weg von sprach- und frameworkspezifischen Implementierungsdetails, lassen sich grundlegende Prinzipien der Bildverarbeitung anschaulich erlernen. In diesem Beitrag stellen wir die visuelle Programmierung mit GraphMIC der nativen Implementierung äquivalenter Funktionen gegenüber. Die in C++ entwickelte Applikation basiert auf Qt, ITK, OpenCV, VTK und MITK. KW - Bildverarbeitung KW - Medizin KW - Hochschuldidaktik Y1 - 2015 U6 - https://doi.org/10.1007/978-3-662-46224-9_68 SP - 395 EP - 400 PB - Springer CY - Berlin ER - TY - CHAP A1 - Palm, Christoph ED - Byrne, Michael F. ED - Parsa, Nasim ED - Greenhill, Alexandra T. ED - Chahal, Daljeet ED - Ahmad, Omer ED - Bargci, Ulas T1 - History, Core Concepts, and Role of AI in Clinical Medicine T2 - AI in Clinical Medicine: A Practical Guide for Healthcare Professionals N2 - The field of AI is characterized by robust promises, astonishing successes, and remarkable breakthroughs. AI will play a major role in all domains of clinical medicine, but the role of AI in relation to the physician is not yet completely determined. The term artificial intelligence or AI is broad, and several different terms are used in this context that must be organized and demystified. This chapter will review the key concepts and methods of AI, and will introduce some of the different roles for AI in relation to the physician. KW - artificial intelligence KW - healthcare Y1 - 2023 SN - 978-1-119-79064-8 U6 - https://doi.org/10.1002/9781119790686.ch5 SP - 49 EP - 55 PB - Wiley ET - 1. Aufl. ER - TY - JOUR A1 - Rückert, Tobias A1 - Rückert, Daniel A1 - Palm, Christoph T1 - Methods and datasets for segmentation of minimally invasive surgical instruments in endoscopic images and videos: A review of the state of the art JF - Computers in Biology and Medicine N2 - In the field of computer- and robot-assisted minimally invasive surgery, enormous progress has been made in recent years based on the recognition of surgical instruments in endoscopic images and videos. In particular, the determination of the position and type of instruments is of great interest. Current work involves both spatial and temporal information, with the idea that predicting the movement of surgical tools over time may improve the quality of the final segmentations. The provision of publicly available datasets has recently encouraged the development of new methods, mainly based on deep learning. In this review, we identify and characterize datasets used for method development and evaluation and quantify their frequency of use in the literature. We further present an overview of the current state of research regarding the segmentation and tracking of minimally invasive surgical instruments in endoscopic images and videos. The paper focuses on methods that work purely visually, without markers of any kind attached to the instruments, considering both single-frame semantic and instance segmentation approaches, as well as those that incorporate temporal information. The publications analyzed were identified through the platforms Google Scholar, Web of Science, and PubMed. The search terms used were “instrument segmentation”, “instrument tracking”, “surgical tool segmentation”, and “surgical tool tracking”, resulting in a total of 741 articles published between 01/2015 and 07/2023, of which 123 were included using systematic selection criteria. A discussion of the reviewed literature is provided, highlighting existing shortcomings and emphasizing the available potential for future developments. KW - Deep Learning KW - Minimal-invasive Chirurgie KW - Bildsegmentierung KW - Surgical instrument segmentation KW - Surgical instrument tracking KW - Spatio-temporal information KW - Endoscopic surgery KW - Robot-assisted surgery Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-69830 N1 - Corresponding author: Tobias Rückert N1 - Corrigendum unter: https://opus4.kobv.de/opus4-oth-regensburg/frontdoor/index/index/docId/7033 VL - 169 PB - Elsevier CY - Amsterdam ER - TY - INPR A1 - Allan, Max A1 - Kondo, Satoshi A1 - Bodenstedt, Sebastian A1 - Leger, Stefan A1 - Kadkhodamohammadi, Rahim A1 - Luengo, Imanol A1 - Fuentes, Felix A1 - Flouty, Evangello A1 - Mohammed, Ahmed A1 - Pedersen, Marius A1 - Kori, Avinash A1 - Alex, Varghese A1 - Krishnamurthi, Ganapathy A1 - Rauber, David A1 - Mendel, Robert A1 - Palm, Christoph A1 - Bano, Sophia A1 - Saibro, Guinther A1 - Shih, Chi-Sheng A1 - Chiang, Hsun-An A1 - Zhuang, Juntang A1 - Yang, Junlin A1 - Iglovikov, Vladimir A1 - Dobrenkii, Anton A1 - Reddiboina, Madhu A1 - Reddy, Anubhav A1 - Liu, Xingtong A1 - Gao, Cong A1 - Unberath, Mathias A1 - Kim, Myeonghyeon A1 - Kim, Chanho A1 - Kim, Chaewon A1 - Kim, Hyejin A1 - Lee, Gyeongmin A1 - Ullah, Ihsan A1 - Luna, Miguel A1 - Park, Sang Hyun A1 - Azizian, Mahdi A1 - Stoyanov, Danail A1 - Maier-Hein, Lena A1 - Speidel, Stefanie T1 - 2018 Robotic Scene Segmentation Challenge N2 - In 2015 we began a sub-challenge at the EndoVis workshop at MICCAI in Munich using endoscope images of exvivo tissue with automatically generated annotations from robot forward kinematics and instrument CAD models. However, the limited background variation and simple motion rendered the dataset uninformative in learning about which techniques would be suitable for segmentation in real surgery. In 2017, at the same workshop in Quebec we introduced the robotic instrument segmentation dataset with 10 teams participating in the challenge to perform binary, articulating parts and type segmentation of da Vinci instruments. This challenge included realistic instrument motion and more complex porcine tissue as background and was widely addressed with modfications on U-Nets and other popular CNN architectures [1]. In 2018 we added to the complexity by introducing a set of anatomical objects and medical devices to the segmented classes. To avoid over-complicating the challenge, we continued with porcine data which is dramatically simpler than human tissue due to the lack of fatty tissue occluding many organs. KW - Minimally invasive surgery KW - Robotic KW - Minimal-invasive Chirurgie KW - Robotik Y1 - 2020 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-50049 UR - https://arxiv.org/abs/2001.11190 ER - TY - GEN A1 - Scheppach, Markus W. A1 - Rauber, David A1 - Mendel, Robert A1 - Palm, Christoph A1 - Byrne, Michael F. A1 - Messmann, Helmut A1 - Ebigbo, Alanna T1 - Detection Of Celiac Disease Using A Deep Learning Algorithm T2 - Endoscopy N2 - Aims Celiac disease (CD) is a complex condition caused by an autoimmune reaction to ingested gluten. Due to its polymorphic manifestation and subtle endoscopic presentation, the diagnosis is difficult and thus the disorder is underreported. We aimed to use deep learning to identify celiac disease on endoscopic images of the small bowel. Methods Patients with small intestinal histology compatible with CD (MARSH classification I-III) were extracted retrospectively from the database of Augsburg University hospital. They were compared to patients with no clinical signs of CD and histologically normal small intestinal mucosa. In a first step MARSH III and normal small intestinal mucosa were differentiated with the help of a deep learning algorithm. For this, the endoscopic white light images were divided into five equal-sized subsets. We avoided splitting the images of one patient into several subsets. A ResNet-50 model was trained with the images from four subsets and then validated with the remaining subset. This process was repeated for each subset, such that each subset was validated once. Sensitivity, specificity, and harmonic mean (F1) of the algorithm were determined. Results The algorithm showed values of 0.83, 0.88, and 0.84 for sensitivity, specificity, and F1, respectively. Further data showing a comparison between the detection rate of the AI model and that of experienced endoscopists will be available at the time of the upcoming conference. Conclusions We present the first clinical report on the use of a deep learning algorithm for the detection of celiac disease using endoscopic images. Further evaluation on an external data set, as well as in the detection of CD in real-time, will follow. However, this work at least suggests that AI can assist endoscopists in the endoscopic diagnosis of CD, and ultimately may be able to do a true optical biopsy in live-time. KW - Celiac Disease KW - Deep Learning Y1 - 2021 U6 - https://doi.org/10.1055/s-0041-1724970 N1 - Digital poster exhibition VL - 53 IS - S 01 PB - Georg Thieme Verlag CY - Stuttgart ER - TY - JOUR A1 - Ruewe, Marc A1 - Eigenberger, Andreas A1 - Klein, Silvan A1 - von Riedheim, Antonia A1 - Gugg, Christine A1 - Prantl, Lukas A1 - Palm, Christoph A1 - Weiherer, Maximilian A1 - Zeman, Florian A1 - Anker, Alexandra T1 - Precise Monitoring of Returning Sensation in Digital Nerve Lesions by 3-D Imaging: A Proof-of-Concept Study JF - Plastic and Reconstructive Surgery N2 - Digital nerve lesions result in a loss of tactile sensation reflected by an anesthetic area (AA) at the radial or ulnar aspect of the respective digit. Yet, available tools to monitor the recovery of tactile sense have been criticized for their lack of validity. However, the precise quantification of AA dynamics by three-dimensional (3-D) imaging could serve as an accurate surrogate to monitor recovery following digital nerve repair. For validation, AAs were marked on digits of healthy volunteers to simulate the AA of an impaired cutaneous innervation. Three dimensional models were composed from raw images that had been acquired with a 3-D camera (Vectra H2) to precisely quantify relative AA for each digit (3-D models, n= 80). Operator properties varied regarding individual experience in 3-D imaging and image processing. Additionally, the concept was applied in a clinical case study. Images taken by experienced photographers were rated better quality (p< 0.001) and needed less processing time (p= 0.020). Quantification of the relative AA was neither altered significantly by experience levels of the photographer (p= 0.425) nor the image assembler (p= 0.749). The proposed concept allows precise and reliable surface quantification of digits and can be performed consistently without relevant distortion by lack of examiner experience. Routine 3-D imaging of the AA has the great potential to provide visual evidence of various returning states of sensation and to convert sensory nerve recovery into a metric variable with high responsiveness to temporal progress. KW - 3D imaging Y1 - 2023 U6 - https://doi.org/10.1097/PRS.0000000000010456 SN - 1529-4242 VL - 152 IS - 4 SP - 670e EP - 674e PB - Lippincott Williams & Wilkins CY - Philadelphia, Pa. ER -