TY - JOUR A1 - Pereira, Clayton R. A1 - Pereira, Danilo R. A1 - Silva, Francisco A. A1 - Masieiro, Joao P. A1 - Weber, Silke A. T. A1 - Hook, Christian A1 - Papa, João Paulo T1 - A new computer vision-based approach to aid the diagnosis of Parkinson's disease JF - Computer Methods and Programs in Biomedicine N2 - Background and Objective: Even today, pointing out an exam that can diagnose a patient with Parkinson's disease (PD) accurately enough is not an easy task. Although a number of techniques have been used in search for a more precise method, detecting such illness and measuring its level of severity early enough to postpone its side effects are not straightforward. In this work, after reviewing a considerable number of works, we conclude that only a few techniques address the problem of PD recognition by means of micrography using computer vision techniques. Therefore, we consider the problem of aiding automatic PD diagnosis by means of spirals and meanders filled out in forms, which are then compared with the template for feature extraction. Methods: In our work, both the template and the drawings are identified and separated automatically using image processing techniques, thus needing no user intervention. Since we have no registered images, the idea is to obtain a suitable representation of both template and drawings using the very same approach for all images in a fast and accurate approach. Results: The results have shown that we can obtain very reasonable recognition rates (around approximate to 67%), with the most accurate class being the one represented by the patients, which outnumbered the control individuals in the proposed dataset. Conclusions: The proposed approach seemed to be suitable for aiding in automatic PD diagnosis by means of computer vision and machine learning techniques. Also, meander images play an important role, leading to higher accuracies than spiral images. We also observed that the main problem in detecting PD is the patients in the early stages, who can draw near-perfect objects, which are very similar to the ones made by control patients. (C) 2016 Elsevier Ireland Ltd. All rights reserved. KW - CLASSIFICATION KW - Micrography KW - Parkinson's disease KW - Pattern recognition KW - SPEECH Y1 - 2016 U6 - https://doi.org/10.1016/j.cmpb.2016.08.005 VL - 136 SP - 79 EP - 88 PB - Elsevier ER - TY - CHAP A1 - Pereira, Clayton R. A1 - Passos, Leandro A. A1 - Lopes, Ricardo R. A1 - Weber, Silke A. T. A1 - Hook, Christian A1 - Papa, Joao Paulo T1 - Parkinson’s Disease Identification Using Restricted Boltzmann Machines T2 - Computer Analysis of Images and Patterns, 17th International Conference, CAIP 2017, Ystad, Sweden, August 22-24, 2017, Proceedings, Part II N2 - Currently, Parkinson’s Disease (PD) has no cure or accurate diagnosis, reaching approximately 60, 000 new cases yearly and worldwide, being more often in the elderly population. Its main symptoms can not be easily uncorrelated with other illness, being way more difficult to be identified at the early stages. As such, computer-aided tools have been recently used to assist in this task, but the challenge in the automatic identification of Parkinson’s Disease still persists. In order to cope with this problem, we propose to employ Restricted Boltzmann Machines (RBMs) to learn features in an unsupervised fashion by analyzing images from handwriting exams, which aim at assessing the writing skills of potential individuals. These are one of the main symptoms of PD-prone people, since such kind of ability ends up being severely affected. We show that RBMs can learn proper features that help supervised classifiers in the task of automatic identification of PD patients, as well as one can obtain a more compact representation of the exam for the sake of storage and computational load purposes. KW - Bevölkerung KW - Handschrift KW - maschinelles Lernen Y1 - 2017 SN - 978-3-319-64697-8 U6 - https://doi.org/10.1007/978-3-319-64698-5_7 VL - 10425 SP - 70 EP - 80 PB - Springer ER - TY - JOUR A1 - Afonso, Luis Claudio Sugi A1 - Pereira, Clayton R. A1 - Weber, Silke A. T. A1 - Hook, Christian A1 - Falcão, Alexandre X. A1 - Papa, Joao Paulo T1 - Hierarchical learning using deep optimum-path forest JF - Journal of Visual Communication and Image Representation N2 - Bag-of-Visual Words (BoVW) and deep learning techniques have been widely used in several domains, which include computer-assisted medical diagnoses. In this work, we are interested in developing tools for the automatic identification of Parkinson’s disease using machine learning and the concept of BoVW. The proposed approach concerns a hierarchical-based learning technique to design visual dictionaries through the Deep Optimum-Path Forest classifier. The proposed method was evaluated in six datasets derived from data collected from individuals when performing handwriting exams. Experimental results showed the potential of the technique, with robust achievements. KW - Handwriting dynamics KW - Hierarchical representation KW - Optimum-path forest KW - Parkinson’s disease Y1 - 2020 U6 - https://doi.org/10.1016/j.jvcir.2020.102823 VL - 71 IS - August PB - Elsevier ER - TY - JOUR A1 - Afonso, Luis Claudio Sugi A1 - Rosa, Gustavo H. A1 - Pereira, Clayton R. A1 - Weber, Silke A. T. A1 - Hook, Christian A1 - Albuquerque, Victor Hugo C. A1 - Papa, Joao Paulo T1 - A recurrence plot-based approach for Parkinson's disease identification JF - Future generation computer systems - The international journal of escience N2 - Parkinson's disease (PD) is a neurodegenerative disease that affects millions of people worldwide, causing mental and mainly motor dysfunctions. The negative impact on the patient's daily routine has moved the science in search of new techniques that can reduce its negative effects and also identify the disease in individuals. One of the main motor characteristics of PD is the hand tremor faced by patients, which turns out to be a crucial information to be used towards a computer-aided diagnosis. In this context, we make use of handwriting dynamics data acquired from individuals when submitted to some tasks that measure abilities related to writing skills. This work proposes the application of recurrence plots to map the signals onto the image domain, which are further used to feed a Convolutional Neural Network for learning proper information that can help the automatic identification of PD. The proposed approach was assessed in a public dataset under several scenarios that comprise different combinations of deep-based architectures, image resolutions, and training set sizes. Experimental results showed significant accuracy improvement compared to our previous work with an average accuracy of over 87%. Moreover, it was observed an improvement in accuracy concerning the classification of patients (i.e., mean recognition rates above to 90%). The promising results showed the potential of the proposed approach towards the automatic identification of Parkinson's disease. KW - Classification KW - Convolutional neural networks KW - diagnosis KW - Optimum-path forest KW - Parkinson's disease KW - Recurrence plot Y1 - 2019 U6 - https://doi.org/10.1016/j.future.2018.11.054 VL - 94 IS - May SP - 282 EP - 292 PB - Elsevier ER - TY - JOUR A1 - Pereira, Clayton R. A1 - Pereira, Danilo R. A1 - Rosa, Gustavo H. A1 - Albuquerque, Victor Hugo C. A1 - Weber, Silke A. T. A1 - Hook, Christian A1 - Papa, João Paulo T1 - Handwritten dynamics assessment through convolutional neural networks BT - An application to Parkinson’s disease identification JF - Artificial Intelligence in Medicine N2 - Background and objective Parkinson’s disease (PD) is considered a degenerative disorder that affects the motor system, which may cause tremors, micrography, and the freezing of gait. Although PD is related to the lack of dopamine, the triggering process of its development is not fully understood yet. Methods In this work, we introduce convolutional neural networks to learn features from images produced by handwritten dynamics, which capture different information during the individual’s assessment. Additionally, we make available a dataset composed of images and signal-based data to foster the research related to computer-aided PD diagnosis. Results The proposed approach was compared against raw data and texture-based descriptors, showing suitable results, mainly in the context of early stage detection, with results nearly to 95%. Conclusions The analysis of handwritten dynamics using deep learning techniques showed to be useful for automatic Parkinson’s disease identification, as well as it can outperform handcrafted features. KW - Convolutional neural networks KW - Handwritten dynamics KW - Parkinson’s disease Y1 - 2018 U6 - https://doi.org/10.1016/j.artmed.2018.04.001 VL - 37 IS - May SP - 67 EP - 77 PB - Elsevier ER - TY - CHAP A1 - Pereira, Clayton R. A1 - Pereira, Danilo R. A1 - da Silva, Francisco A. A1 - Hook, Christian A1 - Weber, Silke A. T. A1 - Pereira, Luis A. M. A1 - Papa, João Paulo T1 - A Step Towards the Automated Diagnosis of Parkinson's Disease: Analyzing Handwriting Movements T2 - 2015 IEEE 28th International Symposium on Computer-Based Medical Systems, 22.-25.06.2015, Sao Carlos, Brazil N2 - Parkinson’s disease (PD) has affected millions of people world-wide, being its major problem the loss of movements and, consequently, the ability of working and locomotion. Although we can find several works that attempt at dealing with this problem out there, most of them make use of datasets composed by a few subjects only. In this work, we present some results toward the automated diagnosis of PD by means of computer vision-based techniques in a dataset composed by dozens of patients, which is one of the main contributions of this work. The dataset is part of a joint research project that aims at extracting both visual and signal-based information from healthy and PD patients in order to go forward the early diagnosis of PD patients. The dataset is composed by handwriting clinical exams that are analyzed by means of image processing and machine learning techniques, being the preliminary results encouraging and promising. Additionally, a new quantitative feature to measure the amount of tremor of an individual’s handwritten trace called Mean Relative Tremor is also presented. Y1 - 2015 SN - 978-1-4673-6775-2 U6 - https://doi.org/10.1109/cbms.2015.34 SN - 2372-9198 SP - 171 EP - 176 PB - IEEE ER - TY - JOUR A1 - Mendel, Robert A1 - Rauber, David A1 - de Souza Jr., Luis Antonio A1 - Papa, João Paulo A1 - Palm, Christoph T1 - Error-Correcting Mean-Teacher: Corrections instead of consistency-targets applied to semi-supervised medical image segmentation JF - Computers in Biology and Medicine N2 - Semantic segmentation is an essential task in medical imaging research. Many powerful deep-learning-based approaches can be employed for this problem, but they are dependent on the availability of an expansive labeled dataset. In this work, we augment such supervised segmentation models to be suitable for learning from unlabeled data. Our semi-supervised approach, termed Error-Correcting Mean-Teacher, uses an exponential moving average model like the original Mean Teacher but introduces our new paradigm of error correction. The original segmentation network is augmented to handle this secondary correction task. Both tasks build upon the core feature extraction layers of the model. For the correction task, features detected in the input image are fused with features detected in the predicted segmentation and further processed with task-specific decoder layers. The combination of image and segmentation features allows the model to correct present mistakes in the given input pair. The correction task is trained jointly on the labeled data. On unlabeled data, the exponential moving average of the original network corrects the student’s prediction. The combined outputs of the students’ prediction with the teachers’ correction form the basis for the semi-supervised update. We evaluate our method with the 2017 and 2018 Robotic Scene Segmentation data, the ISIC 2017 and the BraTS 2020 Challenges, a proprietary Endoscopic Submucosal Dissection dataset, Cityscapes, and Pascal VOC 2012. Additionally, we analyze the impact of the individual components and examine the behavior when the amount of labeled data varies, with experiments performed on two distinct segmentation architectures. Our method shows improvements in terms of the mean Intersection over Union over the supervised baseline and competing methods. Code is available at https://github.com/CloneRob/ECMT. KW - Semi-supervised Segmentation KW - Mean-Teacher KW - Pseudo-labels KW - Medical Imaging Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-57790 SN - 0010-4825 VL - 154 IS - March PB - Elsevier ER - TY - JOUR A1 - Ebigbo, Alanna A1 - Mendel, Robert A1 - Scheppach, Markus W. A1 - Probst, Andreas A1 - Shahidi, Neal A1 - Prinz, Friederike A1 - Fleischmann, Carola A1 - Römmele, Christoph A1 - Gölder, Stefan Karl A1 - Braun, Georg A1 - Rauber, David A1 - Rückert, Tobias A1 - De Souza Jr., Luis Antonio A1 - Papa, João Paulo A1 - Byrne, Michael F. A1 - Palm, Christoph A1 - Messmann, Helmut T1 - Vessel and tissue recognition during third-space endoscopy using a deep learning algorithm JF - Gut N2 - In this study, we aimed to develop an artificial intelligence clinical decision support solution to mitigate operator-dependent limitations during complex endoscopic procedures such as endoscopic submucosal dissection and peroral endoscopic myotomy, for example, bleeding and perforation. A DeepLabv3-based model was trained to delineate vessels, tissue structures and instruments on endoscopic still images from such procedures. The mean cross-validated Intersection over Union and Dice Score were 63% and 76%, respectively. Applied to standardised video clips from third-space endoscopic procedures, the algorithm showed a mean vessel detection rate of 85% with a false-positive rate of 0.75/min. These performance statistics suggest a potential clinical benefit for procedure safety, time and also training. KW - Artificial Intelligence KW - Endoscopy KW - Medical Image Computing Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-54293 VL - 71 IS - 12 SP - 2388 EP - 2390 PB - BMJ CY - London ER - TY - JOUR A1 - De Souza Jr., Luis Antonio A1 - Mendel, Robert A1 - Strasser, Sophia A1 - Ebigbo, Alanna A1 - Probst, Andreas A1 - Messmann, Helmut A1 - Papa, João Paulo A1 - Palm, Christoph T1 - Convolutional Neural Networks for the evaluation of cancer in Barrett’s esophagus: Explainable AI to lighten up the black-box JF - Computers in Biology and Medicine N2 - Even though artificial intelligence and machine learning have demonstrated remarkable performances in medical image computing, their level of accountability and transparency must be provided in such evaluations. The reliability related to machine learning predictions must be explained and interpreted, especially if diagnosis support is addressed. For this task, the black-box nature of deep learning techniques must be lightened up to transfer its promising results into clinical practice. Hence, we aim to investigate the use of explainable artificial intelligence techniques to quantitatively highlight discriminative regions during the classification of earlycancerous tissues in Barrett’s esophagus-diagnosed patients. Four Convolutional Neural Network models (AlexNet, SqueezeNet, ResNet50, and VGG16) were analyzed using five different interpretation techniques (saliency, guided backpropagation, integrated gradients, input × gradients, and DeepLIFT) to compare their agreement with experts’ previous annotations of cancerous tissue. We could show that saliency attributes match best with the manual experts’ delineations. Moreover, there is moderate to high correlation between the sensitivity of a model and the human-and-computer agreement. The results also lightened that the higher the model’s sensitivity, the stronger the correlation of human and computational segmentation agreement. We observed a relevant relation between computational learning and experts’ insights, demonstrating how human knowledge may influence the correct computational learning. KW - Deep Learning KW - Künstliche Intelligenz KW - Computerunterstützte Medizin KW - Barrett's esophagus KW - Adenocarcinoma KW - Machine learning KW - Explainable artificial intelligence KW - Computer-aided diagnosis Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-20126 SN - 0010-4825 VL - 135 SP - 1 EP - 14 PB - Elsevier ER - TY - CHAP A1 - Mendel, Robert A1 - De Souza Jr., Luis Antonio A1 - Rauber, David A1 - Papa, João Paulo A1 - Palm, Christoph T1 - Semi-supervised Segmentation Based on Error-Correcting Supervision T2 - Computer vision - ECCV 2020: 16th European conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part XXIX N2 - Pixel-level classification is an essential part of computer vision. For learning from labeled data, many powerful deep learning models have been developed recently. In this work, we augment such supervised segmentation models by allowing them to learn from unlabeled data. Our semi-supervised approach, termed Error-Correcting Supervision, leverages a collaborative strategy. Apart from the supervised training on the labeled data, the segmentation network is judged by an additional network. The secondary correction network learns on the labeled data to optimally spot correct predictions, as well as to amend incorrect ones. As auxiliary regularization term, the corrector directly influences the supervised training of the segmentation network. On unlabeled data, the output of the correction network is essential to create a proxy for the unknown truth. The corrector’s output is combined with the segmentation network’s prediction to form the new target. We propose a loss function that incorporates both the pseudo-labels as well as the predictive certainty of the correction network. Our approach can easily be added to supervised segmentation models. We show consistent improvements over a supervised baseline on experiments on both the Pascal VOC 2012 and the Cityscapes datasets with varying amounts of labeled data. KW - Semi-Supervised Learning KW - Machine Learning Y1 - 2020 SN - 978-3-030-58525-9 U6 - https://doi.org/10.1007/978-3-030-58526-6_9 SP - 141 EP - 157 PB - Springer CY - Cham ER - TY - JOUR A1 - De Souza Jr., Luis Antonio A1 - Palm, Christoph A1 - Mendel, Robert A1 - Hook, Christian A1 - Ebigbo, Alanna A1 - Probst, Andreas A1 - Messmann, Helmut A1 - Weber, Silke A. T. A1 - Papa, João Paulo T1 - A survey on Barrett's esophagus analysis using machine learning JF - Computers in Biology and Medicine N2 - This work presents a systematic review concerning recent studies and technologies of machine learning for Barrett's esophagus (BE) diagnosis and treatment. The use of artificial intelligence is a brand new and promising way to evaluate such disease. We compile some works published at some well-established databases, such as Science Direct, IEEEXplore, PubMed, Plos One, Multidisciplinary Digital Publishing Institute (MDPI), Association for Computing Machinery (ACM), Springer, and Hindawi Publishing Corporation. Each selected work has been analyzed to present its objective, methodology, and results. The BE progression to dysplasia or adenocarcinoma shows a complex pattern to be detected during endoscopic surveillance. Therefore, it is valuable to assist its diagnosis and automatic identification using computer analysis. The evaluation of the BE dysplasia can be performed through manual or automated segmentation through machine learning techniques. Finally, in this survey, we reviewed recent studies focused on the automatic detection of the neoplastic region for classification purposes using machine learning methods. KW - Speiseröhrenkrankheit KW - Diagnose KW - Mustererkennung KW - Maschinelles Lernen KW - Literaturbericht KW - Barrett's esophagus KW - Machine learning KW - Adenocarcinoma KW - Image processing KW - Pattern recognition KW - Computer-aided diagnosis Y1 - 2018 U6 - https://doi.org/10.1016/j.compbiomed.2018.03.014 VL - 96 SP - 203 EP - 213 PB - Elsevier ER - TY - CHAP A1 - De Souza Jr., Luis Antonio A1 - Passos, Leandro A. A1 - Mendel, Robert A1 - Ebigbo, Alanna A1 - Probst, Andreas A1 - Messmann, Helmut A1 - Palm, Christoph A1 - Papa, João Paulo T1 - Fine-tuning Generative Adversarial Networks using Metaheuristics BT - A Case Study on Barrett's Esophagus Identification T2 - Bildverarbeitung für die Medizin 2021. Proceedings, German Workshop on Medical Image Computing, Regensburg, March 7-9, 2021 N2 - Barrett's esophagus denotes a disorder in the digestive system that affects the esophagus' mucosal cells, causing reflux, and showing potential convergence to esophageal adenocarcinoma if not treated in initial stages. Thus, fast and reliable computer-aided diagnosis becomes considerably welcome. Nevertheless, such approaches usually suffer from imbalanced datasets, which can be addressed through Generative Adversarial Networks (GANs). Such techniques generate realistic images based on observed samples, even though at the cost of a proper selection of its hyperparameters. Many works employed a class of nature-inspired algorithms called metaheuristics to tackle the problem considering distinct deep learning approaches. Therefore, this paper's main contribution is to introduce metaheuristic techniques to fine-tune GANs in the context of Barrett's esophagus identification, as well as to investigate the feasibility of generating high-quality synthetic images for early-cancer assisted identification. KW - Endoskopie KW - Computerunterstützte Medizin KW - Deep Learning Y1 - 2021 SN - 978-3-658-33197-9 U6 - https://doi.org/10.1007/978-3-658-33198-6_50 SP - 205 EP - 210 PB - Springer Vieweg CY - Wiesbaden ER - TY - JOUR A1 - Ebigbo, Alanna A1 - Palm, Christoph A1 - Probst, Andreas A1 - Mendel, Robert A1 - Manzeneder, Johannes A1 - Prinz, Friederike A1 - De Souza Jr., Luis Antonio A1 - Papa, João Paulo A1 - Siersema, Peter A1 - Messmann, Helmut T1 - A technical review of artificial intelligence as applied to gastrointestinal endoscopy: clarifying the terminology JF - Endoscopy International Open N2 - The growing number of publications on the application of artificial intelligence (AI) in medicine underlines the enormous importance and potential of this emerging field of research. In gastrointestinal endoscopy, AI has been applied to all segments of the gastrointestinal tract most importantly in the detection and characterization of colorectal polyps. However, AI research has been published also in the stomach and esophagus for both neoplastic and non-neoplastic disorders. The various technical as well as medical aspects of AI, however, remain confusing especially for non-expert physicians. This physician-engineer co-authored review explains the basic technical aspects of AI and provides a comprehensive overview of recent publications on AI in gastrointestinal endoscopy. Finally, a basic insight is offered into understanding publications on AI in gastrointestinal endoscopy. KW - Diagnose KW - Maschinelles Lernen KW - Gastroenterologie KW - Künstliche Intelligenz KW - Barrett's esophagus KW - Deep learning Y1 - 2019 U6 - https://doi.org/10.1055/a-1010-5705 VL - 07 IS - 12 SP - 1616 EP - 1623 PB - Georg Thieme Verlag CY - Stuttgart ER - TY - GEN A1 - Mendel, Robert A1 - De Souza Jr., Luis Antonio A1 - Rauber, David A1 - Papa, João Paulo A1 - Palm, Christoph T1 - Abstract: Semi-supervised Segmentation Based on Error-correcting Supervision T2 - Bildverarbeitung für die Medizin 2021. Proceedings, German Workshop on Medical Image Computing, Regensburg, March 7-9, 2021 N2 - Pixel-level classification is an essential part of computer vision. For learning from labeled data, many powerful deep learning models have been developed recently. In this work, we augment such supervised segmentation models by allowing them to learn from unlabeled data. Our semi-supervised approach, termed Error-Correcting Supervision, leverages a collaborative strategy. Apart from the supervised training on the labeled data, the segmentation network is judged by an additional network. KW - Deep Learning Y1 - 2021 SN - 978-3-658-33197-9 U6 - https://doi.org/10.1007/978-3-658-33198-6_43 SP - 178 PB - Springer Vieweg CY - Wiesbaden ER - TY - GEN A1 - Ebigbo, Alanna A1 - Mendel, Robert A1 - Probst, Andreas A1 - Manzeneder, Johannes A1 - De Souza Jr., Luis Antonio A1 - Papa, João Paulo A1 - Palm, Christoph A1 - Messmann, Helmut T1 - Artificial Intelligence in Early Barrett's Cancer: The Segmentation Task T2 - Endoscopy N2 - Aims: The delineation of outer margins of early Barrett's cancer can be challenging even for experienced endoscopists. Artificial intelligence (AI) could assist endoscopists faced with this task. As of date, there is very limited experience in this domain. In this study, we demonstrate the measure of overlap (Dice coefficient = D) between highly experienced Barrett endoscopists and an AI system in the delineation of cancer margins (segmentation task). Methods: An AI system with a deep convolutional neural network (CNN) was trained and tested on high-definition endoscopic images of early Barrett's cancer (n = 33) and normal Barrett's mucosa (n = 41). The reference standard for the segmentation task were the manual delineations of tumor margins by three highly experienced Barrett endoscopists. Training of the AI system included patch generation, patch augmentation and adjustment of the CNN weights. Then, the segmentation results from patch classification and thresholding of the class probabilities. Segmentation results were evaluated using the Dice coefficient (D). Results: The Dice coefficient (D) which can range between 0 (no overlap) and 1 (complete overlap) was computed only for images correctly classified by the AI-system as cancerous. At a threshold of t = 0.5, a mean value of D = 0.72 was computed. Conclusions: AI with CNN performed reasonably well in the segmentation of the tumor region in Barrett's cancer, at least when compared with expert Barrett's endoscopists. AI holds a lot of promise as a tool for better visualization of tumor margins but may need further improvement and enhancement especially in real-time settings. KW - Speiseröhrenkrankheit KW - Maschinelles Lernen KW - Barrett's esphagus KW - Deep Learning KW - Segmentation Y1 - 2019 U6 - https://doi.org/10.1055/s-0039-1681187 VL - 51 IS - 04 SP - 6 PB - Georg Thieme Verlag CY - Stuttgart ER - TY - CHAP A1 - De Souza Jr., Luis Antonio A1 - Ebigbo, Alanna A1 - Probst, Andreas A1 - Messmann, Helmut A1 - Papa, João Paulo A1 - Mendel, Robert A1 - Palm, Christoph T1 - Barrett's Esophagus Identification Using Color Co-occurrence Matrices T2 - 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Parana, 2018 N2 - In this work, we propose the use of single channel Color Co-occurrence Matrices for texture description of Barrett’sEsophagus (BE)and adenocarcinoma images. Further classification using supervised learning techniques, such as Optimum-Path Forest (OPF), Support Vector Machines with Radial Basisunction (SVM-RBF) and Bayesian classifier supports the contextof automatic BE and adenocarcinoma diagnosis. We validated three approaches of classification based on patches, patients and images in two datasets (MICCAI 2015 and Augsburg) using the color-and-texture descriptors and the machine learning techniques. Concerning MICCAI 2015 dataset, the best results were obtained using the blue channel for the descriptors and the supervised OPF for classification purposes in the patch-based approach, with sensitivity nearly to 73% for positive adenocarcinoma identification and specificity close to 77% for BE (non-cancerous) patch classification. Regarding the Augsburg dataset, the most accurate results were also obtained using both OPF classifier and blue channel descriptor for the feature extraction, with sensitivity close to 67% and specificity around to76%. Our work highlights new advances in the related research area and provides a promising technique that combines color and texture information, allied to three different approaches of dataset pre-processing aiming to configure robust scenarios for the classification step. KW - Barrett’s Esophagus KW - Co-occurrence Matrices KW - Machine learning KW - Texture Analysis Y1 - 2018 U6 - https://doi.org/10.1109/SIBGRAPI.2018.00028 SP - 166 EP - 173 ER - TY - CHAP A1 - De Souza Jr., Luis Antonio A1 - Afonso, Luis Claudio Sugi A1 - Palm, Christoph A1 - Papa, João Paulo T1 - Barrett's Esophagus Identification Using Optimum-Path Forest T2 - Proceedings of the 30th Conference on Graphics, Patterns and Images Tutorials (SIBGRAPI-T 2017), Niterói, Rio de Janeiro, Brazil, 2017, 17-20 October N2 - Computer-assisted analysis of endoscopic images can be helpful to the automatic diagnosis and classification of neoplastic lesions. Barrett's esophagus (BE) is a common type of reflux that is not straight forward to be detected by endoscopic surveillance, thus being way susceptible to erroneous diagnosis, which can cause cancer when not treated properly. In this work, we introduce the Optimum-Path Forest (OPF) classifier to the task of automatic identification of Barrett'sesophagus, with promising results and outperforming the well known Support Vector Machines (SVM) in the aforementioned context. We consider describing endoscopic images by means of feature extractors based on key point information, such as the Speeded up Robust Features (SURF) and Scale-Invariant Feature Transform (SIFT), for further designing a bag-of-visual-wordsthat is used to feed both OPF and SVM classifiers. The best results were obtained by means of the OPF classifier for both feature extractors, with values lying on 0.732 (SURF) - 0.735(SIFT) for sensitivity, 0.782 (SURF) - 0.806 (SIFT) for specificity, and 0.738 (SURF) - 0.732 (SIFT) for the accuracy. KW - Speiseröhrenkrankheit KW - Diagnose KW - Maschinelles Lernen KW - Bilderkennung KW - Automatische Klassifikation Y1 - 2017 U6 - https://doi.org/10.1109/SIBGRAPI.2017.47 SP - 308 EP - 314 ER - TY - JOUR A1 - De Souza Jr., Luis Antonio A1 - Passos, Leandro A. A1 - Mendel, Robert A1 - Ebigbo, Alanna A1 - Probst, Andreas A1 - Messmann, Helmut A1 - Palm, Christoph A1 - Papa, João Paulo T1 - Assisting Barrett's esophagus identification using endoscopic data augmentation based on Generative Adversarial Networks JF - Computers in Biology and Medicine N2 - Barrett's esophagus figured a swift rise in the number of cases in the past years. Although traditional diagnosis methods offered a vital role in early-stage treatment, they are generally time- and resource-consuming. In this context, computer-aided approaches for automatic diagnosis emerged in the literature since early detection is intrinsically related to remission probabilities. However, they still suffer from drawbacks because of the lack of available data for machine learning purposes, thus implying reduced recognition rates. This work introduces Generative Adversarial Networks to generate high-quality endoscopic images, thereby identifying Barrett's esophagus and adenocarcinoma more precisely. Further, Convolution Neural Networks are used for feature extraction and classification purposes. The proposed approach is validated over two datasets of endoscopic images, with the experiments conducted over the full and patch-split images. The application of Deep Convolutional Generative Adversarial Networks for the data augmentation step and LeNet-5 and AlexNet for the classification step allowed us to validate the proposed methodology over an extensive set of datasets (based on original and augmented sets), reaching results of 90% of accuracy for the patch-based approach and 85% for the image-based approach. Both results are based on augmented datasets and are statistically different from the ones obtained in the original datasets of the same kind. Moreover, the impact of data augmentation was evaluated in the context of image description and classification, and the results obtained using synthetic images outperformed the ones over the original datasets, as well as other recent approaches from the literature. Such results suggest promising insights related to the importance of proper data for the accurate classification concerning computer-assisted Barrett's esophagus and adenocarcinoma detection. KW - Maschinelles Lernen KW - Barrett's esophagus KW - Machine learning KW - Adenocarcinoma KW - Generative adversarial networks KW - Neuronales Netz KW - Adenocarcinom KW - Speiseröhrenkrebs KW - Diagnose Y1 - 2020 U6 - https://doi.org/10.1016/j.compbiomed.2020.104029 VL - 126 IS - November PB - Elsevier ER - TY - CHAP A1 - De Souza Jr., Luis Antonio A1 - Hook, Christian A1 - Papa, João Paulo A1 - Palm, Christoph T1 - Barrett's Esophagus Analysis Using SURF Features T2 - Bildverarbeitung für die Medizin 2017; Algorithmen - Systeme - Anwendungen. Proceedings des Workshops vom 12. bis 14. März 2017 in Heidelberg N2 - The development of adenocarcinoma in Barrett’s esophagus is difficult to detect by endoscopic surveillance of patients with signs of dysplasia. Computer assisted diagnosis of endoscopic images (CAD) could therefore be most helpful in the demarcation and classification of neoplastic lesions. In this study we tested the feasibility of a CAD method based on Speeded up Robust Feature Detection (SURF). A given database containing 100 images from 39 patients served as benchmark for feature based classification models. Half of the images had previously been diagnosed by five clinical experts as being ”cancerous”, the other half as ”non-cancerous”. Cancerous image regions had been visibly delineated (masked) by the clinicians. SURF features acquired from full images as well as from masked areas were utilized for the supervised training and testing of an SVM classifier. The predictive accuracy of the developed CAD system is illustrated by sensitivity and specificity values. The results based on full image matching where 0.78 (sensitivity) and 0.82 (specificity) were achieved, while the masked region approach generated results of 0.90 and 0.95, respectively. KW - Speiseröhrenkrankheit KW - Diagnose KW - Maschinelles Sehen KW - Automatische Klassifikation Y1 - 2017 U6 - https://doi.org/10.1007/978-3-662-54345-0_34 SP - 141 EP - 146 PB - Springer CY - Berlin ER - TY - JOUR A1 - Passos, Leandro A. A1 - De Souza Jr., Luis Antonio A1 - Mendel, Robert A1 - Ebigbo, Alanna A1 - Probst, Andreas A1 - Messmann, Helmut A1 - Palm, Christoph A1 - Papa, João Paulo T1 - Barrett's esophagus analysis using infinity Restricted Boltzmann Machines JF - Journal of Visual Communication and Image Representation N2 - The number of patients with Barret’s esophagus (BE) has increased in the last decades. Considering the dangerousness of the disease and its evolution to adenocarcinoma, an early diagnosis of BE may provide a high probability of cancer remission. However, limitations regarding traditional methods of detection and management of BE demand alternative solutions. As such, computer-aided tools have been recently used to assist in this problem, but the challenge still persists. To manage the problem, we introduce the infinity Restricted Boltzmann Machines (iRBMs) to the task of automatic identification of Barrett’s esophagus from endoscopic images of the lower esophagus. Moreover, since iRBM requires a proper selection of its meta-parameters, we also present a discriminative iRBM fine-tuning using six meta-heuristic optimization techniques. We showed that iRBMs are suitable for the context since it provides competitive results, as well as the meta-heuristic techniques showed to be appropriate for such task. KW - Speiseröhrenkrankheit KW - Diagnose KW - Boltzmann-Maschine KW - Barrett’s esophagus KW - Infinity Restricted Boltzmann Machines KW - Meta-heuristics KW - Deep learning KW - Metaheuristik KW - Maschinelles Lernen Y1 - 2019 U6 - https://doi.org/10.1016/j.jvcir.2019.01.043 VL - 59 SP - 475 EP - 485 PB - Elsevier ER - TY - JOUR A1 - Ebigbo, Alanna A1 - Mendel, Robert A1 - Probst, Andreas A1 - Manzeneder, Johannes A1 - Prinz, Friederike A1 - De Souza Jr., Luis Antonio A1 - Papa, João Paulo A1 - Palm, Christoph A1 - Messmann, Helmut T1 - Real-time use of artificial intelligence in the evaluation of cancer in Barrett’s oesophagus JF - Gut N2 - Based on previous work by our group with manual annotation of visible Barrett oesophagus (BE) cancer images, a real-time deep learning artificial intelligence (AI) system was developed. While an expert endoscopist conducts the endoscopic assessment of BE, our AI system captures random images from the real-time camera livestream and provides a global prediction (classification), as well as a dense prediction (segmentation) differentiating accurately between normal BE and early oesophageal adenocarcinoma (EAC). The AI system showed an accuracy of 89.9% on 14 cases with neoplastic BE. KW - Speiseröhrenkrankheit KW - Diagnose KW - Maschinelles Lernen KW - Barrett's esophagus KW - Deep learning KW - real-time Y1 - 2020 U6 - https://doi.org/10.1136/gutjnl-2019-319460 VL - 69 IS - 4 SP - 615 EP - 616 PB - BMJ CY - London ER - TY - JOUR A1 - Ebigbo, Alanna A1 - Mendel, Robert A1 - Rückert, Tobias A1 - Schuster, Laurin A1 - Probst, Andreas A1 - Manzeneder, Johannes A1 - Prinz, Friederike A1 - Mende, Matthias A1 - Steinbrück, Ingo A1 - Faiss, Siegbert A1 - Rauber, David A1 - De Souza Jr., Luis Antonio A1 - Papa, João Paulo A1 - Deprez, Pierre A1 - Oyama, Tsuneo A1 - Takahashi, Akiko A1 - Seewald, Stefan A1 - Sharma, Prateek A1 - Byrne, Michael F. A1 - Palm, Christoph A1 - Messmann, Helmut T1 - Endoscopic prediction of submucosal invasion in Barrett’s cancer with the use of Artificial Intelligence: A pilot Study JF - Endoscopy N2 - Background and aims: The accurate differentiation between T1a and T1b Barrett’s cancer has both therapeutic and prognostic implications but is challenging even for experienced physicians. We trained an Artificial Intelligence (AI) system on the basis of deep artificial neural networks (deep learning) to differentiate between T1a and T1b Barrett’s cancer white-light images. Methods: Endoscopic images from three tertiary care centres in Germany were collected retrospectively. A deep learning system was trained and tested using the principles of cross-validation. A total of 230 white-light endoscopic images (108 T1a and 122 T1b) was evaluated with the AI-system. For comparison, the images were also classified by experts specialized in endoscopic diagnosis and treatment of Barrett’s cancer. Results: The sensitivity, specificity, F1 and accuracy of the AI-system in the differentiation between T1a and T1b cancer lesions was 0.77, 0.64, 0.73 and 0.71, respectively. There was no statistically significant difference between the performance of the AI-system and that of human experts with sensitivity, specificity, F1 and accuracy of 0.63, 0.78, 0.67 and 0.70 respectively. Conclusion: This pilot study demonstrates the first multicenter application of an AI-based system in the prediction of submucosal invasion in endoscopic images of Barrett’s cancer. AI scored equal to international experts in the field, but more work is necessary to improve the system and apply it to video sequences and in a real-life setting. Nevertheless, the correct prediction of submucosal invasion in Barret´s cancer remains challenging for both experts and AI. KW - Maschinelles Lernen KW - Neuronales Netz KW - Speiseröhrenkrebs KW - Diagnose KW - Artificial Intelligence KW - Machine learning KW - Adenocarcinoma KW - Barrett’s cancer KW - submucosal invasion Y1 - 2021 U6 - https://doi.org/10.1055/a-1311-8570 VL - 53 IS - 09 SP - 878 EP - 883 PB - Thieme CY - Stuttgart ER - TY - JOUR A1 - Ebigbo, Alanna A1 - Mendel, Robert A1 - Probst, Andreas A1 - Manzeneder, Johannes A1 - De Souza Jr., Luis Antonio A1 - Papa, João Paulo A1 - Palm, Christoph A1 - Messmann, Helmut T1 - Computer-aided diagnosis using deep learning in the evaluation of early oesophageal adenocarcinoma JF - GuT N2 - Computer-aided diagnosis using deep learning (CAD-DL) may be an instrument to improve endoscopic assessment of Barrett’s oesophagus (BE) and early oesophageal adenocarcinoma (EAC). Based on still images from two databases, the diagnosis of EAC by CAD-DL reached sensitivities/specificities of 97%/88% (Augsburg data) and 92%/100% (Medical Image Computing and Computer-Assisted Intervention [MICCAI] data) for white light (WL) images and 94%/80% for narrow band images (NBI) (Augsburg data), respectively. Tumour margins delineated by experts into images were detected satisfactorily with a Dice coefficient (D) of 0.72. This could be a first step towards CAD-DL for BE assessment. If developed further, it could become a useful adjunctive tool for patient management. KW - Speiseröhrenkrebs KW - Diagnose KW - Computerunterstütztes Verfahren KW - Maschinelles Lernen Y1 - 2019 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-68 N1 - Corresponding authors: Alanna Ebigbo and Christoph Palm VL - 68 IS - 7 SP - 1143 EP - 1145 PB - British Society of Gastroenterology ER - TY - JOUR A1 - Souza Jr., Luis Antonio A1 - Pacheco, André G.C. A1 - Passos, Leandro A. A1 - Santana, Marcos C. S. A1 - Mendel, Robert A1 - Ebigbo, Alanna A1 - Probst, Andreas A1 - Messmann, Helmut A1 - Palm, Christoph A1 - Papa, João Paulo T1 - DeepCraftFuse: visual and deeply-learnable features work better together for esophageal cancer detection in patients with Barrett’s esophagus JF - Neural Computing and Applications N2 - Limitations in computer-assisted diagnosis include lack of labeled data and inability to model the relation between what experts see and what computers learn. Even though artificial intelligence and machine learning have demonstrated remarkable performances in medical image computing, their accountability and transparency level must be improved to transfer this success into clinical practice. The reliability of machine learning decisions must be explained and interpreted, especially for supporting the medical diagnosis. While deep learning techniques are broad so that unseen information might help learn patterns of interest, human insights to describe objects of interest help in decision-making. This paper proposes a novel approach, DeepCraftFuse, to address the challenge of combining information provided by deep networks with visual-based features to significantly enhance the correct identification of cancerous tissues in patients affected with Barrett’s esophagus (BE). We demonstrate that DeepCraftFuse outperforms state-of-the-art techniques on private and public datasets, reaching results of around 95% when distinguishing patients affected by BE that is either positive or negative to esophageal cancer. KW - Deep Learning Y1 - 2024 U6 - https://doi.org/10.1007/s00521-024-09615-z PB - Springer CY - London ER -