TY - CHAP A1 - Ammeling, Jonas A1 - Hecker, Moritz A1 - Ganz, Jonathan A1 - Donovan, Taryn A1 - Klopfleisch, Robert A1 - Bertram, Christof A1 - Breininger, Katharina A1 - Aubreville, Marc ED - Maier, Andreas ED - Deserno, Thomas Martin ED - Handels, Heinz ED - Maier-Hein, Klaus H. ED - Palm, Christoph ED - Tolxdorff, Thomas T1 - Automated Mitotic Index Calculation via Deep Learning and Immunohistochemistry T2 - Bildverarbeitung für die Medizin 2024: Proceedings, German Conference on Medical Image Computing, Erlangen, March 10–12, 2024 UR - https://doi.org/10.1007/978-3-658-44037-4_37 Y1 - 2024 UR - https://doi.org/10.1007/978-3-658-44037-4_37 SN - 978-3-658-44037-4 SP - 123 EP - 128 PB - Springer Vieweg CY - Wiesbaden ER - TY - JOUR A1 - Wilm, Frauke A1 - Ihling, Christian A1 - Méhes, Gábor A1 - Terracciano, Luigi A1 - Puget, Chloé A1 - Klopfleisch, Robert A1 - Schüffler, Peter A1 - Aubreville, Marc A1 - Maier, Andreas A1 - Mrowiec, Thomas A1 - Breininger, Katharina T1 - Pan-tumor T-lymphocyte detection using deep neural networks: Recommendations for transfer learning in immunohistochemistry JF - Journal of Pathology Informatics N2 - The success of immuno-oncology treatments promises long-term cancer remission for an increasing number of patients. The response to checkpoint inhibitor drugs has shown a correlation with the presence of immune cells in the tumor and tumor microenvironment. An in-depth understanding of the spatial localization of immune cells is therefore critical for understanding the tumor’s immune landscape and predicting drug response. Computer-aided systems are well suited for efficiently quantifying immune cells in their spatial context. Conventional image analysis approaches are often based on color features and therefore require a high level of manual interaction. More robust image analysis methods based on deep learning are expected to decrease this reliance on human interaction and improve the reproducibility of immune cell scoring. However, these methods require sufficient training data and previous work has reported low robustness of these algorithms when they are tested on out-of-distribution data from different pathology labs or samples from different organs. In this work, we used a new image analysis pipeline to explicitly evaluate the robustness of marker-labeled lymphocyte quantification algorithms depending on the number of training samples before and after being transferred to a new tumor indication. For these experiments, we adapted the RetinaNet architecture for the task of T-lymphocyte detection and employed transfer learning to bridge the domain gap between tumor indications and reduce the annotation costs for unseen domains. On our test set, we achieved human-level performance for almost all tumor indications with an average precision of 0.74 in-domain and 0.72–0.74 cross-domain. From our results, we derive recommendations for model development regarding annotation extent, training sample selection, and label extraction for the development of robust algorithms for immune cell scoring. By extending the task of marker-labeled lymphocyte quantification to a multi-class detection task, the pre-requisite for subsequent analyses, e.g., distinguishing lymphocytes in the tumor stroma from tumor-infiltrating lymphocytes, is met. UR - https://doi.org/10.1016/j.jpi.2023.100301 KW - Tumor-infiltrating lymphocytes KW - Immuno-oncology KW - Immunohistochemistry KW - Deep learning KW - Transfer learning KW - Domain adaptation Y1 - 2023 UR - https://doi.org/10.1016/j.jpi.2023.100301 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-40458 SN - 2153-3539 VL - 2023 IS - 14 PB - Elsevier CY - Amsterdam ER - TY - JOUR A1 - Fragoso-Garcia, Marco A1 - Wilm, Frauke A1 - Bertram, Christof A1 - Merz, Sophie A1 - Schmidt, Anja A1 - Donovan, Taryn A1 - Fuchs-Baumgartinger, Andrea A1 - Bartel, Alexander A1 - Marzahl, Christian A1 - Diehl, Laura A1 - Puget, Chloe A1 - Maier, Andreas A1 - Aubreville, Marc A1 - Breininger, Katharina A1 - Klopfleisch, Robert T1 - Automated diagnosis of 7 canine skin tumors using machine learning on H&E-stained whole slide images JF - Veterinary Pathology N2 - Microscopic evaluation of hematoxylin and eosin-stained slides is still the diagnostic gold standard for a variety of diseases, including neoplasms. Nevertheless, intra- and interrater variability are well documented among pathologists. So far, computer assistance via automated image analysis has shown potential to support pathologists in improving accuracy and reproducibility of quantitative tasks. In this proof of principle study, we describe a machine-learning-based algorithm for the automated diagnosis of 7 of the most common canine skin tumors: trichoblastoma, squamous cell carcinoma, peripheral nerve sheath tumor, melanoma, histiocytoma, mast cell tumor, and plasmacytoma. We selected, digitized, and annotated 350 hematoxylin and eosin-stained slides (50 per tumor type) to create a database divided into training, n = 245 whole-slide images (WSIs), validation ( n = 35 WSIs), and test sets ( n = 70 WSIs). Full annotations included the 7 tumor classes and 6 normal skin structures. The data set was used to train a convolutional neural network (CNN) for the automatic segmentation of tumor and nontumor classes. Subsequently, the detected tumor regions were classified patch-wise into 1 of the 7 tumor classes. A majority of patches-approach led to a tumor classification accuracy of the network on the slide-level of 95% (133/140 WSIs), with a patch-level precision of 85%. The same 140 WSIs were provided to 6 experienced pathologists for diagnosis, who achieved a similar slide-level accuracy of 98% (137/140 correct majority votes). Our results highlight the feasibility of artificial intelligence-based methods as a support tool in diagnostic oncologic pathology with future applications in other species and tumor types. UR - https://doi.org/10.1177/03009858231189205 KW - computer-aided diagnosis KW - computational pathology KW - digital pathology KW - dog KW - machine learning KW - skin KW - veterinary oncology Y1 - 2023 UR - https://doi.org/10.1177/03009858231189205 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-38321 SN - 0300-9858 VL - 60 IS - 6 SP - 865 EP - 875 PB - Sage CY - London ER - TY - CHAP A1 - Lausser, Ludwig A1 - Bertram, Christof A1 - Klopfleisch, Robert A1 - Aubreville, Marc ED - Deserno, Thomas Martin ED - Handels, Heinz ED - Maier, Andreas ED - Maier-Hein, Klaus H. ED - Palm, Christoph ED - Tolxdorff, Thomas T1 - Limits of Human Expert Ensembles in Mitosis Multi-expert Ground Truth Generation T2 - Bildverarbeitung für die Medizin 2023: Proceedings, German Workshop on Medical Image Computing, Braunschweig, July 2-4, 2023 UR - https://doi.org/10.1007/978-3-658-41657-7_27 Y1 - 2023 UR - https://doi.org/10.1007/978-3-658-41657-7_27 SN - 978-3-658-41657-7 SN - 978-3-658-41656-0 SP - 116 EP - 121 PB - Springer Vieweg CY - Wiesbaden ER -