TY - CHAP A1 - Aubreville, Marc A1 - Bertram, Christof A1 - Klopfleisch, Robert A1 - Maier, Andreas T1 - SlideRunner BT - a tool for massive cell annotations in whole slide images T2 - Bildverarbeitung für die Medizin 2018: Algorithmen - Systeme - Anwendungen N2 - Large-scale image data such as digital whole-slide histology images pose a challenging task at annotation software solutions. Today, a number of good solutions with varying scopes exist. For cell annotation, however, we find that many do not match the prerequisites for fast annotations. Especially in the field of mitosis detection, it is assumed that detection accuracy could significantly benefit from larger annotation databases that are currently however very troublesome to produce. Further, multiple independent (blind) expert labels are a big asset for such databases, yet there is currently no tool for this kind of annotation available. To ease this tedious process of expert annotation and grading, we introduce SlideRunner, an open source annotation and visualization tool for digital histopathology, developed in close cooperation with two pathologists. SlideRunner is capable of setting annotations like object centers (for e.g. cells) as well as object boundaries (e.g. for tumor outlines). It provides single-click annotations as well as a blind mode for multi-annotations, where the expert is directly shown the microscopy image containing the cells that he has not yet rated. UR - https://doi.org/10.1007/978-3-662-56537-7_81 Y1 - 2018 UR - https://doi.org/10.1007/978-3-662-56537-7_81 SN - 978-3-662-56537-7 SP - 309 EP - 314 PB - Springer Vieweg CY - Berlin ER - TY - CHAP A1 - Marzahl, Christian A1 - Bertram, Christof A1 - Aubreville, Marc A1 - Petrick, Anne A1 - Weiler, Kristina A1 - Gläsel, Agnes C. A1 - Fragoso-Garcia, Marco A1 - Merz, Sophie A1 - Bartenschlager, Florian A1 - Hoppe, Judith A1 - Langenhagen, Alina A1 - Jasensky, Anne-Katherine A1 - Voigt, Jörn A1 - Klopfleisch, Robert A1 - Maier, Andreas T1 - Are Fast Labeling Methods Reliable? A Case Study of Computer-Aided Expert Annotations on Microscopy Slides T2 - Medical Image Computing and Computer Assisted Intervention – MICCAI 2020 UR - https://doi.org/10.1007/978-3-030-59710-8_3 KW - Pathology KW - Microscopy KW - Computer-aided labelling KW - Expert-algorithm collaboration Y1 - 2020 UR - https://doi.org/10.1007/978-3-030-59710-8_3 SN - 978-3-030-59710-8 SN - 1611-3349 SP - 24 EP - 32 PB - Springer CY - Cham ER - TY - CHAP A1 - Bertram, Christof A1 - Veta, Mitko A1 - Marzahl, Christian A1 - Stathonikos, Nikolas A1 - Maier, Andreas A1 - Klopfleisch, Robert A1 - Aubreville, Marc T1 - Are Pathologist-Defined Labels Reproducible? Comparison of the TUPAC16 Mitotic Figure Dataset with an Alternative Set of Labels T2 - Interpretable and Annotation-Efficient Learning for Medical Image Computing UR - https://doi.org/10.1007/978-3-030-61166-8_22 KW - Breast cancer KW - Mitotic figures KW - Computer-aided annotation KW - Deep learning Y1 - 2020 UR - https://doi.org/10.1007/978-3-030-61166-8_22 SN - 978-3-030-61166-8 SN - 1611-3349 SP - 204 EP - 213 PB - Springer CY - Cham ER - TY - CHAP A1 - Krappmann, Maximilian A1 - Aubreville, Marc A1 - Maier, Andreas A1 - Bertram, Christof A1 - Klopfleisch, Robert ED - Maier, Andreas ED - Deserno, Thomas Martin ED - Handels, Heinz ED - Maier-Hein, Klaus H. ED - Palm, Christoph ED - Tolxdorff, Thomas T1 - Classification of Mitotic Cells BT - Potentials Beyond the Limits of Small Data Sets T2 - Bildverarbeitung für die Medizin 2018 UR - https://doi.org/10.1007/978-3-662-56537-7_66 Y1 - 2018 UR - https://doi.org/10.1007/978-3-662-56537-7_66 SN - 978-3-662-56536-0 SP - 245 EP - 250 PB - Springer CY - Berlin ER - TY - INPR A1 - Aubreville, Marc A1 - Krappmann, Maximilian A1 - Bertram, Christof A1 - Klopfleisch, Robert A1 - Maier, Andreas T1 - A Guided Spatial Transformer Network for Histology Cell Differentiation UR - https://doi.org/10.48550/arXiv.1707.08525 Y1 - 2017 UR - https://doi.org/10.48550/arXiv.1707.08525 PB - arXiv CY - Ithaca ER - TY - JOUR A1 - Haghofer, Andreas A1 - Fuchs-Baumgartinger, Andrea A1 - Lipnik, Karoline A1 - Klopfleisch, Robert A1 - Aubreville, Marc A1 - Scharinger, Josef A1 - Weissenböck, Herbert A1 - Winkler, Stephan M. A1 - Bertram, Christof T1 - Histological classification of canine and feline lymphoma using a modular approach based on deep learning and advanced image processing JF - Scientific Reports N2 - AbstractHistopathological examination of tissue samples is essential for identifying tumor malignancy and the diagnosis of different types of tumor. In the case of lymphoma classification, nuclear size of the neoplastic lymphocytes is one of the key features to differentiate the different subtypes. Based on the combination of artificial intelligence and advanced image processing, we provide a workflow for the classification of lymphoma with regards to their nuclear size (small, intermediate, and large). As the baseline for our workflow testing, we use a Unet++ model trained on histological images of canine lymphoma with individually labeled nuclei. As an alternative to the Unet++, we also used a publicly available pre-trained and unmodified instance segmentation model called Stardist to demonstrate that our modular classification workflow can be combined with different types of segmentation models if they can provide proper nuclei segmentation. Subsequent to nuclear segmentation, we optimize algorithmic parameters for accurate classification of nuclear size using a newly derived reference size and final image classification based on a pathologists-derived ground truth. Our image classification module achieves a classification accuracy of up to 92% on canine lymphoma data. Compared to the accuracy ranging from 66.67 to 84% achieved using measurements provided by three individual pathologists, our algorithm provides a higher accuracy level and reproducible results. Our workflow also demonstrates a high transferability to feline lymphoma, as shown by its accuracy of up to 84.21%, even though our workflow was not optimized for feline lymphoma images. By determining the nuclear size distribution in tumor areas, our workflow can assist pathologists in subtyping lymphoma based on the nuclei size and potentially improve reproducibility. Our proposed approach is modular and comprehensible, thus allowing adaptation for specific tasks and increasing the users’ trust in computer-assisted image classification. UR - https://doi.org/10.1038/s41598-023-46607-w Y1 - 2023 UR - https://doi.org/10.1038/s41598-023-46607-w UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-41415 SN - 2045-2322 VL - 13 PB - Springer Nature CY - London ER - TY - CHAP A1 - Ganz, Jonathan A1 - Lipnik, Karoline A1 - Ammeling, Jonas A1 - Richter, Barbara A1 - Puget, Chloé A1 - Parlak, Eda A1 - Diehl, Laura A1 - Klopfleisch, Robert A1 - Donovan, Taryn A1 - Kiupel, Matti A1 - Bertram, Christof A1 - Breininger, Katharina A1 - Aubreville, Marc ED - Deserno, Thomas Martin ED - Handels, Heinz ED - Maier, Andreas ED - Maier-Hein, Klaus H. ED - Palm, Christoph ED - Tolxdorff, Thomas T1 - Deep Learning-based Automatic Assessment of AgNOR-scores in Histopathology Images T2 - Bildverarbeitung für die Medizin 2023: Proceedings, German Workshop on Medical Image Computing, Braunschweig, July 2-4, 2023 UR - https://doi.org/10.1007/978-3-658-41657-7_49 Y1 - 2023 UR - https://doi.org/10.1007/978-3-658-41657-7_49 SN - 978-3-658-41657-7 SN - 978-3-658-41656-0 SP - 226 EP - 231 PB - Springer Vieweg CY - Wiesbaden ER - TY - CHAP A1 - Wilm, Frauke A1 - Fragoso-Garcia, Marco A1 - Bertram, Christof A1 - Stathonikos, Nikolas A1 - Öttl, Mathias A1 - Qiu, Jingna A1 - Klopfleisch, Robert A1 - Maier, Andreas A1 - Aubreville, Marc A1 - Breininger, Katharina T1 - Mind the Gap: Scanner-Induced Domain Shifts Pose Challenges for Representation Learning in Histopathology T2 - 2023 IEEE 20th International Symposium on Biomedical Imaging (ISBI) UR - https://doi.org/10.1109/ISBI53787.2023.10230458 KW - Histopathology KW - Domain Shift KW - Representation Learning KW - Barlow Twins Y1 - 2023 UR - https://doi.org/10.1109/ISBI53787.2023.10230458 SN - 978-1-6654-7358-3 PB - IEEE CY - Piscataway ER - TY - JOUR A1 - Aubreville, Marc A1 - Stathonikos, Nikolas A1 - Donovan, Taryn A1 - Klopfleisch, Robert A1 - Ammeling, Jonas A1 - Ganz, Jonathan A1 - Wilm, Frauke A1 - Veta, Mitko A1 - Jabari, Samir A1 - Eckstein, Markus A1 - Annuscheit, Jonas A1 - Krumnow, Christian A1 - Bozaba, Engin A1 - Cayir, Sercan A1 - Gu, Hongyan A1 - Chen, Xiang A1 - Jahanifar, Mostafa A1 - Shephard, Adam A1 - Kondo, Satoshi A1 - Kasai, Satoshi A1 - Kotte, Sujatha A1 - Saipradeep, Vangala A1 - Lafarge, Maxime W. A1 - Koelzer, Viktor H. A1 - Wang, Ziyue A1 - Zhang, Yongbing A1 - Yang, Sen A1 - Wang, Xiyue A1 - Breininger, Katharina A1 - Bertram, Christof T1 - Domain generalization across tumor types, laboratories, and species — Insights from the 2022 edition of the Mitosis Domain Generalization Challenge JF - Medical Image Analysis N2 - Recognition of mitotic figures in histologic tumor specimens is highly relevant to patient outcome assessment. This task is challenging for algorithms and human experts alike, with deterioration of algorithmic performance under shifts in image representations. Considerable covariate shifts occur when assessment is performed on different tumor types, images are acquired using different digitization devices, or specimens are produced in different laboratories. This observation motivated the inception of the 2022 challenge on MItosis Domain Generalization (MIDOG 2022). The challenge provided annotated histologic tumor images from six different domains and evaluated the algorithmic approaches for mitotic figure detection provided by nine challenge participants on ten independent domains. Ground truth for mitotic figure detection was established in two ways: a three-expert majority vote and an independent, immunohistochemistry-assisted set of labels. This work represents an overview of the challenge tasks, the algorithmic strategies employed by the participants, and potential factors contributing to their success. With an score of 0.764 for the top-performing team, we summarize that domain generalization across various tumor domains is possible with today’s deep learning-based recognition pipelines. However, we also found that domain characteristics not present in the training set (feline as new species, spindle cell shape as new morphology and a new scanner) led to small but significant decreases in performance. When assessed against the immunohistochemistry-assisted reference standard, all methods resulted in reduced recall scores, with only minor changes in the order of participants in the ranking. UR - https://doi.org/10.1016/j.media.2024.103155 Y1 - 2024 UR - https://doi.org/10.1016/j.media.2024.103155 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-58479 SN - 1361-8423 VL - 2024 IS - 94 PB - Elsevier CY - Amsterdam ER - TY - JOUR A1 - Ganz, Jonathan A1 - Marzahl, Christian A1 - Ammeling, Jonas A1 - Rosbach, Emely A1 - Richter, Barbara A1 - Puget, Chloé A1 - Denk, Daniela A1 - Demeter, Elena A. A1 - Tabaran, Flaviu A. A1 - Wasinger, Gabriel A1 - Lipnik, Karoline A1 - Tecilla, Marco A1 - Valentine, Matthew J. A1 - Dark, Michael A1 - Abele, Niklas A1 - Bolfa, Pompei A1 - Erber, Ramona A1 - Klopfleisch, Robert A1 - Merz, Sophie A1 - Donovan, Taryn A1 - Jabari, Samir A1 - Bertram, Christof A1 - Breininger, Katharina A1 - Aubreville, Marc T1 - Information mismatch in PHH3-assisted mitosis annotation leads to interpretation shifts in H&E slide analysis JF - Scientific Reports N2 - The count of mitotic figures (MFs) observed in hematoxylin and eosin (H&E)-stained slides is an important prognostic marker, as it is a measure for tumor cell proliferation. However, the identification of MFs has a known low inter-rater agreement. In a computer-aided setting, deep learning algorithms can help to mitigate this, but they require large amounts of annotated data for training and validation. Furthermore, label noise introduced during the annotation process may impede the algorithms’ performance. Unlike H&E, where identification of MFs is based mainly on morphological features, the mitosis-specific antibody phospho-histone H3 (PHH3) specifically highlights MFs. Counting MFs on slides stained against PHH3 leads to higher agreement among raters and has therefore recently been used as a ground truth for the annotation of MFs in H&E. However, as PHH3 facilitates the recognition of cells indistinguishable from H&E staining alone, the use of this ground truth could potentially introduce an interpretation shift and even label noise into the H&E-related dataset, impacting model performance. This study analyzes the impact of PHH3-assisted MF annotation on inter-rater reliability and object level agreement through an extensive multi-rater experiment. Subsequently, MF detectors, including a novel dual-stain detector, were evaluated on the resulting datasets to investigate the influence of PHH3-assisted labeling on the models’ performance. We found that the annotators’ object-level agreement significantly increased when using PHH3-assisted labeling (F1: 0.53 to 0.74). However, this enhancement in label consistency did not translate to improved performance for H&E-based detectors, neither during the training phase nor the evaluation phase. Conversely, the dual-stain detector was able to benefit from the higher consistency. This reveals an information mismatch between the H&E and PHH3-stained images as the cause of this effect, which renders PHH3-assisted annotations not well-aligned for use with H&E-based detectors. Based on our findings, we propose an improved PHH3-assisted labeling procedure. UR - https://doi.org/10.1038/s41598-024-77244-6 Y1 - 2024 UR - https://doi.org/10.1038/s41598-024-77244-6 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-53559 SN - 2045-2322 VL - 14 IS - 1 PB - Springer Nature CY - London ER - TY - JOUR A1 - Haghofer, Andreas A1 - Parlak, Eda A1 - Bartel, Alexander A1 - Donovan, Taryn A1 - Assenmacher, Charles-Antoine A1 - Bolfa, Pompei A1 - Dark, Michael A1 - Fuchs-Baumgartinger, Andrea A1 - Klang, Andrea A1 - Jäger, Kathrin A1 - Klopfleisch, Robert A1 - Merz, Sophie A1 - Richter, Barbara A1 - Schulman, F. Yvonne A1 - Janout, Hannah A1 - Ganz, Jonathan A1 - Scharinger, Josef A1 - Aubreville, Marc A1 - Winkler, Stephan M. A1 - Kiupel, Matti A1 - Bertram, Christof T1 - Nuclear pleomorphism in canine cutaneous mast cell tumors: Comparison of reproducibility and prognostic relevance between estimates, manual morphometry, and algorithmic morphometry JF - Veterinary Pathology N2 - Variation in nuclear size and shape is an important criterion of malignancy for many tumor types; however, categorical estimates by pathologists have poor reproducibility. Measurements of nuclear characteristics can improve reproducibility, but current manual methods are time-consuming. The aim of this study was to explore the limitations of estimates and develop alternative morphometric solutions for canine cutaneous mast cell tumors (ccMCTs). We assessed the following nuclear evaluation methods for accuracy, reproducibility, and prognostic utility: (1) anisokaryosis estimates by 11 pathologists; (2) gold standard manual morphometry of at least 100 nuclei; (3) practicable manual morphometry with stratified sampling of 12 nuclei by 9 pathologists; and (4) automated morphometry using deep learning–based segmentation. The study included 96 ccMCTs with available outcome information. Inter-rater reproducibility of anisokaryosis estimates was low (k = 0.226), whereas it was good (intraclass correlation = 0.654) for practicable morphometry of the standard deviation (SD) of nuclear size. As compared with gold standard manual morphometry (area under the ROC curve [AUC] = 0.839, 95% confidence interval [CI] = 0.701–0.977), the prognostic value (tumor-specific survival) of SDs of nuclear area for practicable manual morphometry and automated morphometry were high with an AUC of 0.868 (95% CI = 0.737–0.991) and 0.943 (95% CI = 0.889–0.996), respectively. This study supports the use of manual morphometry with stratified sampling of 12 nuclei and algorithmic morphometry to overcome the poor reproducibility of estimates. Further studies are needed to validate our findings, determine inter-algorithmic reproducibility and algorithmic robustness, and explore tumor heterogeneity of nuclear features in entire tumor sections. UR - https://doi.org/10.1177/03009858241295399 Y1 - 2024 UR - https://doi.org/10.1177/03009858241295399 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-53661 SN - 1544-2217 SN - 0300-9858 VL - 62 IS - 2 SP - 161 EP - 177 PB - Sage CY - London ER -