TY - INPR A1 - Haghofer, Andreas A1 - Parlak, Eda A1 - Bartel, Alexander A1 - Donovan, Taryn A1 - Assenmacher, Charles-Antoine A1 - Bolfa, Pompei A1 - Dark, Michael A1 - Fuchs-Baumgartinger, Andrea A1 - Klang, Andrea A1 - Jäger, Kathrin A1 - Klopfleisch, Robert A1 - Merz, Sophie A1 - Richter, Barbara A1 - Schulman, F. Yvonne A1 - Ganz, Jonathan A1 - Scharinger, Josef A1 - Aubreville, Marc A1 - Winkler, Stephan M. A1 - Kiupel, Matti A1 - Bertram, Christof T1 - Nuclear Morphometry using a Deep Learning-based Algorithm has Prognostic Relevance for Canine Cutaneous Mast Cell Tumors N2 - Variation in nuclear size and shape is an important criterion of malignancy for many tumor types; however, categorical estimates by pathologists have poor reproducibility. Measurements of nuclear characteristics (morphometry) can improve reproducibility, but manual methods are time consuming. In this study, we evaluated fully automated morphometry using a deep learning-based algorithm in 96 canine cutaneous mast cell tumors with information on patient survival. Algorithmic morphometry was compared with karyomegaly estimates by 11 pathologists, manual nuclear morphometry of 12 cells by 9 pathologists, and the mitotic count as a benchmark. The prognostic value of automated morphometry was high with an area under the ROC curve regarding the tumor-specific survival of 0.943 (95% CI: 0.889 - 0.996) for the standard deviation (SD) of nuclear area, which was higher than manual morphometry of all pathologists combined (0.868, 95% CI: 0.737 - 0.991) and the mitotic count (0.885, 95% CI: 0.765 - 1.00). At the proposed thresholds, the hazard ratio for algorithmic morphometry (SD of nuclear area ≥9.0μm2) was 18.3 (95% CI: 5.0 - 67.1), for manual morphometry (SD of nuclear area ≥10.9μm2) 9.0 (95% CI: 6.0 - 13.4), for karyomegaly estimates 7.6 (95% CI: 5.7 - 10.1), and for the mitotic count 30.5 (95% CI: 7.8 - 118.0). Inter-rater reproducibility for karyomegaly estimates was fair (κ = 0.226) with highly variable sensitivity/specificity values for the individual pathologists. Reproducibility for manual morphometry (SD of nuclear area) was good (ICC = 0.654). This study supports the use of algorithmic morphometry as a prognostic test to overcome the limitations of estimates and manual measurements. UR - https://doi.org/10.48550/arXiv.2309.15031 Y1 - 2023 UR - https://doi.org/10.48550/arXiv.2309.15031 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-41401 PB - arXiv CY - Ithaca ER - TY - JOUR A1 - Haghofer, Andreas A1 - Parlak, Eda A1 - Bartel, Alexander A1 - Donovan, Taryn A1 - Assenmacher, Charles-Antoine A1 - Bolfa, Pompei A1 - Dark, Michael A1 - Fuchs-Baumgartinger, Andrea A1 - Klang, Andrea A1 - Jäger, Kathrin A1 - Klopfleisch, Robert A1 - Merz, Sophie A1 - Richter, Barbara A1 - Schulman, F. Yvonne A1 - Janout, Hannah A1 - Ganz, Jonathan A1 - Scharinger, Josef A1 - Aubreville, Marc A1 - Winkler, Stephan M. A1 - Kiupel, Matti A1 - Bertram, Christof T1 - Nuclear pleomorphism in canine cutaneous mast cell tumors: Comparison of reproducibility and prognostic relevance between estimates, manual morphometry, and algorithmic morphometry JF - Veterinary Pathology N2 - Variation in nuclear size and shape is an important criterion of malignancy for many tumor types; however, categorical estimates by pathologists have poor reproducibility. Measurements of nuclear characteristics can improve reproducibility, but current manual methods are time-consuming. The aim of this study was to explore the limitations of estimates and develop alternative morphometric solutions for canine cutaneous mast cell tumors (ccMCTs). We assessed the following nuclear evaluation methods for accuracy, reproducibility, and prognostic utility: (1) anisokaryosis estimates by 11 pathologists; (2) gold standard manual morphometry of at least 100 nuclei; (3) practicable manual morphometry with stratified sampling of 12 nuclei by 9 pathologists; and (4) automated morphometry using deep learning–based segmentation. The study included 96 ccMCTs with available outcome information. Inter-rater reproducibility of anisokaryosis estimates was low (k = 0.226), whereas it was good (intraclass correlation = 0.654) for practicable morphometry of the standard deviation (SD) of nuclear size. As compared with gold standard manual morphometry (area under the ROC curve [AUC] = 0.839, 95% confidence interval [CI] = 0.701–0.977), the prognostic value (tumor-specific survival) of SDs of nuclear area for practicable manual morphometry and automated morphometry were high with an AUC of 0.868 (95% CI = 0.737–0.991) and 0.943 (95% CI = 0.889–0.996), respectively. This study supports the use of manual morphometry with stratified sampling of 12 nuclei and algorithmic morphometry to overcome the poor reproducibility of estimates. Further studies are needed to validate our findings, determine inter-algorithmic reproducibility and algorithmic robustness, and explore tumor heterogeneity of nuclear features in entire tumor sections. UR - https://doi.org/10.1177/03009858241295399 Y1 - 2024 UR - https://doi.org/10.1177/03009858241295399 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-53661 SN - 1544-2217 SN - 0300-9858 VL - 62 IS - 2 SP - 161 EP - 177 PB - Sage CY - London ER - TY - CHAP A1 - Rosbach, Emely A1 - Ammeling, Jonas A1 - Krügel, Sebastian A1 - Kießig, Angelika A1 - Fritz, Alexis A1 - Ganz, Jonathan A1 - Puget, Chloé A1 - Donovan, Taryn A1 - Klang, Andrea A1 - Köller, Maximilian C. A1 - Bolfa, Pompei A1 - Tecilla, Marco A1 - Denk, Daniela A1 - Kiupel, Matti A1 - Paraschou, Georgios A1 - Kok, Mun Keong A1 - Haake, Alexander F. H. A1 - de Krijger, Ronald R. A1 - Sonnen, Andreas F.-P. A1 - Kasantikul, Tanit A1 - Dorrestein, Gerry M. A1 - Smedley, Rebecca C. A1 - Stathonikos, Nikolas A1 - Uhl, Matthias A1 - Bertram, Christof A1 - Riener, Andreas A1 - Aubreville, Marc ED - Yamashita, Naomi ED - Evers, Vanessa ED - Yatani, Koji ED - Ding, Xianghua ED - Lee, Bongshin ED - Chetty, Marshini ED - Toups-Dugas, Phoebe T1 - "When Two Wrongs Don't Make a Right" - Examining Confirmation Bias and the Role of Time Pressure During Human-AI Collaboration in Computational Pathology T2 - CHI'25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems N2 - Artificial intelligence (AI)-based decision support systems hold promise for enhancing diagnostic accuracy and efficiency in computational pathology. However, human-AI collaboration can introduce and amplify cognitive biases, like confirmation bias caused by false confirmation when erroneous human opinions are reinforced by inaccurate AI output. This bias may increase under time pressure, a ubiquitous factor in routine pathology, as it strains practitioners’ cognitive resources. We quantified confirmation bias triggered by AI-induced false confirmation and examined the role of time constraints in a web-based experiment, where trained pathology experts (n=28) estimated tumor cell percentages. Our results suggest that AI integration fuels confirmation bias, evidenced by a statistically significant positive linear-mixed-effects model coefficient linking AI recommendations mirroring flawed human judgment and alignment with system advice. Conversely, time pressure appeared to weaken this relationship. These findings highlight potential risks of AI in healthcare and aim to support the safe integration of clinical decision support systems. UR - https://doi.org/10.1145/3706598.3713319 Y1 - 2025 UR - https://doi.org/10.1145/3706598.3713319 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-58797 SN - 979-8-4007-1394-1 PB - ACM CY - New York ER - TY - INPR A1 - Rosbach, Emely A1 - Ammeling, Jonas A1 - Krügel, Sebastian A1 - Kießig, Angelika A1 - Fritz, Alexis A1 - Ganz, Jonathan A1 - Puget, Chloé A1 - Donovan, Taryn A1 - Klang, Andrea A1 - Köller, Maximilian C. A1 - Bolfa, Pompei A1 - Tecilla, Marco A1 - Denk, Daniela A1 - Kiupel, Matti A1 - Paraschou, Georgios A1 - Kok, Mun Keong A1 - Haake, Alexander F. H. A1 - de Krijger, Ronald R. A1 - Sonnen, Andreas F.-P. A1 - Kasantikul, Tanit A1 - Dorrestein, Gerry M. A1 - Smedley, Rebecca C. A1 - Stathonikos, Nikolas A1 - Uhl, Matthias A1 - Bertram, Christof A1 - Riener, Andreas A1 - Aubreville, Marc T1 - "When TwoWrongs Don’t Make a Right" - Examining Confirmation Bias and the Role of Time Pressure During Human-AI Collaboration in Computational Pathology UR - https://doi.org/10.48550/arXiv.2411.01007 Y1 - 2024 UR - https://doi.org/10.48550/arXiv.2411.01007 PB - arXiv CY - Ithaca ER - TY - JOUR A1 - Glahn, Imaine A1 - Haghofer, Andreas A1 - Donovan, Taryn A1 - Degasperi, Brigitte A1 - Bartel, Alexander A1 - Kreilmeier-Berger, Theresa A1 - Hyndman, Philip S. A1 - Janout, Hannah A1 - Assenmacher, Charles-Antoine A1 - Bartenschlager, Florian A1 - Bolfa, Pompei A1 - Dark, Michael A1 - Klang, Andrea A1 - Klopfleisch, Robert A1 - Merz, Sophie A1 - Richter, Barbara A1 - Schulman, F. Yvonne A1 - Ganz, Jonathan A1 - Scharinger, Josef A1 - Aubreville, Marc A1 - Winkler, Stephan M. A1 - Bertram, Christof T1 - Automated Nuclear Morphometry: A Deep Learning Approach for Prognostication in Canine Pulmonary Carcinoma to Enhance Reproducibility JF - Veterinary Sciences N2 - The integration of deep learning-based tools into diagnostic workflows is increasingly prevalent due to their efficiency and reproducibility in various settings. We investigated the utility of automated nuclear morphometry for assessing nuclear pleomorphism (NP), a criterion of malignancy in the current grading system in canine pulmonary carcinoma (cPC), and its prognostic implications. We developed a deep learning-based algorithm for evaluating NP (variation in size, i.e., anisokaryosis and/or shape) using a segmentation model. Its performance was evaluated on 46 cPC cases with comprehensive follow-up data regarding its accuracy in nuclear segmentation and its prognostic ability. Its assessment of NP was compared to manual morphometry and established prognostic tests (pathologists’ NP estimates (n = 11), mitotic count, histological grading, and TNM-stage). The standard deviation (SD) of the nuclear area, indicative of anisokaryosis, exhibited good discriminatory ability for tumor-specific survival, with an area under the curve (AUC) of 0.80 and a hazard ratio (HR) of 3.38. The algorithm achieved values comparable to manual morphometry. In contrast, the pathologists’ estimates of anisokaryosis resulted in HR values ranging from 0.86 to 34.8, with slight inter-observer reproducibility (k = 0.204). Other conventional tests had no significant prognostic value in our study cohort. Fully automated morphometry promises a time-efficient and reproducible assessment of NP with a high prognostic value. Further refinement of the algorithm, particularly to address undersegmentation, and application to a larger study population are required. UR - https://doi.org/10.3390/vetsci11060278 Y1 - 2024 UR - https://doi.org/10.3390/vetsci11060278 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-48612 SN - 2306-7381 VL - 11 IS - 6 PB - MDPI CY - Basel ER - TY - JOUR A1 - Aubreville, Marc A1 - Stathonikos, Nikolas A1 - Bertram, Christof A1 - Klopfleisch, Robert A1 - Hoeve, Natalie ter A1 - Ciompi, Francesco A1 - Wilm, Frauke A1 - Marzahl, Christian A1 - Donovan, Taryn A1 - Maier, Andreas A1 - Breen, Jack A1 - Ravikumar, Nishant A1 - Chung, Youjin A1 - Park, Jinah A1 - Nateghi, Ramin A1 - Pourakpour, Fattaneh A1 - Fick, Rutger H. J. A1 - Ben Hadj, Saima A1 - Jahanifar, Mostafa A1 - Shepard, Adam A1 - Dexl, Jakob A1 - Wittenberg, Thomas A1 - Kondo, Satoshi A1 - Lafarge, Maxime W. A1 - Kolezer, Viktor H. A1 - Liang, Jingtang A1 - Wang, Yubo A1 - Long, Xi A1 - Liu, Jingxin A1 - Razavi, Salar A1 - Khademi, April A1 - Yang, Sen A1 - Wang, Xiyue A1 - Erber, Ramona A1 - Klang, Andrea A1 - Lipnik, Karoline A1 - Bolfa, Pompei A1 - Dark, Michael A1 - Wasinger, Gabriel A1 - Veta, Mitko A1 - Breininger, Katharina T1 - Mitosis domain generalization in histopathology images — The MIDOG challenge JF - Medical Image Analysis UR - https://doi.org/10.1016/j.media.2022.102699 KW - Domain generalization KW - Histopathology KW - Challenge KW - Deep Learning KW - Mitosis Y1 - 2022 UR - https://doi.org/10.1016/j.media.2022.102699 SN - 1361-8423 SN - 1361-8415 VL - 2023 IS - 84 PB - Elsevier CY - Amsterdam ER -