TY - INPR A1 - Aubreville, Marc A1 - Stathonikos, Nikolas A1 - Donovan, Taryn A1 - Klopfleisch, Robert A1 - Ganz, Jonathan A1 - Ammeling, Jonas A1 - Wilm, Frauke A1 - Veta, Mitko A1 - Jabari, Samir A1 - Eckstein, Markus A1 - Annuscheit, Jonas A1 - Krumnow, Christian A1 - Bozaba, Engin A1 - Cayir, Sercan A1 - Gu, Hongyan A1 - Chen, Xiang A1 - Jahanifar, Mostafa A1 - Shephard, Adam A1 - Kondo, Satoshi A1 - Kasai, Satoshi A1 - Kotte, Sujatha A1 - Saipradeep, Vangala A1 - Lafarge, Maxime W. A1 - Koelzer, Viktor H. A1 - Wang, Ziyue A1 - Zhang, Yongbing A1 - Yang, Sen A1 - Wang, Xiyue A1 - Breininger, Katharina A1 - Bertram, Christof T1 - Domain generalization across tumor types, laboratories, and species – Insights from the 2022 edition of the Mitosis Domain Generalization Challenge N2 - Recognition of mitotic figures in histologic tumor specimens is highly relevant to patient outcome assessment. This task is challenging for algorithms and human experts alike, with deterioration of algorithmic performance under shifts in image representations. Considerable covariate shifts occur when assessment is performed on different tumor types, images are acquired using different digitization devices, or specimens are produced in different laboratories. This observation motivated the inception of the 2022 challenge on MItosis Domain Generalization (MIDOG 2022). The challenge provided annotated histologic tumor images from six different domains and evaluated the algorithmic approaches for mitotic figure detection provided by nine challenge participants on ten independent domains. Ground truth for mitotic figure detection was established in two ways: a three-expert consensus and an independent, immunohistochemistry-assisted set of labels. This work represents an overview of the challenge tasks, the algorithmic strategies employed by the participants, and potential factors contributing to their success. With an F1 score of 0.764 for the top-performing team, we summarize that domain generalization across various tumor domains is possible with today's deep learning-based recognition pipelines. When assessed against the immunohistochemistry-assisted reference standard, all methods resulted in reduced recall scores, but with only minor changes in the order of participants in the ranking. UR - https://doi.org/10.48550/arXiv.2309.15589 Y1 - 2023 UR - https://doi.org/10.48550/arXiv.2309.15589 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-41514 PB - arXiv CY - Ithaca ER - TY - CHAP A1 - Bertram, Christof A1 - Veta, Mitko A1 - Marzahl, Christian A1 - Stathonikos, Nikolas A1 - Maier, Andreas A1 - Klopfleisch, Robert A1 - Aubreville, Marc T1 - Are Pathologist-Defined Labels Reproducible? Comparison of the TUPAC16 Mitotic Figure Dataset with an Alternative Set of Labels T2 - Interpretable and Annotation-Efficient Learning for Medical Image Computing UR - https://doi.org/10.1007/978-3-030-61166-8_22 KW - Breast cancer KW - Mitotic figures KW - Computer-aided annotation KW - Deep learning Y1 - 2020 UR - https://doi.org/10.1007/978-3-030-61166-8_22 SN - 978-3-030-61166-8 SN - 1611-3349 SP - 204 EP - 213 PB - Springer CY - Cham ER - TY - JOUR A1 - Aubreville, Marc A1 - Stathonikos, Nikolas A1 - Donovan, Taryn A1 - Klopfleisch, Robert A1 - Ammeling, Jonas A1 - Ganz, Jonathan A1 - Wilm, Frauke A1 - Veta, Mitko A1 - Jabari, Samir A1 - Eckstein, Markus A1 - Annuscheit, Jonas A1 - Krumnow, Christian A1 - Bozaba, Engin A1 - Cayir, Sercan A1 - Gu, Hongyan A1 - Chen, Xiang A1 - Jahanifar, Mostafa A1 - Shephard, Adam A1 - Kondo, Satoshi A1 - Kasai, Satoshi A1 - Kotte, Sujatha A1 - Saipradeep, Vangala A1 - Lafarge, Maxime W. A1 - Koelzer, Viktor H. A1 - Wang, Ziyue A1 - Zhang, Yongbing A1 - Yang, Sen A1 - Wang, Xiyue A1 - Breininger, Katharina A1 - Bertram, Christof T1 - Domain generalization across tumor types, laboratories, and species — Insights from the 2022 edition of the Mitosis Domain Generalization Challenge JF - Medical Image Analysis N2 - Recognition of mitotic figures in histologic tumor specimens is highly relevant to patient outcome assessment. This task is challenging for algorithms and human experts alike, with deterioration of algorithmic performance under shifts in image representations. Considerable covariate shifts occur when assessment is performed on different tumor types, images are acquired using different digitization devices, or specimens are produced in different laboratories. This observation motivated the inception of the 2022 challenge on MItosis Domain Generalization (MIDOG 2022). The challenge provided annotated histologic tumor images from six different domains and evaluated the algorithmic approaches for mitotic figure detection provided by nine challenge participants on ten independent domains. Ground truth for mitotic figure detection was established in two ways: a three-expert majority vote and an independent, immunohistochemistry-assisted set of labels. This work represents an overview of the challenge tasks, the algorithmic strategies employed by the participants, and potential factors contributing to their success. With an score of 0.764 for the top-performing team, we summarize that domain generalization across various tumor domains is possible with today’s deep learning-based recognition pipelines. However, we also found that domain characteristics not present in the training set (feline as new species, spindle cell shape as new morphology and a new scanner) led to small but significant decreases in performance. When assessed against the immunohistochemistry-assisted reference standard, all methods resulted in reduced recall scores, with only minor changes in the order of participants in the ranking. UR - https://doi.org/10.1016/j.media.2024.103155 Y1 - 2024 UR - https://doi.org/10.1016/j.media.2024.103155 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-58479 SN - 1361-8423 VL - 2024 IS - 94 PB - Elsevier CY - Amsterdam ER - TY - JOUR A1 - Stathonikos, Nikolas A1 - Aubreville, Marc A1 - de Vries, Sjoerd A1 - Wilm, Frauke A1 - Bertram, Christof A1 - Veta, Mitko A1 - van Diest, Paul J T1 - Breast cancer survival prediction using an automated mitosis detection pipeline JF - The Journal of Pathology: Clinical Research N2 - AbstractMitotic count (MC) is the most common measure to assess tumor proliferation in breast cancer patients and is highly predictive of patient outcomes. It is, however, subject to inter‐ and intraobserver variation and reproducibility challenges that may hamper its clinical utility. In past studies, artificial intelligence (AI)‐supported MC has been shown to correlate well with traditional MC on glass slides. Considering the potential of AI to improve reproducibility of MC between pathologists, we undertook the next validation step by evaluating the prognostic value of a fully automatic method to detect and count mitoses on whole slide images using a deep learning model. The model was developed in the context of the Mitosis Domain Generalization Challenge 2021 (MIDOG21) grand challenge and was expanded by a novel automatic area selector method to find the optimal mitotic hotspot and calculate the MC per 2 mm2. We employed this method on a breast cancer cohort with long‐term follow‐up from the University Medical Centre Utrecht (N = 912) and compared predictive values for overall survival of AI‐based MC and light‐microscopic MC, previously assessed during routine diagnostics. The MIDOG21 model was prognostically comparable to the original MC from the pathology report in uni‐ and multivariate survival analysis. In conclusion, a fully automated MC AI algorithm was validated in a large cohort of breast cancer with regard to retained prognostic value compared with traditional light‐microscopic MC. UR - https://doi.org/10.1002/2056-4538.70008 Y1 - 2024 UR - https://doi.org/10.1002/2056-4538.70008 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-53087 SN - 2056-4538 VL - 10 IS - 6 PB - Wiley CY - Chichester ER - TY - JOUR A1 - Aubreville, Marc A1 - Stathonikos, Nikolas A1 - Bertram, Christof A1 - Klopfleisch, Robert A1 - Hoeve, Natalie ter A1 - Ciompi, Francesco A1 - Wilm, Frauke A1 - Marzahl, Christian A1 - Donovan, Taryn A1 - Maier, Andreas A1 - Breen, Jack A1 - Ravikumar, Nishant A1 - Chung, Youjin A1 - Park, Jinah A1 - Nateghi, Ramin A1 - Pourakpour, Fattaneh A1 - Fick, Rutger H. J. A1 - Ben Hadj, Saima A1 - Jahanifar, Mostafa A1 - Shepard, Adam A1 - Dexl, Jakob A1 - Wittenberg, Thomas A1 - Kondo, Satoshi A1 - Lafarge, Maxime W. A1 - Kolezer, Viktor H. A1 - Liang, Jingtang A1 - Wang, Yubo A1 - Long, Xi A1 - Liu, Jingxin A1 - Razavi, Salar A1 - Khademi, April A1 - Yang, Sen A1 - Wang, Xiyue A1 - Erber, Ramona A1 - Klang, Andrea A1 - Lipnik, Karoline A1 - Bolfa, Pompei A1 - Dark, Michael A1 - Wasinger, Gabriel A1 - Veta, Mitko A1 - Breininger, Katharina T1 - Mitosis domain generalization in histopathology images — The MIDOG challenge JF - Medical Image Analysis UR - https://doi.org/10.1016/j.media.2022.102699 KW - Domain generalization KW - Histopathology KW - Challenge KW - Deep Learning KW - Mitosis Y1 - 2022 UR - https://doi.org/10.1016/j.media.2022.102699 SN - 1361-8423 SN - 1361-8415 VL - 2023 IS - 84 PB - Elsevier CY - Amsterdam ER - TY - CHAP A1 - Aubreville, Marc A1 - Bertram, Christof A1 - Stathonikos, Nikolas A1 - ter Hoeve, Natalie A1 - Ciompi, Francesco A1 - Klopfleisch, Robert A1 - Veta, Mitko A1 - Donovan, Taryn A1 - Marzahl, Christian A1 - Wilm, Frauke A1 - Breininger, Katharina A1 - Maier, Andreas T1 - Quantifying the Scanner-Induced Domain Gap in Mitosis Detection T2 - MIDL: Medical Imaging with Deep Learning 2021 Y1 - 2021 UR - https://2021.midl.io/papers/i6 PB - MIDL Foundation CY - Nijmegen ER - TY - JOUR A1 - Aubreville, Marc A1 - Wilm, Frauke A1 - Stathonikos, Nikolas A1 - Breininger, Katharina A1 - Donovan, Taryn A1 - Jabari, Samir A1 - Veta, Mitko A1 - Ganz, Jonathan A1 - Ammeling, Jonas A1 - van Diest, Paul J A1 - Klopfleisch, Robert A1 - Bertram, Christof T1 - A comprehensive multi-domain dataset for mitotic figure detection JF - Scientific Data N2 - The prognostic value of mitotic figures in tumor tissue is well-established for many tumor types and automating this task is of high research interest. However, especially deep learning-based methods face performance deterioration in the presence of domain shifts, which may arise from different tumor types, slide preparation and digitization devices. We introduce the MIDOG++ dataset, an extension of the MIDOG 2021 and 2022 challenge datasets. We provide region of interest images from 503 histological specimens of seven different tumor types with variable morphology with in total labels for 11,937 mitotic figures: breast carcinoma, lung carcinoma, lymphosarcoma, neuroendocrine tumor, cutaneous mast cell tumor, cutaneous melanoma, and (sub)cutaneous soft tissue sarcoma. The specimens were processed in several laboratories utilizing diverse scanners. We evaluated the extent of the domain shift by using state-of-the-art approaches, observing notable differences in single-domain training. In a leave-one-domain-out setting, generalizability improved considerably. This mitotic figure dataset is the first that incorporates a wide domain shift based on different tumor types, laboratories, whole slide image scanners, and species. UR - https://doi.org/10.1038/s41597-023-02327-4 Y1 - 2023 UR - https://doi.org/10.1038/s41597-023-02327-4 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-40068 SN - 2052-4463 N1 - Author Correction verfügbar unter https://doi.org/10.1038/s41597-024-03548-x VL - 10 PB - Springer CY - London ER - TY - INPR A1 - Bertram, Christof A1 - Veta, Mitko A1 - Marzahl, Christian A1 - Stathonikos, Nikolas A1 - Maier, Andreas A1 - Klopfleisch, Robert A1 - Aubreville, Marc T1 - Are pathologist-defined labels reproducible? Comparison of the TUPAC16 mitotic figure dataset with an alternative set of labels UR - https://doi.org/10.48550/arXiv.2007.05351 Y1 - 2020 UR - https://doi.org/10.48550/arXiv.2007.05351 PB - arXiv CY - Ithaca ER -