TY - CHAP A1 - Marzahl, Christian A1 - Bertram, Christof A1 - Aubreville, Marc A1 - Petrick, Anne A1 - Weiler, Kristina A1 - Gläsel, Agnes C. A1 - Fragoso-Garcia, Marco A1 - Merz, Sophie A1 - Bartenschlager, Florian A1 - Hoppe, Judith A1 - Langenhagen, Alina A1 - Jasensky, Anne-Katherine A1 - Voigt, Jörn A1 - Klopfleisch, Robert A1 - Maier, Andreas T1 - Are Fast Labeling Methods Reliable? A Case Study of Computer-Aided Expert Annotations on Microscopy Slides T2 - Medical Image Computing and Computer Assisted Intervention – MICCAI 2020 UR - https://doi.org/10.1007/978-3-030-59710-8_3 KW - Pathology KW - Microscopy KW - Computer-aided labelling KW - Expert-algorithm collaboration Y1 - 2020 UR - https://doi.org/10.1007/978-3-030-59710-8_3 SN - 978-3-030-59710-8 SN - 1611-3349 N1 - Der Nachweis einer Preprint-Version dieser Veröffentlichung ist ebenfalls in diesem Repositorium verzeichnet, s. https://opus4.kobv.de/opus4-haw/frontdoor/index/index/docId/1257 SP - 24 EP - 32 PB - Springer CY - Cham ER - TY - INPR A1 - Marzahl, Christian A1 - Bertram, Christof A1 - Aubreville, Marc A1 - Petrick, Anne A1 - Weiler, Kristina A1 - Gläsel, Agnes C. A1 - Fragoso-Garcia, Marco A1 - Merz, Sophie A1 - Bartenschlager, Florian A1 - Hoppe, Judith A1 - Langenhagen, Alina A1 - Jasensky, Anne-Katherine A1 - Voigt, Jörn A1 - Klopfleisch, Robert A1 - Maier, Andreas T1 - Are Fast Labeling Methods Reliable? A Case Study of Computer-Aided Expert Annotations on Microscopy Slides UR - https://doi.org/10.48550/arXiv.2004.05838 Y1 - 2020 UR - https://doi.org/10.48550/arXiv.2004.05838 N1 - Die veröffentlichte Version dieses Preprints ist ebenfalls in diesem Repositorium verzeichnet, s. https://opus4.kobv.de/opus4-haw/frontdoor/index/index/docId/1917 PB - arXiv CY - Ithaca ER - TY - JOUR A1 - Bertram, Christof A1 - Marzahl, Christian A1 - Bartel, Alexander A1 - Stayt, Jason A1 - Bonsembiante, Federico A1 - Beeler-Marfisi, Janet A1 - Barton, Ann K. A1 - Brocca, Ginevra A1 - Gelain, Maria Elena A1 - Gläsel, Agnes C. A1 - du Preez, Kelly A1 - Weiler, Kristina A1 - Weissenbacher-Lang, Christiane A1 - Breininger, Katharina A1 - Aubreville, Marc A1 - Maier, Andreas A1 - Klopfleisch, Robert A1 - Hill, Jenny T1 - Cytologic scoring of equine exercise-induced pulmonary hemorrhage BT - Performance of human experts and a deep learning-based algorithm JF - Veterinary Pathology N2 - Exercise-induced pulmonary hemorrhage (EIPH) is a relevant respiratory disease in sport horses, which can be diagnosed by examination of bronchoalveolar lavage fluid (BALF) cells using the total hemosiderin score (THS). The aim of this study was to evaluate the diagnostic accuracy and reproducibility of annotators and to validate a deep learning-based algorithm for the THS. Digitized cytological specimens stained for iron were prepared from 52 equine BALF samples. Ten annotators produced a THS for each slide according to published methods. The reference methods for comparing annotator’s and algorithmic performance included a ground truth dataset, the mean annotators’ THSs, and chemical iron measurements. Results of the study showed that annotators had marked interobserver variability of the THS, which was mostly due to a systematic error between annotators in grading the intracytoplasmatic hemosiderin content of individual macrophages. Regarding overall measurement error between the annotators, 87.7% of the variance could be reduced by using standardized grades based on the ground truth. The algorithm was highly consistent with the ground truth in assigning hemosiderin grades. Compared with the ground truth THS, annotators had an accuracy of diagnosing EIPH (THS of < or ≥ 75) of 75.7%, whereas, the algorithm had an accuracy of 92.3% with no relevant differences in correlation with chemical iron measurements. The results show that deep learning-based algorithms are useful for improving reproducibility and routine applicability of the THS. For THS by experts, a diagnostic uncertainty interval of 40 to 110 is proposed. THSs within this interval have insufficient reproducibility regarding the EIPH diagnosis. UR - https://doi.org/10.1177/03009858221137582 KW - artificial intelligence KW - automated image analysis KW - bronchoalveolar lavage fluid KW - computational pathology KW - digital pathology KW - equine KW - pulmonary hemorrhage KW - respiratory disease KW - total hemosiderin score Y1 - 2022 UR - https://doi.org/10.1177/03009858221137582 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-35196 SN - 1544-2217 VL - 60 IS - 1 SP - 75 EP - 85 PB - Sage CY - London ER -