TY - CHAP A1 - Rosbach, Emely A1 - Ammeling, Jonas A1 - Krügel, Sebastian A1 - Kießig, Angelika A1 - Fritz, Alexis A1 - Ganz, Jonathan A1 - Puget, Chloé A1 - Donovan, Taryn A1 - Klang, Andrea A1 - Köller, Maximilian C. A1 - Bolfa, Pompei A1 - Tecilla, Marco A1 - Denk, Daniela A1 - Kiupel, Matti A1 - Paraschou, Georgios A1 - Kok, Mun Keong A1 - Haake, Alexander F. H. A1 - de Krijger, Ronald R. A1 - Sonnen, Andreas F.-P. A1 - Kasantikul, Tanit A1 - Dorrestein, Gerry M. A1 - Smedley, Rebecca C. A1 - Stathonikos, Nikolas A1 - Uhl, Matthias A1 - Bertram, Christof A1 - Riener, Andreas A1 - Aubreville, Marc ED - Yamashita, Naomi ED - Evers, Vanessa ED - Yatani, Koji ED - Ding, Xianghua ED - Lee, Bongshin ED - Chetty, Marshini ED - Toups-Dugas, Phoebe T1 - "When Two Wrongs Don't Make a Right" - Examining Confirmation Bias and the Role of Time Pressure During Human-AI Collaboration in Computational Pathology T2 - CHI'25: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems N2 - Artificial intelligence (AI)-based decision support systems hold promise for enhancing diagnostic accuracy and efficiency in computational pathology. However, human-AI collaboration can introduce and amplify cognitive biases, like confirmation bias caused by false confirmation when erroneous human opinions are reinforced by inaccurate AI output. This bias may increase under time pressure, a ubiquitous factor in routine pathology, as it strains practitioners’ cognitive resources. We quantified confirmation bias triggered by AI-induced false confirmation and examined the role of time constraints in a web-based experiment, where trained pathology experts (n=28) estimated tumor cell percentages. Our results suggest that AI integration fuels confirmation bias, evidenced by a statistically significant positive linear-mixed-effects model coefficient linking AI recommendations mirroring flawed human judgment and alignment with system advice. Conversely, time pressure appeared to weaken this relationship. These findings highlight potential risks of AI in healthcare and aim to support the safe integration of clinical decision support systems. UR - https://doi.org/10.1145/3706598.3713319 Y1 - 2025 UR - https://doi.org/10.1145/3706598.3713319 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-58797 SN - 979-8-4007-1394-1 PB - ACM CY - New York ER - TY - JOUR A1 - Ammeling, Jonas A1 - Aubreville, Marc A1 - Fritz, Alexis A1 - Kießig, Angelika A1 - Krügel, Sebastian A1 - Uhl, Matthias T1 - An interdisciplinary perspective on AI-supported decision making in medicine JF - Technology in Society N2 - Artificial intelligence (AI)-supported medical diagnosis offers the potential to utilize the collaborative intelligence of context-sensitive humans and narrowly focused machines for patients’ benefit. The employment of machine-learning-based decision-support systems (MLDSS) in medicine, however, raises important multidisciplinary challenges that cannot be addressed in isolation. We discuss three disciplinary perspectives on the topic and their interplay. Ethical issues arise at the level of changing responsibility structures in healthcare. Behavioral issues relate to the actual impact that the system has on physicians. Technical issues arise with respect to the training of a machine learning (ML) model that gives accurate advice. We argue that the interaction between physicians and MLDSS including the concrete design of the interface in which this interaction occurs can only be considered at the intersection of all three disciplines. UR - https://doi.org/10.1016/j.techsoc.2024.102791 Y1 - 2024 UR - https://doi.org/10.1016/j.techsoc.2024.102791 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-56526 SN - 1879-3274 VL - 2025 IS - 81 PB - Elsevier CY - Amsterdam ER - TY - CHAP A1 - Ammeling, Jonas A1 - Manger, Carina A1 - Kwaka, Elias A1 - Krügel, Sebastian A1 - Uhl, Matthias A1 - Kießig, Angelika A1 - Fritz, Alexis A1 - Ganz, Jonathan A1 - Riener, Andreas A1 - Bertram, Christof A1 - Breininger, Katharina A1 - Aubreville, Marc ED - Stolze, Markus ED - Loch, Frieder ED - Baldauf, Matthias ED - Alt, Florian ED - Schneegass, Christina ED - Kosch, Thomas ED - Hirzle, Teresa ED - Sadeghian, Shadan ED - Draxler, Fiona ED - Bektas, Kenan ED - Lohan, Katrin ED - Knierim, Pascal T1 - Appealing but Potentially Biasing - Investigation of the Visual Representation of Segmentation Predictions by AI Recommender Systems for Medical Decision Making T2 - Mensch und Computer 2023: Building Bridges: Tagungsband (Proceedings) UR - https://doi.org/10.1145/3603555.3608561 Y1 - 2023 UR - https://doi.org/10.1145/3603555.3608561 SN - 979-8-4007-0771-1 SP - 330 EP - 335 PB - ACM CY - New York ER - TY - JOUR A1 - Krügel, Sebastian A1 - Ammeling, Jonas A1 - Aubreville, Marc A1 - Fritz, Alexis A1 - Kießig, Angelika A1 - Uhl, Matthias T1 - Perceived responsibility in AI-supported medicine JF - AI & Society: Journal of Knowledge, Culture and Communication N2 - In a representative vignette study in Germany with 1,653 respondents, we investigated laypeople’s attribution of moral responsibility in collaborative medical diagnosis. Specifically, we compare people’s judgments in a setting in which physicians are supported by an AI-based recommender system to a setting in which they are supported by a human colleague. It turns out that people tend to attribute moral responsibility to the artificial agent, although this is traditionally considered a category mistake in normative ethics. This tendency is stronger when people believe that AI may become conscious at some point. In consequence, less responsibility is attributed to human agents in settings with hybrid diagnostic teams than in settings with human-only diagnostic teams. Our findings may have implications for behavior exhibited in contexts of collaborative medical decision making with AI-based as opposed to human recommenders because less responsibility is attributed to agents who have the mental capacity to care about outcomes. UR - https://doi.org/10.1007/s00146-024-01972-6 Y1 - 2024 UR - https://doi.org/10.1007/s00146-024-01972-6 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-57874 SN - 1435-5655 VL - 40 SP - 1485 EP - 1495 PB - Springer CY - London ER -