Error-Correcting Mean-Teacher: Corrections instead of consistency-targets applied to semi-supervised medical image segmentation

  • Semantic segmentation is an essential task in medical imaging research. Many powerful deep-learning-based approaches can be employed for this problem, but they are dependent on the availability of an expansive labeled dataset. In this work, we augment such supervised segmentation models to be suitable for learning from unlabeled data. Our semi-supervised approach, termed Error-Correcting Mean-Teacher, uses an exponential moving average model like the original Mean Teacher but introduces our new paradigm of error correction. The original segmentation network is augmented to handle this secondary correction task. Both tasks build upon the core feature extraction layers of the model. For the correction task, features detected in the input image are fused with features detected in the predicted segmentation and further processed with task-specific decoder layers. The combination of image and segmentation features allows the model to correct present mistakes in the given input pair. The correction task is trained jointly on the labeled data. On unlabeled data, the exponential moving average of the original network corrects the student’s prediction. The combined outputs of the students’ prediction with the teachers’ correction form the basis for the semi-supervised update. We evaluate our method with the 2017 and 2018 Robotic Scene Segmentation data, the ISIC 2017 and the BraTS 2020 Challenges, a proprietary Endoscopic Submucosal Dissection dataset, Cityscapes, and Pascal VOC 2012. Additionally, we analyze the impact of the individual components and examine the behavior when the amount of labeled data varies, with experiments performed on two distinct segmentation architectures. Our method shows improvements in terms of the mean Intersection over Union over the supervised baseline and competing methods. Code is available at https://github.com/CloneRob/ECMT.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar Statistics
Metadaten
Author:Robert MendelORCiD, David Rauber, Luis Antonio de Souza Jr.ORCiD, João Paulo PapaORCiD, Christoph PalmORCiDGND
URN:urn:nbn:de:bvb:898-opus4-57790
DOI:https://doi.org/10.1016/j.compbiomed.2023.106585
ISSN:0010-4825
Parent Title (English):Computers in Biology and Medicine
Publisher:Elsevier
Document Type:Article
Language:English
Year of first Publication:2023
Publishing Institution:Ostbayerische Technische Hochschule Regensburg
Release Date:2023/02/02
Tag:Mean-Teacher; Medical Imaging; Pseudo-labels; Semi-supervised Segmentation
Volume:154
Issue:March
Article Number:106585
Pagenumber:13
Institutes:Fakultät Informatik und Mathematik
Regensburg Center of Health Sciences and Technology - RCHST
Fakultät Informatik und Mathematik / Regensburg Medical Image Computing (ReMIC)
Begutachtungsstatus:peer-reviewed
Kostenträger (Forschungsprojekt, Labor, Einrichtung etc.):2027207
research focus:Lebenswissenschaften und Ethik
OpenAccess Publikationsweg:Hybrid Open Access - OA-Veröffentlichung in einer Subskriptionszeitschrift/-medium
Funding:Publikationsfonds der OTH Regensburg
Licence (German):Creative Commons - CC BY-NC-ND - Namensnennung - Nicht kommerziell - Keine Bearbeitungen 4.0 International