TY - JOUR A1 - Rühle, Bastian A1 - Krumrey, Julian Frederic A1 - Hodoroaba, Vasile-Dan T1 - Workflow towards automated segmentation of agglomerated, non‑spherical particles from electron microscopy images using artificial neural networks JF - Scientific reports N2 - We present a workflow for obtaining fully trained artificial neural networks that can perform automatic particle segmentations of agglomerated, non-spherical nanoparticles from scanning electron microscopy images “from scratch”, without the need for large training data sets of manually annotated images. The whole process only requires about 15 minutes of hands-on time by a user and can typically be finished within less than 12 hours when training on a single graphics card (GPU). After training, SEM image analysis can be carried out by the artificial neural network within seconds. This is achieved by using unsupervised learning for most of the training dataset generation, making heavy use of generative adversarial networks and especially unpaired image-to-image translation via cycle-consistent adversarial networks. We compare the segmentation masks obtained with our suggested workflow qualitatively and quantitatively to state-of-the-art methods using various metrics. Finally, we used the segmentation masks for automatically extracting particle size distributions from the SEM images of TiO2 particles, which were in excellent agreement with particle size distributions obtained manually but could be obtained in a fraction of the time. KW - Electron microscopy KW - Neural networks KW - Artificial intelligence KW - Image segmentation KW - Automated image analysis PY - 2021 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-522454 DO - https://doi.org/10.1038/s41598-021-84287-6 VL - 11 IS - 1 SP - 4942 PB - Springer Nature AN - OPUS4-52245 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Rühle, Bastian A1 - Hodoroaba, Vasile-Dan T1 - Towards Automated Electron Microscopy Image Segmentation for Nanoparticles of Complex Shape by Convolutional Neural Networks JF - Microscopy and Microanalysis N2 - In this contribution different ways are explored with the aim to generate suitable training data for ‘non-ideal’ samples using various approaches, e.g., computer-generated images or unsupervised learning algorithms such as generative adversarial networks (GANs). We used these data to train simple CNNs to produce segmentation masks of SEM images and tested the trained networks on real SEM images of complex nanoparticle samples. The novel use of CNN for the automated analysis of the size of nanoparticles of complex shape and with a high degree of agglomeration has proved to be a promising tool for the evaluation of particle size distribution on a large number of constituent particles. Further development and validation of the preliminary model, respectively larger training and validation data sets are necessary. KW - Nanoparticles KW - Convolutional neural networks KW - Image segmentation KW - Electron microscopy KW - Automatisation PY - 2020 DO - https://doi.org/10.1017/S1431927620017262 VL - 26 IS - S2 SP - 1188 EP - 1189 PB - Cambridge University Press CY - Cambridge, UK AN - OPUS4-51773 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER -