TY - JOUR A1 - Deserno, Thomas M. A1 - Handels, Heinz A1 - Maier-Hein, Klaus H. A1 - Mersmann, Sven A1 - Palm, Christoph A1 - Tolxdorff, Thomas A1 - Wagenknecht, Gudrun A1 - Wittenberg, Thomas T1 - Viewpoints on Medical Image Processing BT - From Science to Application JF - Current Medical Imaging Reviews N2 - Medical image processing provides core innovation for medical imaging. This paper is focused on recent developments from science to applications analyzing the past fifteen years of history of the proceedings of the German annual meeting on medical image processing (BVM). Furthermore, some members of the program committee present their personal points of views: (i) multi-modality for imaging and diagnosis, (ii) analysis of diffusion-weighted imaging, (iii) model-based image analysis, (iv) registration of section images, (v) from images to information in digital endoscopy, and (vi) virtual reality and robotics. Medical imaging and medical image computing is seen as field of rapid development with clear trends to integrated applications in diagnostics, treatment planning and treatment. KW - Medical imaging KW - Image processing KW - Image analysis KW - Vizualization KW - Multi-modal imaging KW - Diffusion-weighted imaging KW - Model-based imaging KW - Digital endoscopy KW - Bildgebendes Verfahren KW - Bildverarbeitung KW - Medizin Y1 - 2013 U6 - https://doi.org/10.2174/1573405611309020002 VL - 9 IS - 2 SP - 79 EP - 88 ER - TY - JOUR A1 - Palm, Christoph A1 - Axer, Markus A1 - Gräßel, David A1 - Dammers, Jürgen A1 - Lindemeyer, Johannes A1 - Zilles, Karl A1 - Pietrzyk, Uwe A1 - Amunts, Katrin T1 - Towards ultra-high resolution fibre tract mapping of the human brain BT - registration of polarised light images and reorientation of fibre vectors JF - Frontiers in Human Neuroscience N2 - Polarised light imaging (PLI) utilises the birefringence of the myelin sheaths in order to visualise the orientation of nerve fibres in microtome sections of adult human post-mortem brains at ultra-high spatial resolution. The preparation of post-mortem brains for PLI involves fixation, freezing and cutting into 100-μm-thick sections. Hence, geometrical distortions of histological sections are inevitable and have to be removed for 3D reconstruction and subsequent fibre tracking. We here present a processing pipeline for 3D reconstruction of these sections using PLI derived multimodal images of post-mortem brains. Blockface images of the brains were obtained during cutting; they serve as reference data for alignment and elimination of distortion artefacts. In addition to the spatial image transformation, fibre orientation vectors were reoriented using the transformation fields, which consider both affine and subsequent non-linear registration. The application of this registration and reorientation approach results in a smooth fibre vector field, which reflects brain morphology. PLI combined with 3D reconstruction and fibre tracking is a powerful tool for human brain mapping. It can also serve as an independent method for evaluating in vivo fibre tractography. KW - Bildgebendes Verfahren KW - Dreidimensionale Bildverarbeitung KW - Polarisiertes Licht KW - Gehirnkarte Y1 - 2010 U6 - https://doi.org/10.3389/neuro.09.009.2010 VL - 4 ER - TY - CHAP A1 - Weiherer, Maximilian A1 - Zorn, Martin A1 - Wittenberg, Thomas A1 - Palm, Christoph ED - Tolxdorff, Thomas ED - Deserno, Thomas M. ED - Handels, Heinz ED - Maier, Andreas ED - Maier-Hein, Klaus H. ED - Palm, Christoph T1 - Retrospective Color Shading Correction for Endoscopic Images T2 - Bildverarbeitung für die Medizin 2020. Algorithmen - Systeme - Anwendungen. Proceedings des Workshops vom 15. bis 17. März 2020 in Berlin N2 - In this paper, we address the problem of retrospective color shading correction. An extension of the established gray-level shading correction algorithm based on signal envelope (SE) estimation to color images is developed using principal color components. Compared to the probably most general shading correction algorithm based on entropy minimization, SE estimation does not need any computationally expensive optimization and thus can be implemented more effciently. We tested our new shading correction scheme on artificial as well as real endoscopic images and observed promising results. Additionally, an indepth analysis of the stop criterion used in the SE estimation algorithm is provided leading to the conclusion that a fixed, user-defined threshold is generally not feasible. Thus, we present new ideas how to develop a non-parametric version of the SE estimation algorithm using entropy. KW - Endoskopie KW - Bildgebendes Verfahren KW - Farbenraum KW - Graustufe Y1 - 2020 SN - 978-3-658-29266-9 U6 - https://doi.org/10.1007/978-3-658-29267-6 SP - 14 EP - 19 PB - Springer Vieweg CY - Wiesbaden ER - TY - JOUR A1 - Axer, Markus A1 - Amunts, Katrin A1 - Gräßel, David A1 - Palm, Christoph A1 - Dammers, Jürgen A1 - Axer, Hubertus A1 - Pietrzyk, Uwe A1 - Zilles, Karl T1 - Novel Approach to the Human Connectome BT - Ultra-High Resolution Mapping of Fiber Tracts in the Brain JF - NeuroImage N2 - Signal transmission between different brain regions requires connecting fiber tracts, the structural basis of the human connectome. In contrast to animal brains, where a multitude of tract tracing methods can be used, magnetic resonance (MR)-based diffusion imaging is presently the only promising approach to study fiber tracts between specific human brain regions. However, this procedure has various inherent restrictions caused by its relatively low spatial resolution. Here, we introduce 3D-polarized light imaging (3D-PLI) to map the three-dimensional course of fiber tracts in the human brain with a resolution at a submillimeter scale based on a voxel size of 100 μm isotropic or less. 3D-PLI demonstrates nerve fibers by utilizing their intrinsic birefringence of myelin sheaths surrounding axons. This optical method enables the demonstration of 3D fiber orientations in serial microtome sections of entire human brains. Examples for the feasibility of this novel approach are given here. 3D-PLI enables the study of brain regions of intense fiber crossing in unprecedented detail, and provides an independent evaluation of fiber tracts derived from diffusion imaging data. KW - Connectome KW - Human brain KW - Method KW - Polarized light imaging KW - Tractography KW - Systems biology KW - Bildgebendes Verfahren KW - Dreidimensionale Bildverarbeitung KW - Polarisiertes Licht KW - Gehirnkarte Y1 - 2011 U6 - https://doi.org/10.1016/j.neuroimage.2010.08.075 VL - 54 IS - 2 SP - 1091 EP - 1101 ER - TY - GEN A1 - Gräßel, David A1 - Axer, Markus A1 - Palm, Christoph A1 - Dammers, Jürgen A1 - Amunts, Katrin A1 - Pietrzyk, Uwe A1 - Zilles, Karl T1 - Visualization of Fiber Tracts in the Postmortem Human Brain by Means of Polarized Light T2 - NeuroImage KW - Gehirn KW - Bildgebendes Verfahren KW - Polarisiertes Licht KW - Pathologische Anatomie Y1 - 2009 U6 - https://doi.org/10.1016/S1053-8119(09)71415-6 VL - 47 IS - Suppl. 1 SP - 142 ER - TY - JOUR A1 - Dammers, Jürgen A1 - Axer, Markus A1 - Gräßel, David A1 - Palm, Christoph A1 - Zilles, Karl A1 - Amunts, Katrin A1 - Pietrzyk, Uwe T1 - Signal enhancement in polarized light imaging by means of independent component analysis JF - NeuroImage N2 - Polarized light imaging (PLI) enables the evaluation of fiber orientations in histological sections of human postmortem brains, with ultra-high spatial resolution. PLI is based on the birefringent properties of the myelin sheath of nerve fibers. As a result, the polarization state of light propagating through a rotating polarimeter is changed in such a way that the detected signal at each measurement unit of a charged-coupled device (CCD) camera describes a sinusoidal signal. Vectors of the fiber orientation defined by inclination and direction angles can then directly be derived from the optical signals employing PLI analysis. However, noise, light scatter and filter inhomogeneities interfere with the original sinusoidal PLI signals. We here introduce a novel method using independent component analysis (ICA) to decompose the PLI images into statistically independent component maps. After decomposition, gray and white matter structures can clearly be distinguished from noise and other artifacts. The signal enhancement after artifact rejection is quantitatively evaluated in 134 histological whole brain sections. Thus, the primary sinusoidal signals from polarized light imaging can be effectively restored after noise and artifact rejection utilizing ICA. Our method therefore contributes to the analysis of nerve fiber orientation in the human brain within a micrometer scale. KW - Bildgebendes Verfahren KW - Polarisiertes Licht KW - Signalverarbeitung KW - Signaltrennung KW - Komponentenanalyse KW - Gehirn Y1 - 2010 U6 - https://doi.org/10.1016/j.neuroimage.2009.08.059 VL - 49 IS - 2 SP - 1241 EP - 1248 PB - Elsevier ER - TY - JOUR A1 - Becker, Johanna Sabine A1 - Matusch, Andreas A1 - Becker, Julia Susanne A1 - Wu, Bei A1 - Palm, Christoph A1 - Becker, Albert Johann A1 - Salber, Dagmar T1 - Mass spectrometric imaging (MSI) of metals using advanced BrainMet techniques for biomedical research JF - International Journal of Mass Spectrometry N2 - Mass spectrometric imaging (MSI) is a young innovative analytical technique and combines different fields of advanced mass spectrometry and biomedical research with the aim to provide maps of elements and molecules, complexes or fragments. Especially essential metals such as zinc, copper, iron and manganese play a functional role in signaling, metabolism and homeostasis of the cell. Due to the high degree of spatial organization of metals in biological systems their distribution analysis is of key interest in life sciences. We have developed analytical techniques termed BrainMet using laser ablation inductively coupled plasma mass spectrometry (LA-ICP-MS) imaging to measure the distribution of trace metals in biological tissues for biomedical research and feasibility studies—including bioaccumulation and bioavailability studies, ecological risk assessment and toxicity studies in humans and other organisms. The analytical BrainMet techniques provide quantitative images of metal distributions in brain tissue slices which can be combined with other imaging modalities such as photomicrography of native or processed tissue (histochemistry, immunostaining) and autoradiography or with in vivo techniques such as positron emission tomography or magnetic resonance tomography. Prospective and instrumental developments will be discussed concerning the development of the metalloprotein microscopy using a laser microdissection (LMD) apparatus for specific sample introduction into an inductively coupled plasma mass spectrometer (LMD-ICP-MS) or an application of the near field effect in LA-ICP-MS (NF-LA-ICP-MS). These nano-scale mass spectrometric techniques provide improved spatial resolution down to the single cell level. KW - Bioimaging KW - Brain tissue KW - Laser ablation inductively coupled plasma mass spectrometry KW - Laser microdissection inductively coupled plasma mass spectrometry KW - Metals KW - Metallomics KW - Nano-LA-ICP-MS KW - Tumour KW - Massenspektrometrie KW - Bildgebendes Verfahren KW - Metalle KW - Metallproteide KW - Gehirn Y1 - 2011 U6 - https://doi.org/10.1016/j.ijms.2011.01.015 VL - 307 IS - 1-3 SP - 3 EP - 15 PB - eLSEVIER CY - Elsevier ER - TY - GEN A1 - Scheppach, Markus W. A1 - Mendel, Robert A1 - Probst, Andreas A1 - Meinikheim, Michael A1 - Palm, Christoph A1 - Messmann, Helmut A1 - Ebigbo, Alanna T1 - Artificial Intelligence (AI) – assisted vessel and tissue recognition during third space endoscopy (Smart ESD) T2 - Zeitschrift für Gastroenterologie N2 - Clinical setting  Third space procedures such as endoscopic submucosal dissection (ESD) and peroral endoscopic myotomy (POEM) are complex minimally invasive techniques with an elevated risk for operator-dependent adverse events such as bleeding and perforation. This risk arises from accidental dissection into the muscle layer or through submucosal blood vessels as the submucosal cutting plane within the expanding resection site is not always apparent. Deep learning algorithms have shown considerable potential for the detection and characterization of gastrointestinal lesions. So-called AI – clinical decision support solutions (AI-CDSS) are commercially available for polyp detection during colonoscopy. Until now, these computer programs have concentrated on diagnostics whereas an AI-CDSS for interventional endoscopy has not yet been introduced. We aimed to develop an AI-CDSS („Smart ESD“) for real-time intra-procedural detection and delineation of blood vessels, tissue structures and endoscopic instruments during third-space endoscopic procedures. Characteristics of Smart ESD  An AI-CDSS was invented that delineates blood vessels, tissue structures and endoscopic instruments during third-space endoscopy in real-time. The output can be displayed by an overlay over the endoscopic image with different modes of visualization, such as a color-coded semitransparent area overlay, or border tracing (demonstration video). Hereby the optimal layer for dissection can be visualized, which is close above or directly at the muscle layer, depending on the applied technique (ESD or POEM). Furthermore, relevant blood vessels (thickness> 1mm) are delineated. Spatial proximity between the electrosurgical knife and a blood vessel triggers a warning signal. By this guidance system, inadvertent dissection through blood vessels could be averted. Technical specifications  A DeepLabv3+ neural network architecture with KSAC and a 101-layer ResNeSt backbone was used for the development of Smart ESD. It was trained and validated with 2565 annotated still images from 27 full length third-space endoscopic videos. The annotation classes were blood vessel, submucosal layer, muscle layer, electrosurgical knife and endoscopic instrument shaft. A test on a separate data set yielded an intersection over union (IoU) of 68%, a Dice Score of 80% and a pixel accuracy of 87%, demonstrating a high overlap between expert and AI segmentation. Further experiments on standardized video clips showed a mean vessel detection rate (VDR) of 85% with values of 92%, 70% and 95% for POEM, rectal ESD and esophageal ESD respectively. False positive measurements occurred 0.75 times per minute. 7 out of 9 vessels which caused intraprocedural bleeding were caught by the algorithm, as well as both vessels which required hemostasis via hemostatic forceps. Future perspectives  Smart ESD performed well for vessel and tissue detection and delineation on still images, as well as on video clips. During a live demonstration in the endoscopy suite, clinical applicability of the innovation was examined. The lag time for processing of the live endoscopic image was too short to be visually detectable for the interventionist. Even though the algorithm could not be applied during actual dissection by the interventionist, Smart ESD appeared readily deployable during visual assessment by ESD experts. Therefore, we plan to conduct a clinical trial in order to obtain CE-certification of the algorithm. This new technology may improve procedural safety and speed, as well as training of modern minimally invasive endoscopic resection techniques. KW - Artificial Intelligence KW - Medical Image Computing KW - Endoscopy KW - Bildgebendes Verfahren KW - Medizin KW - Künstliche Intelligenz KW - Endoskopie Y1 - 2022 U6 - https://doi.org/10.1055/s-0042-1755110 VL - 60 IS - 08 PB - Georg Thieme Verlag CY - Stuttgart ER -