Refine
Year of publication
Document Type
- In Proceedings (42)
- Article (36)
- ZIB-Report (19)
- In Collection (3)
- Other (2)
- Book chapter (1)
- Doctoral Thesis (1)
- Poster (1)
- Research data (1)
Keywords
- model-based inversion (3)
- Monte Carlo (2)
- blood oxygen saturation (2)
- inverse problem (2)
- quantitative photoacoustic imaging (2)
- spectral unmixing (2)
- 2-photon microscopy (1)
- 2D distance map (1)
- Amira (1)
- Beton (1)
Institute
- Visual and Data-centric Computing (105)
- Visual Data Analysis (103)
- Image Analysis in Biology and Materials Science (72)
- Visual Data Analysis in Science and Engineering (26)
- Therapy Planning (17)
- Numerical Mathematics (2)
- Vergleichende Visualisierung (2)
- Distributed Algorithms and Supercomputing (1)
- ZIB Allgemein (1)
Im Rahmen der biomechanischen Simulation knöcherner Organe ist die Frage nach einer befriedigenden Materialbeschreibung nach wie vor ungelöst. Computertomographische Datensätze liefern eine räumliche Verteilung der (Röntgen-)Dichte und ermöglichen damit eine gute Darstellung der individuellen Geometrie. Weiter können die verschiedenen Materialbestandteile des Knochens, Spongiosa und Kortikalis, voneinander getrennt werden. Aber die richtungsabängige Information der Materialanisotropie ist verloren. In dieser Arbeit wird ein Ansatz für eine anisotrope Materialbeschreibung vorgestellt, die es ermöglicht, den Einfluss der individuellen knöchernen Struktur auf das makroskopische Materialverhalten abzuschätzen.
This work introduces a novel streamline seeding technique based on dual streamlines that are orthogonal to the vector field, instead of tangential. The greedy algorithm presented here produces a net of orthogonal streamlines that is iteratively refined resulting in good domain coverage and a high degree of continuity and uniformity. The algorithm is easy to implement and efficient, and it naturally extends to curved surfaces.
Kurzfassung. Durch die Alkalität des Betons wird Betonstahl dauerhaft vor
Korrosion geschützt. Infolge von Chlorideintrag kann dieser Schutz nicht länger
aufrechterhalten werden und führt zu Lochkorrosion. Die zerstörungsfreie Prüfung
von Stahlbetonproben mit 3D-CT bietet die Möglichkeit, eine Probe mehrfach
gezielt vorzuschädigen und den Korrosionsfortschritt zu untersuchen. Zur Quantifizierung
des Schädigungsgrades müssen die bei dieser Untersuchung anfallenden
großen Bilddaten mit Bildverarbeitungsmethoden ausgewertet werden. Ein wesentlicher
Schritt dabei ist die Segmentierung der Bilddaten, bei der zwischen Korrosionsprodukt
(Rost), Betonstahl (BSt), Beton, Rissen, Poren und Umgebung
unterschieden werden muss. Diese Segmentierung bildet die Grundlage für statistische
Untersuchungen des Schädigungsfortschritts. Hierbei sind die Änderung
der BSt-Geometrie, die Zunahme von Korrosionsprodukten und deren Veränderung
über die Zeit sowie ihrer räumlichen Verteilung in der Probe von Interesse. Aufgrund
der Größe der CT-Bilddaten ist eine manuelle Segmentierung nicht durchführbar,
so dass automatische Verfahren unabdingbar sind. Dabei ist insbesondere
die Segmentierung der Korrosionsprodukte in den Bilddaten ein schwieriges
Problem. Allein aufgrund der Grauwerte ist eine Zuordnung nahezu unmöglich,
denn die Grauwerte von Beton und Korrosionsprodukt unterscheiden sich kaum.
Eine formbasierte Suche ist nicht offensichtlich, da die Korrosionsprodukte in Beton
diffuse Formen haben.
Allerdings lässt sich Vorwissen über die Ausbreitung der Korrosionsprodukte
nutzen. Sie bilden sich in räumlicher Nähe des BSt (in Bereichen vorheriger
Volumenabnahme des BSt), entlang von Rissen sowie in Porenräumen, die direkt
am BSt und in dessen Nahbereich liegen. Davon ausgehend wird vor der
Korrosionsprodukterkennung zunächst eine BSt-Volumen-, Riss- und Porenerkennung
durchgeführt. Dieser in der Arbeit näher beschriebene Schritt erlaubt es, halbautomatisch
Startpunkte (Seed Points) für die Korrosionsprodukterkennung zu
finden. Weiterhin werden verschiedene in der Bildverarbeitung bekannte
Algorithmen auf ihre Eignung untersucht werden.
Introduction – Many biological structures show recurring tiling patterns on one structural level or the other. Current image acquisition techniques are able to resolve those tiling patterns to allow quantitative analyses. The resulting image data, however, may contain an enormous number of elements. This renders manual image analysis infeasible, in particular when statistical analysis is to be conducted, requiring a larger number of image data to be analyzed. As a consequence, the analysis process needs to be automated to a large degree. In this paper, we describe a multi-step image segmentation pipeline for the automated segmentation of the calcified cartilage into individual tesserae from computed tomography images of skeletal elements of stingrays.
Methods – Besides applying state-of-the-art algorithms like anisotropic diffusion smoothing, local thresholding for foreground segmentation, distance map calculation, and hierarchical watershed, we exploit a graph-based representation for fast correction of the segmentation. In addition, we propose a new distance map that is computed only in the plane that locally best approximates the calcified cartilage. This distance map drastically improves the separation of individual tesserae. We apply our segmentation pipeline to hyomandibulae from three individuals of the round stingray (Urobatis halleri), varying both in age and size.
Results – Each of the hyomandibula datasets contains approximately 3000 tesserae. To evaluate the quality of the automated segmentation, four expert users manually generated ground truth segmentations of small parts of one hyomandibula. These ground truth segmentations allowed us to compare the segmentation quality w.r.t. individual tesserae. Additionally, to investigate the segmentation quality of whole skeletal elements, landmarks were manually placed on all tesserae and their positions were then compared to the segmented tesserae. With the proposed segmentation pipeline, we sped up the processing of a single skeletal element from days or weeks to a few hours.
From Image Data to Three-Dimensional Models - Case Studies on the Impact of 3D Patient Models
(2002)
Dual Streamline Seeding
(2009)
In civil engineering, the corrosion of steel reinforcements in structural elements of concrete bares a risk of
stability-reduction, mainly caused by the exposure to chlorides. 3D computed tomography (CT) reveals the inner
structure of concrete and allows one to investigate the corrosion with non-destructive testing methods. To carry
out such investigations, specimens with a large artificial crack and an embedded steel rebar have been
manufactured. 3D CT images of those specimens were acquired in the original state. Subsequently three cycles
of electrochemical pre-damaging together with CT imaging were applied. These time series have been evaluated
by means of image processing algorithms to segment and quantify the corrosion products. Visualization of the
results supports the understanding of how corrosion propagates into cracks and pores. Furthermore, pitting of
structural elements can be seen without dismantling. In this work, several image processing and visualization
techniques are presented that have turned out to be particularly effective for the visualization and segmentation
of corrosion products. Their combination to a workflow for corrosion analysis is the main contribution of this
work.
An intuitive and sparse representation of the void space of porous materials supports the efficient analysis and visualization of interesting qualitative and quantitative parameters of such materials. We introduce definitions of the elements of this void space, here called pore space, based on its distance function, and present methods to extract these elements using the extremal structures of the distance function. The presented methods are implemented by an image processing pipeline that determines pore centers, pore paths and pore constrictions. These pore space elements build a graph that represents the topology of the pore space in a compact way. The representations we derive from μCT image data of realistic soil specimens enable the computation of many statistical parameters and, thus, provide a basis for further visual analysis and application-specific developments. We introduced parts of our pipeline in previous work. In this chapter, we present additional details and compare our results with the analytic computation of the pore space elements for a sphere packing in order to show the correctness of our graph computation.
Adapting trabecular structures for 3D printing: an image processing approach based on µCT data
(2017)
Materials with a trabecular structure notably combine advantages such as lightweight, reasonable strength, and permeability for fluids. This combination of advantages is especially interesting for tissue engineering in trauma surgery and orthopedics. Bone-substituting scaffolds for instance are designed with a trabecular structure in order to allow cell migration for bone ingrowth and vascularization. An emerging and recently very popular technology to produce such complex, porous structures is 3D printing. However, several technological aspects regarding the scaffold architecture, the printable resolution, and the feature size have to be considered when fabricating scaffolds for bone tissue replacement and regeneration.
Here, we present a strategy to assess and prepare realistic trabecular structures for 3D printing using image analysis with the aim of preserving the structural elements. We discuss critical conditions of the printing system and present a 3-stage approach to adapt a trabecular structure from $\mu$CT data while incorporating knowledge about the printing system. In the first stage, an image-based extraction of solid and void structures is performed, which results in voxel- and graph-based representations of the extracted structures. These representations not only allow us to quantify geometrical properties such as pore size or strut geometry and length. But, since the graph represents the geometry and the topology of the initial structure, it can be used in the second stage to modify and adjust feature size, volume and sample size in an easy and consistent way. In the final reconstruction stage, the graph is then converted into a voxel representation preserving the topology of the initial structure. This stage generates a model with respect to the printing conditions to ensure a stable and controlled voxel placement during the printing process.
The mitotic spindle ensures the faithful segregation of chromosomes. Here we combine the first large-scale serial electron tomography of whole mitotic spindles in early C. elegans embryos with live-cell imaging to reconstruct all microtubules in 3D and identify their plus- and minus-ends. We classify them as kinetochore (KMTs), spindle (SMTs) or astral microtubules (AMTs) according to their positions, and quantify distinct properties of each class. While our light microscopy and mutant studies show that microtubules are nucleated from the centrosomes, we find only a few KMTs directly connected to the centrosomes. Indeed, by quantitatively analysing several models of microtubule growth, we conclude that minus-ends of KMTs have selectively detached and depolymerized from the centrosome. In toto, our results show that the connection between centrosomes and chromosomes is mediated by an anchoring into the entire spindle network and that any direct connections through KMTs are few and likely very transient.
Adapting trabecular structures for 3D printing: an image processing approach based on µCT data
(2017)
Materials with a trabecular structure notably combine advantages such as lightweight, reasonable strength, and permeability for fluids. This combination of advantages is especially interesting for tissue engineering in trauma surgery and orthopedics. Bone-substituting scaffolds for instance are designed with a trabecular structure in order to allow cell migration for bone ingrowth and vascularization. An emerging and recently very popular technology to produce such complex, porous structures is 3D printing. However, several technological aspects regarding the scaffold architecture, the printable resolution, and the feature size have to be considered when fabricating scaffolds for bone tissue replacement and regeneration.
Here, we present a strategy to assess and prepare realistic trabecular structures for 3D printing using image analysis with the aim of preserving the structural elements. We discuss critical conditions of the printing system and present a 3-stage approach to adapt a trabecular structure from $\mu$CT data while incorporating knowledge about the printing system. In the first stage, an image-based extraction of solid and void structures is performed, which results in voxel- and graph-based representations of the extracted structures. These representations not only allow us to quantify geometrical properties such as pore size or strut geometry and length. But, since the graph represents the geometry and the topology of the initial structure, it can be used in the second stage to modify and adjust feature size, volume and sample size in an easy and consistent way. In the final reconstruction stage, the graph is then converted into a voxel representation preserving the topology of the initial structure. This stage generates a model with respect to the printing conditions to ensure a stable and controlled voxel placement during the printing process.
The role of titanium surface nanotopography on preosteoblast morphology, adhesion and migration
(2017)
Surface structuring of titanium-based implants with appropriate nanotopographies can significantly modulate their impact on the biological behavior of cells populating these implants. Implant assisted bone tissue repair and regeneration require functional adhesion and expansion of bone progenitors. The surface nanotopography of implant materials used to support bone healing and its effect on cell behavior, in particular cell adhesion, spreading, expansion, and motility, is still not clearly understood. The aim of this study is to investigate preosteoblast proliferation, adhesion, morphology, and migration on different titanium materials with similar surface chemistry, but distinct nanotopographical features. Sonochemical treatment and anodic oxidation were employed to fabricate disordered – mesoporous titania (TMS), and ordered – titania nanotubular (TNT) topographies respectively. The morphological evaluation revealed a surface dependent shape, thickness, and spreading of cells owing to different adherence behavior. Cells were polygonal-shaped and well-spread on glass and TMS, but displayed an elongated fibroblast-like morphology on TNT surfaces. The cells on glass however, were much flatter than on nanostructured surfaces. Both nanostructured surfaces impaired cell adhesion, but TMS was more favorable for cell growth due to its support of cell attachment and spreading in contrast to TNT. Quantitative wound healing assay in combination with live-cell imaging revealed that cells seeded on TMS surfaces migrated in close proximity to neighboring cells and less directed when compared to the migratory behavior on other surfaces. The results indicate distinctly different cell adhesion and migration on ordered and disordered titania nanotopographies, providing important information that could be used in optimizing titanium-based scaffold design to foster bone tissue growth and repair.
Introduction – Many biological structures show recurring tiling patterns on one structural level or the other. Current image acquisition techniques are able to resolve those tiling patterns to allow quantitative analyses. The resulting image data, however, may contain an enormous number of elements. This renders manual image analysis infeasible, in particular when statistical analysis is to be conducted, requiring a larger number of image data to be analyzed. As a consequence, the analysis process needs to be automated to a large degree. In this paper, we describe a multi-step image segmentation pipeline for the automated segmentation of the calcified cartilage into individual tesserae from computed tomography images of skeletal elements of stingrays.
Methods – Besides applying state-of-the-art algorithms like anisotropic diffusion smoothing, local thresholding for foreground segmentation, distance map calculation, and hierarchical watershed, we exploit a graph-based representation for fast correction of the segmentation. In addition, we propose a new distance map that is computed only in the plane that locally best approximates the calcified cartilage. This distance map drastically improves the separation of individual tesserae. We apply our segmentation pipeline to hyomandibulae from three individuals of the round stingray (Urobatis halleri), varying both in age and size.
Results – Each of the hyomandibula datasets contains approximately 3000 tesserae. To evaluate the quality of the automated segmentation, four expert users manually generated ground truth segmentations of small parts of one hyomandibula. These ground truth segmentations allowed us to compare the segmentation quality w.r.t. individual tesserae. Additionally, to investigate the segmentation quality of whole skeletal elements, landmarks were manually placed on all tesserae and their positions were then compared to the segmented tesserae. With the proposed segmentation pipeline, we sped up the processing of a single skeletal element from days or weeks to a few hours.
Supplementary data to reproduce and understand key results from the related publication, including original image data and processed data. In particular, sections from hyomandibulae harvested from specimens of round stingray Urobatis halleri, donated from another study (DOI: 10.1002/etc.2564). Specimens were from sub-adults/adults collected by beach seine from collection sites in San Diego and Seal Beach, California, USA. The hyomandibulae were mounted in clay, sealed in ethanol-humidified plastic tubes and scanned with a Skyscan 1172 desktop μCT scanner (Bruker μCT, Kontich, Belgium) in association with another study (DOI: 10.1111/joa.12508). Scans for all samples were performed with voxel sizes of 4.89 μm at 59 kV source voltage and 167 μA source current, over 360◦ sample 120 rotation. For our segmentations, the datasets were resampled to a voxel size of 9.78 μm to reduce the size of the images and speed up processing. In addition, the processed data that was generated with the visualization software Amira with techniques described in the related publication based on the mentioned specimens.
Mitotic and meiotic spindles are microtubule-based structures to faithfully segregate chromosomes. Electron tomography is currently the method of choice to analyze the three-dimensional architecture of both types of spindles. Over the years, we have developed methods and software for automatic segmentation and stitching of microtubules in serial sections for large-scale reconstructions. Three-dimensional reconstruction of microtubules, however, is only the first step towards biological insight. The second step is the analysis of the structural data to derive measurable spindle properties. Here, we present a comprehensive set of techniques to quantify spindle parameters. These techniques provide quantitative analyses of specific microtubule classes and are applicable to a variety of tomographic reconstructions of spindles from different organisms.
The role of titanium surface nanotopography on preosteoblast morphology, adhesion and migration
(2017)
Surface structuring of titanium-based implants with appropriate nanotopographies can significantly modulate their impact on the biological behavior of cells populating these implants. Implant assisted bone tissue repair and regeneration require functional adhesion and expansion of bone progenitors. The surface nanotopography of implant materials used to support bone healing and its effect on cell behavior, in particular cell adhesion, spreading, expansion, and motility, is still not clearly understood. The aim of this study is to investigate preosteoblast proliferation, adhesion, morphology, and migration on different titanium materials with similar surface chemistry, but distinct nanotopographical features. Sonochemical treatment and anodic oxidation were employed to fabricate disordered – mesoporous titania (TMS), and ordered – titania nanotubular (TNT) topographies respectively. The morphological evaluation revealed a surface dependent shape, thickness, and spreading of cells owing to different adherence behavior. Cells were polygonal-shaped and well-spread on glass and TMS, but displayed an elongated fibroblast-like morphology on TNT surfaces. The cells on glass however, were much flatter than on nanostructured surfaces. Both nanostructured surfaces impaired cell adhesion, but TMS was more favorable for cell growth due to its support of cell attachment and spreading in contrast to TNT. Quantitative wound healing assay in combination with live-cell imaging revealed that cells seeded on TMS surfaces migrated in close proximity to neighboring cells and less directed when compared to the migratory behavior on other surfaces. The results indicate distinctly different cell adhesion and migration on ordered and disordered titania nanotopographies, providing important information that could be used in optimizing titanium-based scaffold design to foster bone tissue growth and repair.
The goal of quantitative photoacoustic tomography (qPAT) is to recover maps of the chromophore distributions from multiwavelength images of the initial pressure. Model-based inversions that incorporate the physical processes underlying the photoacoustic (PA) signal generation represent a promising approach. Monte-Carlo models of the light transport are computationally expensive, but provide accurate fluence distributions predictions, especially in the ballistic and quasi-ballistic regimes. Here, we focus on the inverse problem of 3D qPAT of blood oxygenation and investigate the application of the Monte-Carlo method in a model-based inversion scheme. A forward model of the light transport based on the MCX simulator and acoustic propagation modeled by the k-Wave toolbox was used to generate a PA image data set acquired in a tissue phantom over a planar detection geometry. The combination of the optical and acoustic models is shown to account for limited-view artifacts. In addition, the errors in the fluence due to, for example, partial volume artifacts and absorbers immediately adjacent to the region of interest are investigated. To accomplish large-scale inversions in 3D, the number of degrees of freedom is reduced by applying image segmentation to the initial pressure distribution to extract a limited number of regions with homogeneous optical parameters. The absorber concentration in the tissue phantom was estimated using a coordinate descent parameter search based on the comparison between measured and modeled PA spectra. The estimated relative concentrations using this approach lie within 5 % compared to the known concentrations. Finally, we discuss the feasibility of this approach to recover the blood oxygenation from experimental data.
Quantitative photoacoustic tomography (qPAT) aims to extract physiological parameters, such as blood oxygen saturation (sO2), from measured multi-wavelength image data sets. The challenge of this approach lies in the inherently nonlinear fluence distribution in the tissue, which has to be accounted for by using an appropriate model, and the large scale of the inverse problem. In addition, the accuracy of experimental and scanner-specific parameters, such as the wavelength dependence of the incident fluence, the acoustic detector response, the beam profile and divergence, needs to be considered. This study aims at quantitative imaging of blood sO2, as it has been shown to be a more robust parameter compared to absolute concentrations. We propose a Monte-Carlo–based inversion scheme in conjunction with a reduction in the number of variables achieved using image segmentation. The inversion scheme is experimentally validated in tissue-mimicking phantoms consisting of polymer tubes suspended in a scattering liquid. The tubes were filled with chromophore solutions at different concentration ratios. 3-D multi-spectral image data sets were acquired using a Fabry-Perot based PA scanner. A quantitative comparison of the measured data with the output of the forward model is presented. Parameter estimates of chromophore concentration ratios were found to be within 5 % of the true values.
Neural circuit mapping is generating datasets of tens of thousands of labeled neurons. New computational tools are needed to search and organize these data. We present NBLAST, a sensitive and rapid algorithm, for measuring pairwise neuronal similarity. NBLAST considers both position and local geometry, decomposing neurons into short segments; matched segments are scored using a probabilistic scoring matrix defined by statistics of matches and non-matches. We validated NBLAST on a published dataset of 16,129 single Drosophila neurons. NBLAST can distinguish neuronal types down to the finest level (single identified neurons) without a priori information. Cluster analysis of extensively studied neuronal classes identified new types and unreported topographical features. Fully automated clustering organized the validation dataset into 1,052 clusters, many of which map onto previously described neuronal types. NBLAST supports additional query types, including searching neurons against transgene expression patterns. Finally, we show that NBLAST is effective with data from other invertebrates and zebrafish.
In this work, we developed an automatic algorithm to analyze cell migration in chemotaxis assays, based on phase-contrast time-lapse microscopy. While manual approaches are still widely used in recent publications, our algorithm is able to track hundreds of single cells per frame. The extracted paths are analysed with traditional geometrical approaches as well as diffusion-driven Markov state models (MSM). Based on these models, a detailed view on spatial and temporal effects is possible.
Using our new approach on experimental data, we are able to distinguish between directed migration (e.g. towards a VEGF gradient) and random migration without favored direction. A calculation of the committor probabilities reveals that cells of the whole image area are more likely to migrate directly towards the VEGF than away from it during the first four hours. However, in absence of a chemoattractant, cells migrate more likely to their nearest image border. These conclusions are supported by the spatial mean directions.
In a next step, the cell-cell interaction during migration and the migration of cell clusters will be analyzed. Furthermore, we want to observe phenotypical changes during migration based on fluorescence microscopy and machine learning.
The algorithm is part of a collaborative platform which brings the experimental expertise of scientists from life sciences and the analytical knowledge of computer scientists together. This platform is built using web-based technologies with a responsive real-time user interface. All data, including raw and metadata as well as the accompanying results, will be stored in a secure and scalable compute cluster. The compute cluster provides sufficient space and computational power for modern image-based experiments and their analyses. Specific versions of data and results can be tagged to keep immutable records for archival.
Automated 3D Crack Detection for Analyzing Damage Processes in Concrete with Computed Tomography
(2012)
Identification of Descriptive Parameters of the Soil Pore Structure using Experiments and CT Data
(2010)
Quantitative PA tomography of high resolution 3-D images: experimental validation in tissue phantoms
(2020)
Quantitative photoacoustic tomography aims recover the spatial distribution of absolute chromophore concentrations and their ratios from deep tissue, high-resolution images. In this study, a model-based inversion scheme based on a Monte-Carlo light transport model is experimentally validated on 3-D multispectral images of a tissue phantom acquired using an all-optical scanner with a planar detection geometry. A calibrated absorber allowed scaling of the measured data during the inversion, while an acoustic correction method was employed to compensate the effects of limited view detection. Chromophore- and fluence-dependent step sizes and Adam optimization were implemented to achieve rapid convergence. High resolution 3-D maps of absolute concentrations and their ratios were recovered with high accuracy. Potential applications of this method include quantitative functional and molecular photoacoustic tomography of deep tissue in preclinical and clinical studies.
We present a software-assisted workflow for the alignment and matching of filamentous structures across a 3D stack of serial images. This is achieved by combining automatic methods, visual validation, and interactive correction. After an initial alignment, the user can continuously improve the result by interactively correcting landmarks or matches of filaments. Supported by a visual quality assessment of regions that have been already inspected, this allows a trade-off between quality and manual labor. The software tool was developed to investigate cell division by quantitative 3D analysis of microtubules (MTs) in both mitotic and meiotic spindles. For this, each spindle is cut into a series of semi-thick physical sections, of which electron tomograms are acquired. The serial tomograms are then stitched and non-rigidly aligned to allow tracing and connecting of MTs across tomogram boundaries. In practice, automatic stitching alone provides only an incomplete solution, because large physical distortions and a low signal-to-noise ratio often cause experimental difficulties. To derive 3D models of spindles despite the problems related to sample preparation and subsequent data collection, semi-automatic validation and correction is required to remove stitching mistakes. However, due to the large number of MTs in spindles (up to 30k) and their resulting dense spatial arrangement, a naive inspection of each MT is too time consuming. Furthermore, an interactive visualization of the full image stack is hampered by the size of the data (up to 100 GB). Here, we present a specialized, interactive, semi-automatic solution that considers all requirements for large-scale stitching of filamentous structures in serial-section image stacks. The key to our solution is a careful design of the visualization and interaction tools for each processing step to guarantee real-time response, and an optimized workflow that efficiently guides the user through datasets.
Neurons are highly polarized cells that require continuous turnover of membrane proteins at axon terminals to develop, function, and survive. Yet, it is still unclear whether membrane protein degradation requires transport back to the cell body or whether degradation also occurs locally at the axon terminal, where live observation of sorting and degradation has remained a challenge. Here, we report direct observation of two cargo-specific membrane protein degradation mechanisms at axon terminals based on a live-imaging approach in intact Drosophila brains.
We show that different acidification-sensing cargo probes are sorted into distinct classes of degradative ‘‘hub’’ compartments for synaptic vesicle proteins and plasma membrane proteins at axon terminals. Sorting and degradation of the two cargoes in the separate hubs are molecularly distinct. Local sorting of synaptic vesicle proteins for degradation at the axon terminal is, surprisingly, Rab7 independent,
whereas sorting of plasma membrane proteins is Rab7 dependent. The cathepsin-like protease CP1 is specific to synaptic vesicle hubs, and its delivery requires the vesicle SNARE neuronal synaptobrevin. Cargo separation only occurs at the axon terminal, whereas degradative compartments at the cell body are mixed. These data show that at least two local, molecularly distinct pathways sort membrane cargo for degradation specifically at the axon terminal, whereas degradation can occur both at the terminal and en route to the cell body.
In this paper, we present a software-assisted workflow for the alignment and matching of filamentous structures across a stack of 3D serial image sections. This is achieved by a combination of automatic methods, visual validation, and interactive correction. After an initial alignment, the user can continuously improve the result by interactively correcting landmarks or matches of filaments. This is supported by a quality assessment that visualizes regions that have been already inspected and, thus, allows a trade-off between quality and manual labor.
The software tool was developed in collaboration with biologists who investigate microtubule-based spindles during cell division. To quantitatively understand the structural organization of such spindles, a 3D reconstruction of the numerous microtubules is essential. Each spindle is cut into a series of semi-thick physical sections, of which electron tomograms are acquired. The sections then need to be stitched, i.e. non-rigidly aligned; and the microtubules need to be traced in each section and connected across section boundaries. Experiments led to the conclusion that automatic methods for stitching alone provide only an incomplete solution to practical analysis needs. Automatic methods may fail due to large physical distortions, a low signal-to-noise ratio of the images, or other unexpected experimental difficulties. In such situations, semi-automatic validation and correction is required to rescue as much information as possible to derive biologically meaningful results despite of some errors related to data collection.
Since the correct stitching is visually not obvious due to the number of microtubules (up to 30k) and their dense spatial arrangement, these are difficult tasks. Furthermore, a naive inspection of each microtubule is too time consuming. In addition, interactive visualization is hampered by the size of the image data (up to 100 GB). Based on the requirements of our collaborators, we present a practical solution for the semi-automatic stitching of serial section image stacks with filamentous structures.
Quantitative photoacoustic tomography aims to recover maps of the local concentrations of tissue chromophores from multispectral images. While model-based inversion schemes are promising approaches, major challenges to their practical implementation include the unknown fluence distribution and the scale of the inverse problem. This paper describes an inversion scheme based on a radiance Monte Carlo model and an adjoint-assisted gradient optimization that incorporates fluence-dependent step sizes and adaptive moment estimation. The inversion is shown to recover absolute chromophore concentrations, blood oxygen saturation and the Grüneisen parameter from in silico 3D phantom images for different radiance approximations. The scattering coefficient was assumed to be homogeneous and known a priori.
Mitotic and meiotic spindles are microtubule-based structures to faithfully segregate chromosomes. Electron tomography is currently the method of choice to analyze the three-dimensional (3D) architecture of both types of spindles. Over the years, we have developed methods and software for automatic segmentation and stitching of microtubules in serial sections for large-scale reconstructions. 3D reconstruction of microtubules, however, is only the first step toward biological insight. The second step is the analysis of the structural data to derive measurable spindle properties. Here, we present a comprehensive set of techniques to quantify spindle parameters. These techniques provide quantitative analyses of specific microtubule classes and are applicable to a variety of tomographic reconstructions of spindles from different organisms.
In oocytes of many organisms, meiotic spindles form in the absence of centrosomes [1–5]. Such female meiotic spindles have a pointed appearance in metaphase with microtubules focused at acentrosomal spindle poles. At anaphase, the microtubules of acentrosomal spindles then transition to an inter- chromosomal array, while the spindle poles disappear. This transition is currently not understood. Previous studies have focused on this inter- chromosomal microtubule array and proposed a pushing model to drive chromosome segregation [6, 7]. This model includes an end-on orientation of microtubules with chromosomes. Alternatively, chromosomes were thought to associate along bundles of microtubules [8, 9]. Starting with metaphase, this second model proposed a pure lateral chromosome-to-microtubule association up to the final meiotic stages of anaphase. Here we applied large-scale electron tomography [10] of staged C. elegans oocytes in meiosis to analyze the orientation of microtubules in respect to chromosomes. We show that microtubules at metaphase I are primarily oriented laterally to the chromosomes and that microtubules switch to an end-on orientation during progression through anaphase. We further show that this switch in microtubule orientation involves a kinesin-13 microtubule depolymerase, KLP-7, which removes laterally associated microtubules around chromosomes. From this we conclude that both lateral and end-on modes of microtubule-to-chromosome orientations are successively used in C. elegans oocytes to segregate meiotic chromosomes.
In oocytes of many organisms, meiotic spindles form in the absence
of centrosomes [1–5]. Such female meiotic spindles have a pointed appearance in metaphase with microtubules focused at acentrosomal spindle poles. At anaphase, the microtubules of acentrosomal spindles then transition to an inter- chromosomal array, while the spindle poles disappear. This transition is currently not understood. Previous studies have focused on this inter- chromosomal microtubule array and proposed a pushing model to drive chromosome segregation [6, 7]. This model includes an end-on orientation of microtubules with chromosomes. Alternatively, chromosomes were thought to associate along bundles of microtubules [8, 9]. Starting with metaphase, this second model proposed a pure lateral chromosome-to-microtubule association up to the final meiotic stages of anaphase. Here we applied large-scale electron tomography [10] of staged C. elegans oocytes in meiosis to analyze the orientation of microtubules in respect to chromosomes. We show that microtubules at metaphase I are primarily oriented laterally to the chromosomes and that microtubules switch to an end-on orientation during progression through anaphase. We further show that this switch in microtubule orientation involves a kinesin-13 microtubule depolymerase, KLP-7, which removes laterally associated microtubules around chromosomes. From this we conclude that both lateral and end-on modes of microtubule-to-chromosome orientations are successively used in C. elegans oocytes to segregate meiotic chromosomes.
Most female meiotic spindles undergo striking morphological changes while transitioning from metaphase to anaphase. The ultra-structure of meiotic spindles, and how changes to this structure correlate with such dramatic spindle rearrangements remains largely unknown. To address this, we applied light microscopy, large-scale electron tomography and mathematical modeling of female meiotic \textit{Caenorhabditis elegans} spindles. Combining these approaches, we find that meiotic spindles are dynamic arrays of short microtubules that turn over within seconds. The results show that the metaphase to anaphase transition correlates with an increase in microtubule numbers and a decrease in their average length. Detailed analysis of the tomographic data revealed that the microtubule length changes significantly during the metaphase-to-anaphase transition. This effect is most pronounced for microtubules located within 150 nm of the chromosome surface. To understand the mechanisms that drive this transition, we developed a mathematical model for the microtubule length distribution that considers microtubule growth, catastrophe, and severing. Using Bayesian inference to compare model predictions and data, we find that microtubule turn-over is the major driver of the spindle reorganizations. Our data suggest that in metaphase only a minor fraction of microtubules, those closest to the chromosomes, are severed. The large majority of microtubules, which are not in close contact with chromosomes, do not undergo severing. Instead, their length distribution is fully explained by growth and catastrophe. This suggests that the most prominent drivers of spindle rearrangements are changes in nucleation and catastrophe rate. In addition, we provide evidence that microtubule severing is dependent on katanin.
Quantitative photoacoustic tomography aims to recover maps of the local concentrations of tissue chromophores from multispectral images. While model-based inversion schemes are promising approaches, major challenges to their practical implementation include the unknown fluence distribution and the scale of the inverse problem. This paper describes an inversion scheme based on a radiance Monte Carlo model and an adjoint-assisted gradient optimization that incorporates fluence-dependent step sizes and adaptive moment estimation. The inversion is shown to recover absolute chromophore concentrations, blood oxygen saturation and the Grüneisen parameter from in silico 3D phantom images for different radiance approximations. The scattering coefficient was assumed to be homogeneous and known a priori.
Quantitative PA tomography of high resolution 3-D images: experimental validation in tissue phantoms
(2019)
Quantitative photoacoustic tomography aims recover the spatial distribution of absolute chromophore concentrations and their ratios from deep tissue, high-resolution images. In this study, a model-based inversion scheme based on a Monte-Carlo light transport model is experimentally validated on 3-D multispectral images of a tissue phantom acquired using an all-optical scanner with a planar detection geometry. A calibrated absorber allowed scaling of the measured data during the inversion, while an acoustic correction method was employed to compensate the effects of limited view detection. Chromophore- and fluence-dependent step sizes and Adam optimization were implemented to achieve rapid convergence. High resolution 3-D maps of absolute concentrations and their ratios were recovered with high accuracy. Potential applications of this method include quantitative functional and molecular photoacoustic tomography of deep tissue in preclinical and clinical studies.
This work introduces novel internal and external memory algorithms for computing voxel skeletons of massive voxel objects with complex network-like architecture and for converting these voxel skeletons to piecewise linear geometry, that is triangle meshes and piecewise straight lines. The presented techniques help to tackle the challenge of visualizing and analyzing 3d images of increasing size and complexity, which are becoming more and more important in, for example, biological and medical research. Section 2.3.1 contributes to the theoretical foundations of thinning algorithms with a discussion of homotopic thinning in the grid cell model. The grid cell model explicitly represents a cell complex built of faces, edges, and vertices shared between voxels. A characterization of pairs of cells to be deleted is much simpler than characterizations of simple voxels were before. The grid cell model resolves topologically unclear voxel configurations at junctions and locked voxel configurations causing, for example, interior voxels in sets of non-simple voxels. A general conclusion is that the grid cell model is superior to indecomposable voxels for algorithms that need detailed control of topology. Section 2.3.2 introduces a noise-insensitive measure based on the geodesic distance along the boundary to compute two-dimensional skeletons. The measure is able to retain thin object structures if they are geometrically important while ignoring noise on the object's boundary. This combination of properties is not known of other measures. The measure is also used to guide erosion in a thinning process from the boundary towards lines centered within plate-like structures. Geodesic distance based quantities seem to be well suited to robustly identify one- and two-dimensional skeletons. Chapter 6 applies the method to visualization of bone micro-architecture. Chapter 3 describes a novel geometry generation scheme for representing voxel skeletons, which retracts voxel skeletons to piecewise linear geometry per dual cube. The generated triangle meshes and graphs provide a link to geometry processing and efficient rendering of voxel skeletons. The scheme creates non-closed surfaces with boundaries, which contain fewer triangles than a representation of voxel skeletons using closed surfaces like small cubes or iso-surfaces. A conclusion is that thinking specifically about voxel skeleton configurations instead of generic voxel configurations helps to deal with the topological implications. The geometry generation is one foundation of the applications presented in Chapter 6. Chapter 5 presents a novel external memory algorithm for distance ordered homotopic thinning. The presented method extends known algorithms for computing chamfer distance transformations and thinning to execute I/O-efficiently when input is larger than the available main memory. The applied block-wise decomposition schemes are quite simple. Yet it was necessary to carefully analyze effects of block boundaries to devise globally correct external memory variants of known algorithms. In general, doing so is superior to naive block-wise processing ignoring boundary effects. Chapter 6 applies the algorithms in a novel method based on confocal microscopy for quantitative study of micro-vascular networks in the field of microcirculation.
Neural circuit mapping is generating datasets of 10,000s of labeled neurons. New computational tools are needed to search and organize these data. We present NBLAST, a sensitive and rapid algorithm, for measuring pairwise neuronal similarity. NBLAST considers both position and local geometry, decomposing neurons into short segments; matched segments are scored using a probabilistic scoring matrix defined by statistics of matches and non-matches.
We validated NBLAST on a published dataset of 16,129 single Drosophila neurons. NBLAST can distinguish neuronal types down to the finest level (single identified neurons) without a priori information. Cluster analysis of extensively studied neuronal classes identified new types and unreported topographical features. Fully automated clustering organized the validation dataset into 1052 clusters, many of which map onto previously described neuronal types. NBLAST supports additional query types including searching neurons against transgene expression patterns. Finally we show that NBLAST is effective with data from other invertebrates and zebrafish.
We present a level of detail method for trees based on ellipsoids and lines. We leverage the Expectation Maximization algorithm with a Gaussian Mixture Model to create a hierarchy of high-quality leaf clusterings, while the branches are simplified using agglomerative bottom-up clustering to preserve the connectivity. The simplification runs in a preprocessing step and requires no human interaction. For a fly by over and through a scene of 10k trees, our method renders on average at 40 ms/frame, up to 6 times faster than billboard clouds with comparable artifacts.
The goal of quantitative photoacoustic tomography (qPAT) is to recover maps of the chromophore distributions from multiwavelength images of the initial pressure. Model-based inversions that incorporate the physical processes underlying the photoacoustic (PA) signal generation represent a promising approach. Monte-Carlo models of the light transport are computationally expensive, but provide accurate fluence distributions predictions, especially in the ballistic and quasi-ballistic regimes. Here, we focus on the inverse problem of 3D qPAT of blood oxygenation and investigate the application of the Monte-Carlo method in a model-based inversion scheme. A forward model of the light transport based on the MCX simulator and acoustic propagation modeled by the k-Wave toolbox was used to generate a PA image data set acquired in a tissue phantom over a planar detection geometry. The combination of the optical and acoustic models is shown to account for limited-view artifacts. In addition, the errors in the fluence due to, for example, partial volume artifacts and absorbers immediately adjacent to the region of interest are investigated. To accomplish large-scale inversions in 3D, the number of degrees of freedom is reduced by applying image segmentation to the initial pressure distribution to extract a limited number of regions with homogeneous optical parameters. The absorber concentration in the tissue phantom was estimated using a coordinate descent parameter search based on the comparison between measured and modeled PA spectra. The estimated relative concentrations using this approach lie within 5 % compared to the known concentrations. Finally, we discuss the feasibility of this approach to recover the blood oxygenation from experimental data.
We present iCon.text, a kiosk platform for the iPad centered around artefacts, whose content and layout can be tailored without programming skills for specific museum exhibitions. The central metaphor to access information is a virtual postcard with one front and a customizable number of back sides that provide details about exhibits to museum visitors in textual and image form. Back sides can link to others cards. Access to these postcards is possible through one or more navigation views that can be navigated to from a navigation bar.
The entry point to the application is designed as a multitouch interactive pile of cards in a playful manner that allows visitors of any age an easy approach to the presentation and interaction metaphor. To directly access a certain postcard, a mosaic view can be uitilized to provide an overview about all available exhibits. A category view groups postcards into themes. Locating artefacts on a zoomable map or exhibition floor plan allows for conveying information about spatial contexts between different objects and their location. Furthermore, contexts can be illustrated with a two stage view comprising an overview and corresponding detail views to provide further insights into the spatial, temporal, and thematic contexts of artefacts. The application scaffolding allows the design of bilingual presentations to support exhibitions with an international audience. The logo of the presenting institution or exhibition can be incorporated to display the the kiosk's corporate design branding and to access an imprint or further informations. Usage is logged into files to provide a basis for extracting statistical information about the usage.
The details about the exhibits are presented as images and as such impose no limit to the design choices made by the content provider or exhibition designer.
The application (enhanced with a panoramic view) has been integrated successfully into a large special exhibition about the ancient city of Pergamon 2011/2012 at the Pergamon Museum Berlin within the interdisciplinary project "Berlin Sculpture Network".