Refine
Year of publication
Document Type
- In Proceedings (42)
- Article (36)
- ZIB-Report (19)
- In Collection (3)
- Other (2)
- Book chapter (1)
- Doctoral Thesis (1)
- Poster (1)
- Research data (1)
Keywords
- model-based inversion (3)
- Monte Carlo (2)
- blood oxygen saturation (2)
- inverse problem (2)
- quantitative photoacoustic imaging (2)
- spectral unmixing (2)
- 2-photon microscopy (1)
- 2D distance map (1)
- Amira (1)
- Beton (1)
Institute
- Visual and Data-centric Computing (105)
- Visual Data Analysis (103)
- Image Analysis in Biology and Materials Science (72)
- Visual Data Analysis in Science and Engineering (26)
- Therapy Planning (17)
- Numerical Mathematics (2)
- Vergleichende Visualisierung (2)
- Distributed Algorithms and Supercomputing (1)
- ZIB Allgemein (1)
Identification of Descriptive Parameters of the Soil Pore Structure using Experiments and CT Data
(2010)
Quantitative PA tomography of high resolution 3-D images: experimental validation in tissue phantoms
(2020)
Quantitative photoacoustic tomography aims recover the spatial distribution of absolute chromophore concentrations and their ratios from deep tissue, high-resolution images. In this study, a model-based inversion scheme based on a Monte-Carlo light transport model is experimentally validated on 3-D multispectral images of a tissue phantom acquired using an all-optical scanner with a planar detection geometry. A calibrated absorber allowed scaling of the measured data during the inversion, while an acoustic correction method was employed to compensate the effects of limited view detection. Chromophore- and fluence-dependent step sizes and Adam optimization were implemented to achieve rapid convergence. High resolution 3-D maps of absolute concentrations and their ratios were recovered with high accuracy. Potential applications of this method include quantitative functional and molecular photoacoustic tomography of deep tissue in preclinical and clinical studies.
Quantitative photoacoustic tomography aims to recover maps of the local concentrations of tissue chromophores from multispectral images. While model-based inversion schemes are promising approaches, major challenges to their practical implementation include the unknown fluence distribution and the scale of the inverse problem. This paper describes an inversion scheme based on a radiance Monte Carlo model and an adjoint-assisted gradient optimization that incorporates fluence-dependent step sizes and adaptive moment estimation. The inversion is shown to recover absolute chromophore concentrations, blood oxygen saturation and the Grüneisen parameter from in silico 3D phantom images for different radiance approximations. The scattering coefficient was assumed to be homogeneous and known a priori.
Quantitative photoacoustic tomography aims to recover maps of the local concentrations of tissue chromophores from multispectral images. While model-based inversion schemes are promising approaches, major challenges to their practical implementation include the unknown fluence distribution and the scale of the inverse problem. This paper describes an inversion scheme based on a radiance Monte Carlo model and an adjoint-assisted gradient optimization that incorporates fluence-dependent step sizes and adaptive moment estimation. The inversion is shown to recover absolute chromophore concentrations, blood oxygen saturation and the Grüneisen parameter from in silico 3D phantom images for different radiance approximations. The scattering coefficient was assumed to be homogeneous and known a priori.
Quantitative PA tomography of high resolution 3-D images: experimental validation in tissue phantoms
(2019)
Quantitative photoacoustic tomography aims recover the spatial distribution of absolute chromophore concentrations and their ratios from deep tissue, high-resolution images. In this study, a model-based inversion scheme based on a Monte-Carlo light transport model is experimentally validated on 3-D multispectral images of a tissue phantom acquired using an all-optical scanner with a planar detection geometry. A calibrated absorber allowed scaling of the measured data during the inversion, while an acoustic correction method was employed to compensate the effects of limited view detection. Chromophore- and fluence-dependent step sizes and Adam optimization were implemented to achieve rapid convergence. High resolution 3-D maps of absolute concentrations and their ratios were recovered with high accuracy. Potential applications of this method include quantitative functional and molecular photoacoustic tomography of deep tissue in preclinical and clinical studies.
Quantitative photoacoustic tomography (qPAT) aims to extract physiological parameters, such as blood oxygen saturation (sO2), from measured multi-wavelength image data sets. The challenge of this approach lies in the inherently nonlinear fluence distribution in the tissue, which has to be accounted for by using an appropriate model, and the large scale of the inverse problem. In addition, the accuracy of experimental and scanner-specific parameters, such as the wavelength dependence of the incident fluence, the acoustic detector response, the beam profile and divergence, needs to be considered. This study aims at quantitative imaging of blood sO2, as it has been shown to be a more robust parameter compared to absolute concentrations. We propose a Monte-Carlo–based inversion scheme in conjunction with a reduction in the number of variables achieved using image segmentation. The inversion scheme is experimentally validated in tissue-mimicking phantoms consisting of polymer tubes suspended in a scattering liquid. The tubes were filled with chromophore solutions at different concentration ratios. 3-D multi-spectral image data sets were acquired using a Fabry-Perot based PA scanner. A quantitative comparison of the measured data with the output of the forward model is presented. Parameter estimates of chromophore concentration ratios were found to be within 5 % of the true values.
We present a level of detail method for trees based on ellipsoids and lines. We leverage the Expectation Maximization algorithm with a Gaussian Mixture Model to create a hierarchy of high-quality leaf clusterings, while the branches are simplified using agglomerative bottom-up clustering to preserve the connectivity. The simplification runs in a preprocessing step and requires no human interaction. For a fly by over and through a scene of 10k trees, our method renders on average at 40 ms/frame, up to 6 times faster than billboard clouds with comparable artifacts.
Neural circuit mapping is generating datasets of tens of thousands of labeled neurons. New computational tools are needed to search and organize these data. We present NBLAST, a sensitive and rapid algorithm, for measuring pairwise neuronal similarity. NBLAST considers both position and local geometry, decomposing neurons into short segments; matched segments are scored using a probabilistic scoring matrix defined by statistics of matches and non-matches. We validated NBLAST on a published dataset of 16,129 single Drosophila neurons. NBLAST can distinguish neuronal types down to the finest level (single identified neurons) without a priori information. Cluster analysis of extensively studied neuronal classes identified new types and unreported topographical features. Fully automated clustering organized the validation dataset into 1,052 clusters, many of which map onto previously described neuronal types. NBLAST supports additional query types, including searching neurons against transgene expression patterns. Finally, we show that NBLAST is effective with data from other invertebrates and zebrafish.
Neural circuit mapping is generating datasets of 10,000s of labeled neurons. New computational tools are needed to search and organize these data. We present NBLAST, a sensitive and rapid algorithm, for measuring pairwise neuronal similarity. NBLAST considers both position and local geometry, decomposing neurons into short segments; matched segments are scored using a probabilistic scoring matrix defined by statistics of matches and non-matches.
We validated NBLAST on a published dataset of 16,129 single Drosophila neurons. NBLAST can distinguish neuronal types down to the finest level (single identified neurons) without a priori information. Cluster analysis of extensively studied neuronal classes identified new types and unreported topographical features. Fully automated clustering organized the validation dataset into 1052 clusters, many of which map onto previously described neuronal types. NBLAST supports additional query types including searching neurons against transgene expression patterns. Finally we show that NBLAST is effective with data from other invertebrates and zebrafish.
From Image Data to Three-Dimensional Models - Case Studies on the Impact of 3D Patient Models
(2002)
Purpose/Aims of the Study: Bone’s hierarchical structure can be visualized using a variety of methods. Many techniques, such as light and electron microscopy generate two-dimensional (2D) images, while micro computed tomography (μCT) allows a direct representation of the three-dimensional (3D) structure. In addition, different methods provide complementary structural information, such as the arrangement of organic or inorganic compounds. The overall aim of the present study is to answer bone research questions by linking information of different 2D and 3D imaging techniques. A great challenge in combining different methods arises from the fact that they usually reflect different characteristics of the real structure.
Materials and Methods: We investigated bone during healing by means of μCT and a couple of 2D methods. Backscattered electron images were used to qualitatively evaluate the tissue’s calcium content and served as a position map for other experimental data. Nanoindentation and X-ray scattering experiments were performed to visualize mechanical and structural properties. Results: We present an approach for the registration of 2D data in a 3D μCT reference frame, where scanning electron microscopies serve as a methodic link. Backscattered electron images are perfectly suited for registration into μCT reference frames, since both show structures based on the same physical principles. We introduce specific registration tools that have been developed to perform the registration process in a semi-automatic way.
Conclusions: By applying this routine, we were able to exactly locate structural information (e.g. mineral particle properties) in the 3D bone volume. In bone healing studies this will help to better understand basic formation, remodeling and mineralization processes.
Adapting trabecular structures for 3D printing: an image processing approach based on µCT data
(2017)
Materials with a trabecular structure notably combine advantages such as lightweight, reasonable strength, and permeability for fluids. This combination of advantages is especially interesting for tissue engineering in trauma surgery and orthopedics. Bone-substituting scaffolds for instance are designed with a trabecular structure in order to allow cell migration for bone ingrowth and vascularization. An emerging and recently very popular technology to produce such complex, porous structures is 3D printing. However, several technological aspects regarding the scaffold architecture, the printable resolution, and the feature size have to be considered when fabricating scaffolds for bone tissue replacement and regeneration.
Here, we present a strategy to assess and prepare realistic trabecular structures for 3D printing using image analysis with the aim of preserving the structural elements. We discuss critical conditions of the printing system and present a 3-stage approach to adapt a trabecular structure from $\mu$CT data while incorporating knowledge about the printing system. In the first stage, an image-based extraction of solid and void structures is performed, which results in voxel- and graph-based representations of the extracted structures. These representations not only allow us to quantify geometrical properties such as pore size or strut geometry and length. But, since the graph represents the geometry and the topology of the initial structure, it can be used in the second stage to modify and adjust feature size, volume and sample size in an easy and consistent way. In the final reconstruction stage, the graph is then converted into a voxel representation preserving the topology of the initial structure. This stage generates a model with respect to the printing conditions to ensure a stable and controlled voxel placement during the printing process.
Adapting trabecular structures for 3D printing: an image processing approach based on µCT data
(2017)
Materials with a trabecular structure notably combine advantages such as lightweight, reasonable strength, and permeability for fluids. This combination of advantages is especially interesting for tissue engineering in trauma surgery and orthopedics. Bone-substituting scaffolds for instance are designed with a trabecular structure in order to allow cell migration for bone ingrowth and vascularization. An emerging and recently very popular technology to produce such complex, porous structures is 3D printing. However, several technological aspects regarding the scaffold architecture, the printable resolution, and the feature size have to be considered when fabricating scaffolds for bone tissue replacement and regeneration.
Here, we present a strategy to assess and prepare realistic trabecular structures for 3D printing using image analysis with the aim of preserving the structural elements. We discuss critical conditions of the printing system and present a 3-stage approach to adapt a trabecular structure from $\mu$CT data while incorporating knowledge about the printing system. In the first stage, an image-based extraction of solid and void structures is performed, which results in voxel- and graph-based representations of the extracted structures. These representations not only allow us to quantify geometrical properties such as pore size or strut geometry and length. But, since the graph represents the geometry and the topology of the initial structure, it can be used in the second stage to modify and adjust feature size, volume and sample size in an easy and consistent way. In the final reconstruction stage, the graph is then converted into a voxel representation preserving the topology of the initial structure. This stage generates a model with respect to the printing conditions to ensure a stable and controlled voxel placement during the printing process.
An intuitive and sparse representation of the void space of porous materials supports the efficient analysis and visualization of interesting qualitative and quantitative parameters of such materials. We introduce definitions of the elements of this void space, here called pore space, based on its distance function, and present methods to extract these elements using the extremal structures of the distance function. The presented methods are implemented by an image processing pipeline that determines pore centers, pore paths and pore constrictions. These pore space elements build a graph that represents the topology of the pore space in a compact way. The representations we derive from μCT image data of realistic soil specimens enable the computation of many statistical parameters and, thus, provide a basis for further visual analysis and application-specific developments. We introduced parts of our pipeline in previous work. In this chapter, we present additional details and compare our results with the analytic computation of the pore space elements for a sphere packing in order to show the correctness of our graph computation.
Neurons are highly polarized cells that require continuous turnover of membrane proteins at axon terminals to develop, function, and survive. Yet, it is still unclear whether membrane protein degradation requires transport back to the cell body or whether degradation also occurs locally at the axon terminal, where live observation of sorting and degradation has remained a challenge. Here, we report direct observation of two cargo-specific membrane protein degradation mechanisms at axon terminals based on a live-imaging approach in intact Drosophila brains.
We show that different acidification-sensing cargo probes are sorted into distinct classes of degradative ‘‘hub’’ compartments for synaptic vesicle proteins and plasma membrane proteins at axon terminals. Sorting and degradation of the two cargoes in the separate hubs are molecularly distinct. Local sorting of synaptic vesicle proteins for degradation at the axon terminal is, surprisingly, Rab7 independent,
whereas sorting of plasma membrane proteins is Rab7 dependent. The cathepsin-like protease CP1 is specific to synaptic vesicle hubs, and its delivery requires the vesicle SNARE neuronal synaptobrevin. Cargo separation only occurs at the axon terminal, whereas degradative compartments at the cell body are mixed. These data show that at least two local, molecularly distinct pathways sort membrane cargo for degradation specifically at the axon terminal, whereas degradation can occur both at the terminal and en route to the cell body.
The goal of quantitative photoacoustic tomography (qPAT) is to recover maps of the chromophore distributions from multiwavelength images of the initial pressure. Model-based inversions that incorporate the physical processes underlying the photoacoustic (PA) signal generation represent a promising approach. Monte-Carlo models of the light transport are computationally expensive, but provide accurate fluence distributions predictions, especially in the ballistic and quasi-ballistic regimes. Here, we focus on the inverse problem of 3D qPAT of blood oxygenation and investigate the application of the Monte-Carlo method in a model-based inversion scheme. A forward model of the light transport based on the MCX simulator and acoustic propagation modeled by the k-Wave toolbox was used to generate a PA image data set acquired in a tissue phantom over a planar detection geometry. The combination of the optical and acoustic models is shown to account for limited-view artifacts. In addition, the errors in the fluence due to, for example, partial volume artifacts and absorbers immediately adjacent to the region of interest are investigated. To accomplish large-scale inversions in 3D, the number of degrees of freedom is reduced by applying image segmentation to the initial pressure distribution to extract a limited number of regions with homogeneous optical parameters. The absorber concentration in the tissue phantom was estimated using a coordinate descent parameter search based on the comparison between measured and modeled PA spectra. The estimated relative concentrations using this approach lie within 5 % compared to the known concentrations. Finally, we discuss the feasibility of this approach to recover the blood oxygenation from experimental data.
The goal of quantitative photoacoustic tomography (qPAT) is to recover maps of the chromophore distributions from multiwavelength images of the initial pressure. Model-based inversions that incorporate the physical processes underlying the photoacoustic (PA) signal generation represent a promising approach. Monte-Carlo models of the light transport are computationally expensive, but provide accurate fluence distributions predictions, especially in the ballistic and quasi-ballistic regimes. Here, we focus on the inverse problem of 3D qPAT of blood oxygenation and investigate the application of the Monte-Carlo method in a model-based inversion scheme. A forward model of the light transport based on the MCX simulator and acoustic propagation modeled by the k-Wave toolbox was used to generate a PA image data set acquired in a tissue phantom over a planar detection geometry. The combination of the optical and acoustic models is shown to account for limited-view artifacts. In addition, the errors in the fluence due to, for example, partial volume artifacts and absorbers immediately adjacent to the region of interest are investigated. To accomplish large-scale inversions in 3D, the number of degrees of freedom is reduced by applying image segmentation to the initial pressure distribution to extract a limited number of regions with homogeneous optical parameters. The absorber concentration in the tissue phantom was estimated using a coordinate descent parameter search based on the comparison between measured and modeled PA spectra. The estimated relative concentrations using this approach lie within 5 % compared to the known concentrations. Finally, we discuss the feasibility of this approach to recover the blood oxygenation from experimental data.
We present iCon.text, a kiosk platform for the iPad centered around artefacts, whose content and layout can be tailored without programming skills for specific museum exhibitions. The central metaphor to access information is a virtual postcard with one front and a customizable number of back sides that provide details about exhibits to museum visitors in textual and image form. Back sides can link to others cards. Access to these postcards is possible through one or more navigation views that can be navigated to from a navigation bar.
The entry point to the application is designed as a multitouch interactive pile of cards in a playful manner that allows visitors of any age an easy approach to the presentation and interaction metaphor. To directly access a certain postcard, a mosaic view can be uitilized to provide an overview about all available exhibits. A category view groups postcards into themes. Locating artefacts on a zoomable map or exhibition floor plan allows for conveying information about spatial contexts between different objects and their location. Furthermore, contexts can be illustrated with a two stage view comprising an overview and corresponding detail views to provide further insights into the spatial, temporal, and thematic contexts of artefacts. The application scaffolding allows the design of bilingual presentations to support exhibitions with an international audience. The logo of the presenting institution or exhibition can be incorporated to display the the kiosk's corporate design branding and to access an imprint or further informations. Usage is logged into files to provide a basis for extracting statistical information about the usage.
The details about the exhibits are presented as images and as such impose no limit to the design choices made by the content provider or exhibition designer.
The application (enhanced with a panoramic view) has been integrated successfully into a large special exhibition about the ancient city of Pergamon 2011/2012 at the Pergamon Museum Berlin within the interdisciplinary project "Berlin Sculpture Network".
Introduction – Many biological structures show recurring tiling patterns on one structural level or the other. Current image acquisition techniques are able to resolve those tiling patterns to allow quantitative analyses. The resulting image data, however, may contain an enormous number of elements. This renders manual image analysis infeasible, in particular when statistical analysis is to be conducted, requiring a larger number of image data to be analyzed. As a consequence, the analysis process needs to be automated to a large degree. In this paper, we describe a multi-step image segmentation pipeline for the automated segmentation of the calcified cartilage into individual tesserae from computed tomography images of skeletal elements of stingrays.
Methods – Besides applying state-of-the-art algorithms like anisotropic diffusion smoothing, local thresholding for foreground segmentation, distance map calculation, and hierarchical watershed, we exploit a graph-based representation for fast correction of the segmentation. In addition, we propose a new distance map that is computed only in the plane that locally best approximates the calcified cartilage. This distance map drastically improves the separation of individual tesserae. We apply our segmentation pipeline to hyomandibulae from three individuals of the round stingray (Urobatis halleri), varying both in age and size.
Results – Each of the hyomandibula datasets contains approximately 3000 tesserae. To evaluate the quality of the automated segmentation, four expert users manually generated ground truth segmentations of small parts of one hyomandibula. These ground truth segmentations allowed us to compare the segmentation quality w.r.t. individual tesserae. Additionally, to investigate the segmentation quality of whole skeletal elements, landmarks were manually placed on all tesserae and their positions were then compared to the segmented tesserae. With the proposed segmentation pipeline, we sped up the processing of a single skeletal element from days or weeks to a few hours.
Introduction – Many biological structures show recurring tiling patterns on one structural level or the other. Current image acquisition techniques are able to resolve those tiling patterns to allow quantitative analyses. The resulting image data, however, may contain an enormous number of elements. This renders manual image analysis infeasible, in particular when statistical analysis is to be conducted, requiring a larger number of image data to be analyzed. As a consequence, the analysis process needs to be automated to a large degree. In this paper, we describe a multi-step image segmentation pipeline for the automated segmentation of the calcified cartilage into individual tesserae from computed tomography images of skeletal elements of stingrays.
Methods – Besides applying state-of-the-art algorithms like anisotropic diffusion smoothing, local thresholding for foreground segmentation, distance map calculation, and hierarchical watershed, we exploit a graph-based representation for fast correction of the segmentation. In addition, we propose a new distance map that is computed only in the plane that locally best approximates the calcified cartilage. This distance map drastically improves the separation of individual tesserae. We apply our segmentation pipeline to hyomandibulae from three individuals of the round stingray (Urobatis halleri), varying both in age and size.
Results – Each of the hyomandibula datasets contains approximately 3000 tesserae. To evaluate the quality of the automated segmentation, four expert users manually generated ground truth segmentations of small parts of one hyomandibula. These ground truth segmentations allowed us to compare the segmentation quality w.r.t. individual tesserae. Additionally, to investigate the segmentation quality of whole skeletal elements, landmarks were manually placed on all tesserae and their positions were then compared to the segmented tesserae. With the proposed segmentation pipeline, we sped up the processing of a single skeletal element from days or weeks to a few hours.
Supplementary data to reproduce and understand key results from the related publication, including original image data and processed data. In particular, sections from hyomandibulae harvested from specimens of round stingray Urobatis halleri, donated from another study (DOI: 10.1002/etc.2564). Specimens were from sub-adults/adults collected by beach seine from collection sites in San Diego and Seal Beach, California, USA. The hyomandibulae were mounted in clay, sealed in ethanol-humidified plastic tubes and scanned with a Skyscan 1172 desktop μCT scanner (Bruker μCT, Kontich, Belgium) in association with another study (DOI: 10.1111/joa.12508). Scans for all samples were performed with voxel sizes of 4.89 μm at 59 kV source voltage and 167 μA source current, over 360◦ sample 120 rotation. For our segmentations, the datasets were resampled to a voxel size of 9.78 μm to reduce the size of the images and speed up processing. In addition, the processed data that was generated with the visualization software Amira with techniques described in the related publication based on the mentioned specimens.
Im Rahmen der biomechanischen Simulation knöcherner Organe ist die Frage nach einer befriedigenden Materialbeschreibung nach wie vor ungelöst. Computertomographische Datensätze liefern eine räumliche Verteilung der (Röntgen-)Dichte und ermöglichen damit eine gute Darstellung der individuellen Geometrie. Weiter können die verschiedenen Materialbestandteile des Knochens, Spongiosa und Kortikalis, voneinander getrennt werden. Aber die richtungsabängige Information der Materialanisotropie ist verloren. In dieser Arbeit wird ein Ansatz für eine anisotrope Materialbeschreibung vorgestellt, die es ermöglicht, den Einfluss der individuellen knöchernen Struktur auf das makroskopische Materialverhalten abzuschätzen.