Baum, Daniel
Refine
Year of publication
Document Type
- Article (67)
- ZIB-Report (28)
- In Proceedings (24)
- Poster (6)
- Research data (5)
- In Collection (2)
- Book chapter (1)
- Doctoral Thesis (1)
- Master's Thesis (1)
- Software (1)
Is part of the Bibliography
- no (136)
Keywords
- 2D distance map (1)
- Amira (1)
- Beton (1)
- Bildverarbeitung (1)
- Bron-Kerbosch algorithm (1)
- Computertomografie (1)
- Cultural Heritage (1)
- DNA (1)
- Geometry processing (1)
- HCI (1)
A prerequisite for many analysis tasks in modern comparative biology is the segmentation of 3-dimensional (3D) images of the specimens being investigated (e.g. from microCT data). Depending on the specific imaging technique that was used to acquire the images and on the image resolution, different segmentation tools will be required. While some standard tools exist that can often be applied for specific subtasks, building whole processing pipelines solely from standard tools is often difficult. Some tasks may even necessitate the implementation of manual interaction tools to achieve a quality that is sufficient for the subsequent analysis. In this work, we present a pipeline of segmentation tools that can be used for the semi-automatic segmentation and quantitative analysis of voids in tissue (i.e. internal structural porosity). We use this pipeline to analyze lacuno-canalicular networks in stingray tesserae from 3D images acquired with synchrotron microCT.
* The first step of this processing pipeline, the segmentation of the tesserae, was performed using standard marker-based watershed segmentation. The efficient processing of the next two steps, that is, the segmentation of all lacunae spaces belonging to a specific tessera and the separation of these spaces into individual lacunae required modern, recently developed tools.
* For proofreading, we developed a graph-based interactive method that allowed us to quickly split lacunae that were accidentally merged, and to merge lacunae that were wrongly split.
* Finally, the tesserae and their corresponding lacunae were subdivided into anatomical regions of interest (structural wedges) using a semi- manual approach.
An advantageous property of mesh-based geometric morphometrics (GM) towards landmark-based approaches, is the possibility of precisely examining highly irregular shapes and highly topographic surfaces. In case of spherical-harmonics-based GM the main requirement is a completely closed mesh surface, which often is not given, especially when dealing with natural objects. Here we present a methodological workflow to prepare 3D segmentations containing large cavity openings for the conduction of spherical-harmonics-based GM. This will be exemplified with a case study on claws of hermit crabs (Paguroidea, Decapoda, Crustacea), whereby joint openings – between manus and “movable finger” – typify the large-cavity-opening problem. We found a methodology including an ambient-occlusion-based segmentation algorithm leading to results precise and suitable to study the inter- and intraspecific differences in shape of hermit crab claws. Statistical analyses showed a significant separation between all examined diogenid and pagurid claws, whereas the separation between all left and right claws did not show significance. Additionally, the procedure offers other benefits. It is easy to reproduce and creates sparse variance in the data, closures integrate smoothly into the total structures and the algorithm saves a significant amount of time.
In most vertebrates the embryonic cartilaginous skeleton is replaced by bone during development. During this process, cartilage cells (chondrocytes) mineralize the extracellular matrix and undergo apoptosis, giving way to bone cells (osteocytes). In contrast, sharks and rays (elasmobranchs) have cartilaginous skeletons throughout life, where only the surface mineralizes, forming a layer of tiles (tesserae). Elasmobranch chondrocytes, unlike those of other vertebrates, survive cartilage mineralization and are maintained alive in spaces (lacunae) within tesserae. However, the function(s) of the chondrocytes in the mineralized tissue remain unknown. Applying a custom analysis workflow to high-resolution synchrotron microCT scans of tesserae, we characterize the morphologies and arrangements of stingray chondrocyte lacunae, using lacunar morphology as a proxy for chondrocyte morphology. We show that the cell density is comparable in unmineralized and mineralized tissue from our study species and that cells maintain the similar volume even when they have been incorporated into tesserae. This discovery supports previous hypotheses that elasmobranch chondrocytes, unlike those of other taxa, do not proliferate, hypertrophy or undergo apoptosis during mineralization. Tessera lacunae show zonal variation in their shapes—being flatter further from and more spherical closer to the unmineralized cartilage matrix and larger in the center of tesserae— and show pronounced organization into parallel layers and strong orientation toward neighboring tesserae. Tesserae also exhibit local variation in lacunar density, with the density considerably higher near pores passing through the tesseral layer, suggesting pores and cells interact (e.g. that pores contain a nutrient source). We hypothesize that the different lacunar types reflect the stages of the tesserae formation process, while also representing local variation in tissue architecture and cell function. Lacunae are linked by small passages (canaliculi) in the matrix to form elongate series at the tesseral periphery and tight clusters in the center of tesserae, creating a rich connectivity among cells. The network arrangement and the shape variation of chondrocytes in tesserae indicate that cells may interact within and between tesserae and manage mineralization differently from chondrocytes in other vertebrates, perhaps performing analogous roles to osteocytes in bone.
An advantageous property of mesh-based geometric morphometrics (GM) towards landmark-based approaches, is the possibility of precisely examining highly irregular shapes and highly topographic surfaces. In case of spherical-harmonics-based GM the main requirement is a completely closed mesh surface, which often is not given, especially when dealing with natural objects. Here we present a methodological workflow to prepare 3D segmentations containing large cavity openings for the conduction of spherical-harmonics-based GM. This will be exemplified with a case study on claws of hermit crabs (Paguroidea, Decapoda, Crustacea), whereby joint openings – between manus and “movable finger” – typify the large-cavity-opening problem. We found a methodology including an ambient-occlusion-based segmentation algorithm leading to results precise and suitable to study the inter- and intraspecific differences in shape of hermit crab claws. Statistical analyses showed a significant separation between all examined diogenid and pagurid claws, whereas the separation between all left and right claws did not show significance. Additionally, the procedure offers other benefits. It is easy to reproduce and creates sparse variance in the data, closures integrate smoothly into the total structures and the algorithm saves a significant amount of time.
In most vertebrates the embryonic cartilaginous skeleton is replaced by bone during development. During this process, cartilage cells (chondrocytes) mineralize the extracellular matrix and undergo apoptosis, giving way to bone cells (osteocytes). In contrast, sharks and rays (elasmobranchs) have cartilaginous skeletons throughout life, where only the surface mineralizes, forming a layer of tiles (tesserae). Elasmobranch chondrocytes, unlike those of other vertebrates, survive cartilage mineralization and are maintained alive in spaces (lacunae) within tesserae. However, the function(s) of the chondrocytes in the mineralized tissue remain unknown. Applying a custom analysis workflow to high-resolution synchrotron microCT scans of tesserae, we characterize the morphologies and arrangements of stingray chondrocyte lacunae, using lacunar morphology as a proxy for chondrocyte morphology. We show that the cell density is comparable in unmineralized and mineralized tissue from our study species and that cells maintain the similar volume even when they have been incorporated into tesserae. This discovery supports previous hypotheses that elasmobranch chondrocytes, unlike those of other taxa, do not proliferate, hypertrophy or undergo apoptosis during mineralization. Tessera lacunae show zonal variation in their shapes—being flatter further from and more spherical closer to the unmineralized cartilage matrix and larger in the center of tesserae— and show pronounced organization into parallel layers and strong orientation toward neighboring tesserae. Tesserae also exhibit local variation in lacunar density, with the density considerably higher near pores passing through the tesseral layer, suggesting pores and cells interact (e.g. that pores contain a nutrient source). We hypothesize that the different lacunar types reflect the stages of the tesserae formation process, while also representing local variation in tissue architecture and cell function. Lacunae are linked by small passages (canaliculi) in the matrix to form elongate series at the tesseral periphery and tight clusters in the center of tesserae, creating a rich connectivity among cells. The network arrangement and the shape variation of chondrocytes in tesserae indicate that cells may interact within and between tesserae and manage mineralization differently from chondrocytes in other vertebrates, perhaps performing analogous roles to osteocytes in bone.
The temporally and spatially resolved tracking of lithium intercalation and electrode degradation processes are crucial for detecting and understanding performance losses during the operation of lithium-batteries. Here, high-throughput X-ray computed tomography has enabled the identification of mechanical degradation processes in a commercial Li/MnO2 primary battery and the indirect tracking of lithium diffusion; furthermore, complementary neutron computed tomography has identified the direct lithium diffusion process and the electrode wetting by the electrolyte. Virtual electrode unrolling techniques provide a deeper view inside the electrode layers and are used to detect minor fluctuations which are difficult to observe using conventional three dimensional rendering tools. Moreover, the ‘unrolling’ provides a platform for correlating multi-modal image data which is expected to find wider application in battery science and engineering to study diverse effects e.g. electrode degradation or lithium diffusion blocking during battery cycling.
In individuals of similar body mass representing closely related species with different lifestyles, muscle architectural properties can be assumed to reflect adaptation to differing, lifestyle-related functional demands. We here employ a fiber recognition algorithm on contrast-enhanced micro-computed tomography (μCT) scans of one specimen each of an arboreal (Sciurus vulgaris) and a fossorial (Spermophilus citellus) sciuromorph rodent. The automated approach accounts for potential heterogeneity of architectural properties within a muscle by analyzing all fascicles that compose a muscle. Muscle architectural properties (volume, fascicle length, and orientation, and force-generating capacity) were quantified in 14 hindlimb (hip, knee, and ankle) extensor muscles and compared between specimens. We expected the arboreal squirrel to exhibit greater force-generating capacity and a greater capacity for length change allowing more powerful hindlimb extension. Generally and mostly matching our expectations, the S. vulgaris specimen had absolutely and relatively larger extensor muscles than the S. citellus specimen which were thus metabolically more expensive and demonstrate the relatively larger investment into powerful hindlimb extension necessary in the arboreal context. We conclude that detailed quantitative data on hindlimb muscle internal structure as was gathered here for a very limited sample further lends support to the notion that muscle architecture reflects adaptation to differential functional demands in closely related species with different locomotor behaviors and lifestyles.
The historical importance of ancient manuscripts is unique since they provide information about the heritage of ancient cultures. Often texts are hidden in rolled or folded documents. Due to recent impro- vements in sensitivity and resolution, spectacular disclosures of rolled hidden texts were possible by X-ray tomography. However, revealing text on folded manuscripts is even more challenging. Manual unfolding is often too risky in view of the fragile condition of fragments, as it can lead to the total loss of the document. X-ray tomography allows for virtual unfolding and enables non-destructive access to hid- den texts. We have recently demonstrated the procedure and tested unfolding algorithms on a mockup sample. Here, we present results on unfolding ancient papyrus packages from the papyrus collection of the Musée du Louvre, among them objects folded along approximately orthogonal folding lines. In one of the packages, the first identification of a word was achieved, the Coptic word for “Lord”.
The historical importance of ancient manuscripts is unique since they provide information about the heritage of ancient cultures. Often texts are hidden in rolled or folded documents. Due to recent impro- vements in sensitivity and resolution, spectacular disclosures of rolled hidden texts were possible by X-ray tomography. However, revealing text on folded manuscripts is even more challenging. Manual unfolding is often too risky in view of the fragile condition of fragments, as it can lead to the total loss of the document. X-ray tomography allows for virtual unfolding and enables non-destructive access to hid- den texts. We have recently demonstrated the procedure and tested unfolding algorithms on a mockup sample. Here, we present results on unfolding ancient papyrus packages from the papyrus collection of the Musée du Louvre, among them objects folded along approximately orthogonal folding lines. In one of the packages, the first identification of a word was achieved, the Coptic word for “Lord”.
High-Throughput Segmentation of Tiled Biological Structures using Random-Walk Distance Transforms
(2019)
Various 3D imaging techniques are routinely used to examine biological materials, the results of which are usually a stack of grayscale images. In order to quantify structural aspects of the biological materials, however, they must first be extracted from the dataset in a process called segmentation. If the individual structures to be extracted are in contact or very close to each other, distance-based segmentation methods utilizing the Euclidean distance transform are commonly employed. Major disadvantages of the Euclidean distance transform, however, are its susceptibility to noise (very common in biological data), which often leads to incorrect segmentations (i.e. poor separation of objects of interest), and its limitation of being only effective for roundish objects. In the present work, we propose an alternative distance transform method, the random-walk distance transform, and demonstrate its effectiveness in high-throughput segmentation of three microCT datasets of biological tilings (i.e. structures composed of a large number of similar repeating units). In contrast to the Euclidean distance transform, this random-walk approach represents the global, rather than the local, geometric character of the objects to be segmented and, thus, is less susceptible to noise. In addition, it is directly applicable to structures with anisotropic shape characteristics. Using three case studies—stingray tessellated cartilage, starfish dermal endoskeleton, and the prismatic layer of bivalve mollusc shell—we provide a typical workflow for the segmentation of tiled structures, describe core image processing concepts that are underused in biological research, and show that for each study system, large amounts of biologically-relevant data can be rapidly segmented, visualized and analyzed.
High-Throughput Segmentation of Tiled Biological Structures using Random-Walk Distance Transforms
(2019)
Various 3D imaging techniques are routinely used to examine biological materials, the results of which are usually a stack of grayscale images. In order to quantify structural aspects of the biological materials, however, they must first be extracted from the dataset in a process called segmentation. If the individual structures to be extracted are in contact or very close to each other, distance-based segmentation methods utilizing the Euclidean distance transform are commonly employed. Major disadvantages of the Euclidean distance transform, however, are its susceptibility to noise (very common in biological data), which often leads to incorrect segmentations (i.e. poor separation of objects of interest), and its limitation of being only effective for roundish objects. In the present work, we propose an alternative distance transform method, the random-walk distance transform, and demonstrate its effectiveness in high-throughput segmentation of three microCT datasets of biological tilings (i.e. structures composed of a large number of similar repeating units). In contrast to the Euclidean distance transform, this random-walk approach represents the global, rather than the local, geometric character of the objects to be segmented and, thus, is less susceptible to noise. In addition, it is directly applicable to structures with anisotropic shape characteristics. Using three case studies—stingray tessellated cartilage, starfish dermal endoskeleton, and the prismatic layer of bivalve mollusc shell—we provide a typical workflow for the segmentation of tiled structures, describe core image processing concepts that are underused in biological research, and show that for each study system, large amounts of biologically-relevant data can be rapidly segmented, visualized and analyzed.
We show how biologically coherent mesh models of animals can be created from μCT data to generate artificial yet naturally looking intermediate objects. The whole pipeline of processing algorithms is presented, starting from generating topologically equivalent surface meshes, followed by solving the correspondence problem, and, finally, creating a surface morphing. In this pipeline, we address all the challenges that are due to dealing with complex biological, non-isometric objects. For biological objects it is often particularly important to obtain deformations that look as realistic as possible. In addition, spatially non-uniform shape morphings that only change one part of the surface and keep the rest as stable as possible are of interest for evolutionary studies, since functional modules often change independently from one another. We use Poisson interpolation for this purpose and show that it is well suited to generate both global and local shape deformations.
We show how biologically coherent mesh models of animals can be created from μCT data to generate artificial yet naturally looking intermediate objects. The whole pipeline of processing algorithms is presented, starting from generating topologically equivalent surface meshes, followed by solving the correspondence problem, and, finally, creating a surface morphing. In this pipeline, we address all the challenges that are due to dealing with complex biological, non-isometric objects. For biological objects it is often particularly important to obtain deformations that look as realistic as possible. In addition, spatially non-uniform shape morphings that only change one part of the surface and keep the rest as stable as possible are of interest for evolutionary studies, since functional modules often change independently from one another. We use Poisson interpolation for this purpose and show that it is well suited to generate both global and local shape deformations.
The analysis and visualization of nucleic acids (RNA and DNA) is playing an increasingly important role due to their fundamental importance for all forms of life and the growing number of known 3D structures of such molecules. The great complexity of these structures, in particular, those of RNA, demands interactive visualization to get deeper insights into the relationship between the 2D secondary structure motifs and their 3D tertiary structures. Over the last decades, a lot of research in molecular visualization has focused on the visual exploration of protein structures while nucleic acids have only been marginally addressed. In contrast to proteins, which are composed of amino acids, the ingredients of nucleic acids are nucleotides. They form structuring patterns that differ from those of proteins and, hence, also require different visualization and exploration techniques. In order to support interactive exploration of nucleic acids, the computation of secondary structure motifs as well as their visualization in 2D and 3D must be fast. Therefore, in this paper, we focus on the performance of both the computation and visualization of nucleic acid structure. We present a ray casting-based visualization of RNA and DNA secondary and tertiary structures, which enables for the first time real-time visualization of even large molecular dynamics trajectories. Furthermore, we provide a detailed description of all important aspects to visualize nucleic acid secondary and tertiary structures. With this, we close an important gap in molecular visualization.
The analysis and visualization of nucleic acids (RNA and DNA) play an increasingly important role due to the growing number of known 3-dimensional structures of such molecules. The great complexity of these structures, in particular, those of RNA, demands interactive visualization to get deeper insights into the relationship between the 2D secondary structure motifs and their 3D tertiary structures. Over the last decades, a lot of research in molecular visualization has focused on the visual exploration of protein structures while nucleic acids have only been marginally addressed. In contrast to proteins, which are composed of amino acids, the ingredients of nucleic acids are nucleotides. They form structuring patterns that differ from those of proteins and, hence, also require different visualization and exploration techniques. In order to support interactive exploration of nucleic acids, the computation of secondary structure motifs as well as their visualization in 2D and 3D must be fast. Therefore, in this paper, we focus on the performance of both the computation and visualization of nucleic acid structure. For the first time, we present a ray casting-based visualization of RNA and DNA secondary and tertiary structures, which enables real-time visualization of even large molecular dynamics trajectories. Furthermore, we provide a detailed description of all important aspects to visualize nucleic acid secondary and tertiary structures. With this, we close an important gap in molecular visualization.
In molecular structure analysis and visualization, the molecule’s atoms are often modeled as hard spheres parametrized by their positions and radii. While the atom positions result from experiments or molecular simulations, for the radii typically values are taken from literature. Most often, van der Waals (vdW) radii are used, for which diverse values exist. As a consequence, different visualization and analysis tools use different atomic radii, and the analyses are less objective than often believed. Furthermore, for the geometric accessibility analysis of molecular structures, vdW radii are not well suited. The reason is that during the molecular dynamics simulation, depending on the force field and the kinetic energy in the system, non-bonded atoms can come so close to each other that their vdW spheres intersect. In this paper, we introduce a new kind of atomic radius, called atomic accessibility radius’, that better characterizes the accessibility of an atom in a given molecular trajectory. The new radii reflect the movement possibilities of atoms in the simulated physical system. They are computed by solving a linear program that maximizes the radii of the atoms under the constraint that non-bonded spheres do not intersect in the considered molecular trajectory. Using this data-driven approach, the actual accessibility of atoms can be visualized more precisely.
In molecular structure analysis and visualization, the molecule’s atoms are often modeled as hard spheres parametrized by their positions and radii. While the atom positions result from experiments or molecular simulations, for the radii typically values are taken from literature. Most often, van der Waals (vdW) radii are used, for which diverse values exist. As a consequence, different visualization and analysis tools use different atomic radii, and the analyses are less objective than often believed. Furthermore, for the geometric accessibility analysis of molecular structures, vdW radii are not well suited. The reason is that during the molecular dynamics simulation, depending on the force field and the kinetic energy in the system, non-bonded atoms can come so close to each other that their vdW spheres intersect. In this paper, we introduce a new kind of atomic radius, called atomic accessibility radius’, that better characterizes the accessibility of an atom in a given molecular trajectory. The new radii reflect the movement possibilities of atoms in the simulated physical system. They are computed by solving a linear program that maximizes the radii of the atoms under the constraint that non-bonded spheres do not intersect in the considered molecular trajectory. Using this data-driven approach, the actual accessibility of atoms can be visualized more precisely.
During the last decades, X-ray (micro-)computed tomography has gained increasing attention for the description of porous skeletal and shell structures of various organism groups. However, their quantitative analysis is often hampered by the difficulty to discriminate cavities and pores within the object from the surrounding region. Herein, we test the ambient occlusion (AO) algorithm and newly implemented optimisations for the segmentation of cavities (implemented in the software Amira). The segmentation accuracy is evaluated as a function of (i) changes in the ray length input variable, and (ii) the usage of AO (scalar) field and other AO-derived (scalar) fields. The results clearly indicate that the AO field itself outperforms all other AO-derived fields in terms of segmentation accuracy and robustness against variations in the ray length input variable. The newly implemented optimisations improved the AO field-based segmentation only slightly, while the segmentations based on the AO-derived fields improved considerably. Additionally, we evaluated the potential of the AO field and AO-derived fields for the separation and classification of cavities as well as skeletal structures by comparing them with commonly used distance-map-based segmentations. For this, we tested the zooid separation within a bryozoan colony, the stereom classification of an ophiuroid tooth, the separation of bioerosion traces within a marble block and the calice (central cavity)-pore separation within a dendrophyllid coral. The obtained results clearly indicate that the ideal input field depends on the three-dimensional morphology of the object of interest. The segmentations based on the AO-derived fields often provided cavity separations and skeleton classifications that were superior to or impossible to obtain with commonly used distance- map-based segmentations. The combined usage of various AO-derived fields by supervised or unsupervised segmentation algorithms might provide a promising target for future research to further improve the results for this kind of high-end data segmentation and classification. Furthermore, the application of the developed segmentation algorithm is not restricted to X-ray (micro-)computed tomographic data but may potentially be useful for the segmentation of 3D volume data from other sources.
During the last decades, X-ray (micro-)computed tomography has gained increasing attention for the description of porous skeletal and shell structures of various organism groups. However, their quantitative analysis is often hampered by the difficulty to discriminate cavities and pores within the object from the surrounding region. Herein, we test the ambient occlusion (AO) algorithm and newly implemented optimisations for the segmentation of cavities (implemented in the software Amira). The segmentation accuracy is evaluated as a function of (i) changes in the ray length input variable, and (ii) the usage of AO (scalar) field and other AO-derived (scalar) fields. The results clearly indicate that the AO field itself outperforms all other AO-derived fields in terms of segmentation accuracy and robustness against variations in the ray length input variable. The newly implemented optimisations improved the AO field-based segmentation only slightly, while the segmentations based on the AO-derived fields improved considerably. Additionally, we evaluated the potential of the AO field and AO-derived fields for the separation and classification of cavities as well as skeletal structures by comparing them with commonly used distance-map-based segmentations. For this, we tested the zooid separation within a bryozoan colony, the stereom classification of an ophiuroid tooth, the separation of bioerosion traces within a marble block and the calice (central cavity)-pore separation within a dendrophyllid coral. The obtained results clearly indicate that the ideal input field depends on the three-dimensional morphology of the object of interest. The segmentations based on the AO-derived fields often provided cavity separations and skeleton classifications that were superior to or impossible to obtain with commonly used distance- map-based segmentations. The combined usage of various AO-derived fields by supervised or unsupervised segmentation algorithms might provide a promising target for future research to further improve the results for this kind of high-end data segmentation and classification. Furthermore, the application of the developed segmentation algorithm is not restricted to X-ray (micro-)computed tomographic data but may potentially be useful for the segmentation of 3D volume data from other sources.
Comets display with decreasing solar distance an increased emission of gas and dust particles, leading to the formation of the coma and tail. Spacecraft missions provide insight in the temporal and spatial variations of the dust and gas sources located on the cometary nucleus. For the case of comet 67P/Churyumov-Gerasimenko (67P/C-G), the long-term obser- vations from the Rosetta mission point to a homogeneous dust emission across the entire illuminated surface. Despite the homogeneous initial dis- tribution, a collimation in jet-like structures becomes visible. We propose that this observation is linked directly to the complex shape of the nucleus and projects concave topographical features into the dust coma. To test this hypothesis, we put forward a gas-dust description of 67P/C-G, where gravitational and gas forces are accurately determined from the surface mesh and the rotation of the nucleus is fully incorporated. The emerging jet-like structures persist for a wide range of gas-dust interactions and show a dust velocity dependent bending.
Supplementary data to reproduce and understand key results from the related publication, including original image data and processed data. In particular, sections from hyomandibulae harvested from specimens of round stingray Urobatis halleri, donated from another study (DOI: 10.1002/etc.2564). Specimens were from sub-adults/adults collected by beach seine from collection sites in San Diego and Seal Beach, California, USA. The hyomandibulae were mounted in clay, sealed in ethanol-humidified plastic tubes and scanned with a Skyscan 1172 desktop μCT scanner (Bruker μCT, Kontich, Belgium) in association with another study (DOI: 10.1111/joa.12508). Scans for all samples were performed with voxel sizes of 4.89 μm at 59 kV source voltage and 167 μA source current, over 360◦ sample 120 rotation. For our segmentations, the datasets were resampled to a voxel size of 9.78 μm to reduce the size of the images and speed up processing. In addition, the processed data that was generated with the visualization software Amira with techniques described in the related publication based on the mentioned specimens.
Comets display with decreasing solar distance an increased emission of gas and dust particles, leading to the formation of the coma and tail. Spacecraft missions provide insight in the temporal and spatial variations of the dust and gas sources located on the cometary nucleus. For the case of comet 67P/Churyumov-Gerasimenko (67P/C-G), the long-term obser- vations from the Rosetta mission point to a homogeneous dust emission across the entire illuminated surface. Despite the homogeneous initial dis- tribution, a collimation in jet-like structures becomes visible. We propose that this observation is linked directly to the complex shape of the nucleus and projects concave topographical features into the dust coma. To test this hypothesis, we put forward a gas-dust description of 67P/C-G, where gravitational and gas forces are accurately determined from the surface mesh and the rotation of the nucleus is fully incorporated. The emerging jet-like structures persist for a wide range of gas-dust interactions and show a dust velocity dependent bending.
Introduction – Many biological structures show recurring tiling patterns on one structural level or the other. Current image acquisition techniques are able to resolve those tiling patterns to allow quantitative analyses. The resulting image data, however, may contain an enormous number of elements. This renders manual image analysis infeasible, in particular when statistical analysis is to be conducted, requiring a larger number of image data to be analyzed. As a consequence, the analysis process needs to be automated to a large degree. In this paper, we describe a multi-step image segmentation pipeline for the automated segmentation of the calcified cartilage into individual tesserae from computed tomography images of skeletal elements of stingrays.
Methods – Besides applying state-of-the-art algorithms like anisotropic diffusion smoothing, local thresholding for foreground segmentation, distance map calculation, and hierarchical watershed, we exploit a graph-based representation for fast correction of the segmentation. In addition, we propose a new distance map that is computed only in the plane that locally best approximates the calcified cartilage. This distance map drastically improves the separation of individual tesserae. We apply our segmentation pipeline to hyomandibulae from three individuals of the round stingray (Urobatis halleri), varying both in age and size.
Results – Each of the hyomandibula datasets contains approximately 3000 tesserae. To evaluate the quality of the automated segmentation, four expert users manually generated ground truth segmentations of small parts of one hyomandibula. These ground truth segmentations allowed us to compare the segmentation quality w.r.t. individual tesserae. Additionally, to investigate the segmentation quality of whole skeletal elements, landmarks were manually placed on all tesserae and their positions were then compared to the segmented tesserae. With the proposed segmentation pipeline, we sped up the processing of a single skeletal element from days or weeks to a few hours.
Introduction – Many biological structures show recurring tiling patterns on one structural level or the other. Current image acquisition techniques are able to resolve those tiling patterns to allow quantitative analyses. The resulting image data, however, may contain an enormous number of elements. This renders manual image analysis infeasible, in particular when statistical analysis is to be conducted, requiring a larger number of image data to be analyzed. As a consequence, the analysis process needs to be automated to a large degree. In this paper, we describe a multi-step image segmentation pipeline for the automated segmentation of the calcified cartilage into individual tesserae from computed tomography images of skeletal elements of stingrays.
Methods – Besides applying state-of-the-art algorithms like anisotropic diffusion smoothing, local thresholding for foreground segmentation, distance map calculation, and hierarchical watershed, we exploit a graph-based representation for fast correction of the segmentation. In addition, we propose a new distance map that is computed only in the plane that locally best approximates the calcified cartilage. This distance map drastically improves the separation of individual tesserae. We apply our segmentation pipeline to hyomandibulae from three individuals of the round stingray (Urobatis halleri), varying both in age and size.
Results – Each of the hyomandibula datasets contains approximately 3000 tesserae. To evaluate the quality of the automated segmentation, four expert users manually generated ground truth segmentations of small parts of one hyomandibula. These ground truth segmentations allowed us to compare the segmentation quality w.r.t. individual tesserae. Additionally, to investigate the segmentation quality of whole skeletal elements, landmarks were manually placed on all tesserae and their positions were then compared to the segmented tesserae. With the proposed segmentation pipeline, we sped up the processing of a single skeletal element from days or weeks to a few hours.
Adapting trabecular structures for 3D printing: an image processing approach based on µCT data
(2017)
Materials with a trabecular structure notably combine advantages such as lightweight, reasonable strength, and permeability for fluids. This combination of advantages is especially interesting for tissue engineering in trauma surgery and orthopedics. Bone-substituting scaffolds for instance are designed with a trabecular structure in order to allow cell migration for bone ingrowth and vascularization. An emerging and recently very popular technology to produce such complex, porous structures is 3D printing. However, several technological aspects regarding the scaffold architecture, the printable resolution, and the feature size have to be considered when fabricating scaffolds for bone tissue replacement and regeneration.
Here, we present a strategy to assess and prepare realistic trabecular structures for 3D printing using image analysis with the aim of preserving the structural elements. We discuss critical conditions of the printing system and present a 3-stage approach to adapt a trabecular structure from $\mu$CT data while incorporating knowledge about the printing system. In the first stage, an image-based extraction of solid and void structures is performed, which results in voxel- and graph-based representations of the extracted structures. These representations not only allow us to quantify geometrical properties such as pore size or strut geometry and length. But, since the graph represents the geometry and the topology of the initial structure, it can be used in the second stage to modify and adjust feature size, volume and sample size in an easy and consistent way. In the final reconstruction stage, the graph is then converted into a voxel representation preserving the topology of the initial structure. This stage generates a model with respect to the printing conditions to ensure a stable and controlled voxel placement during the printing process.
Geometric morphometrics plays an important role in evolutionary studies. The state-of-the-art in this field are landmark-based methods. Since the landmarks usually need to be placed manually, only a limited number of landmarks are generally used to represent the shape of an anatomical structure. As a result, shape characteristics that cannot be properly represented by small sets of landmarks are disregarded.
In this study, we present a method that is free of this limitation. The method takes into account the whole shape of an anatomical structure, which is represented as a surface, hence the term ‘surface-based morphometrics’. Correspondence between two surfaces is established by defining a partitioning of the surfaces into homologous surface patches. The first step for the generation of a surface partitioning is to place landmarks on the surface. Subsequently, the landmarks are connected by curves lying on the surface. The curves, called ‘surface paths’, might either follow specific anatomical features or they can be geodesics, that is, shortest paths on the surface. One important requirement, however, is that the resulting surface path networks are topologically equivalent across all surfaces. Once the surface path networks have been defined, the surfaces are decomposed into patches according to the path networks.
This approach has several advantages. One of them is that we can discretize the surface by as many points as desired. Thus, even fine shape details can be resolved if this is of interest for the study. Since a point discretization is used, another advantage is that well-established analysis methods for landmark-based morphometrics can be utilized. Finally, the shapes can be easily morphed into one another, thereby greatly supporting the understanding of shape changes across all considered specimens.
To show the potential of the described method for evolutionary studies of biological specimens, we applied the method to the para-basisphenoid complex of the snake genus Eirenis. By using this anatomical structure as example, we present all the steps that are necessary for surface-based morphometrics, including the segmentation of the para-basisphenoid complex from micro-CT data sets. We also show some first results using statistical analysis as well as classification methods based on the presented technique.
Adapting trabecular structures for 3D printing: an image processing approach based on µCT data
(2017)
Materials with a trabecular structure notably combine advantages such as lightweight, reasonable strength, and permeability for fluids. This combination of advantages is especially interesting for tissue engineering in trauma surgery and orthopedics. Bone-substituting scaffolds for instance are designed with a trabecular structure in order to allow cell migration for bone ingrowth and vascularization. An emerging and recently very popular technology to produce such complex, porous structures is 3D printing. However, several technological aspects regarding the scaffold architecture, the printable resolution, and the feature size have to be considered when fabricating scaffolds for bone tissue replacement and regeneration.
Here, we present a strategy to assess and prepare realistic trabecular structures for 3D printing using image analysis with the aim of preserving the structural elements. We discuss critical conditions of the printing system and present a 3-stage approach to adapt a trabecular structure from $\mu$CT data while incorporating knowledge about the printing system. In the first stage, an image-based extraction of solid and void structures is performed, which results in voxel- and graph-based representations of the extracted structures. These representations not only allow us to quantify geometrical properties such as pore size or strut geometry and length. But, since the graph represents the geometry and the topology of the initial structure, it can be used in the second stage to modify and adjust feature size, volume and sample size in an easy and consistent way. In the final reconstruction stage, the graph is then converted into a voxel representation preserving the topology of the initial structure. This stage generates a model with respect to the printing conditions to ensure a stable and controlled voxel placement during the printing process.
The structure of Bulk-Heterojunction (BHJ) materials, the main component of organic photovoltaic solar cells, is very complex, and the relationship between structure and performance is still largely an open question. Overall, there is a wide spectrum of fabrication configurations resulting in different BHJ morphologies and correspondingly different performances. Current state- of-the-art methods for assessing the performance of BHJ morphologies are either based on global quantification of morphological features or simply on visual inspection of the morphology based on experimental imaging. This makes finding optimal BHJ structures very challenging. Moreover, finding the optimal fabrication parameters to get an optimal structure is still an open question. In this paper, we propose a visual analysis framework to help answer these questions through comparative visualization and parameter space exploration for local morphology features. With our approach, we enable scientists to explore multivariate correlations between local features and performance indicators of BHJ morphologies. Our framework is built on shape-based clustering of local cubical regions of the morphology that we call patches. This enables correlating the features of clusters with intuition-based performance indicators computed from geometrical and topological features of charge paths.
The endoskeleton of sharks and rays (elasmobranchs) is comprised of a cartilaginous core, covered by thousands of mineralized tiles, called tesserae. Characterizing the relationship between tesseral morphometrics, skeletal growth and mechanics is challenging because tesserae are small (a few hundred micrometers wide), anchored to the surrounding tissue in complex three-dimensional ways, and occur in huge numbers. We integrate material property, histology, electron microscopy and synchrotron and laboratory µCT scans of skeletal elements from an ontogenetic series of round stingray Urobatis halleri, to gain insights into the generation and maintenance of a natural tessellated system. Using a custom-made semiautomatic segmentation algorithm, we present the first quantitative and 3d description of tesserae across whole skeletal elements. The tessellation is not interlocking or regular, with tesserae showing a great range of shapes, sizes and number of neighbors. This is partly region-dependent: for example, thick, columnar tesserae are arranged in series along convex edges with small radius of curvature (RoC), whereas more brick- or disc-shaped tesserae are found in planar/flatter areas. Comparison of the tessellation across ontogeny, shows that in younger animals, the forming tesseral network is less densely packed, appearing as a covering of separate, poorly mineralized islands that grow together with age to form a complete surface. Some gaps in the tessellation are localized to specific regions in all samples, indicating they are real features, perhaps either regions of delayed mineralization or of tendon insertion. We will use the structure of elasmobranch skeletons as a road map for understanding shark and ray skeletal mechanics, but also to extract fundamental engineering principles for tiled composite materials.
The structure of Bulk-Heterojunction (BHJ) materials, the main component of organic photovoltaic solar cells, is very complex, and the relationship between structure and performance is still largely an open question. Overall, there is a wide spectrum of fabrication configurations resulting in different BHJ morphologies and correspondingly different performances. Current state- of-the-art methods for assessing the performance of BHJ morphologies are either based on global quantification of morphological features or simply on visual inspection of the morphology based on experimental imaging. This makes finding optimal BHJ structures very challenging. Moreover, finding the optimal fabrication parameters to get an optimal structure is still an open question. In this paper, we propose a visual analysis framework to help answer these questions through comparative visualization and parameter space exploration for local morphology features. With our approach, we enable scientists to explore multivariate correlations between local features and performance indicators of BHJ morphologies. Our framework is built on shape-based clustering of local cubical regions of the morphology that we call patches. This enables correlating the features of clusters with intuition-based performance indicators computed from geometrical and topological features of charge paths.
When physical unfolding/unrolling of papyri is not possible or too dangerous for preserving the precious object, tomographic approaches may be the ap- propriate alternative. Requirements are the resolution and the contrast to distinguish writing and substrate. The steps to be performed are the following: (1) Select the object of interest (archaeological arguments, cultural back- ground of the object, etc.). (2) Find the proper physical procedure, especially with respect to contrast, take the tomographic data, e.g. by absorption x-ray tomography. (3) Apply mathematical unfolding transformations to the tomographic data, in order to obtain a 2d-planar reconstruction of text.
Structural properties of molecules are of primary concern in many fields. This report provides a comprehensive overview on techniques that have been developed in the fields of molecular graphics and visualization with a focus on applications in structural biology. The field heavily relies on computerized geometric and visual representations of three-dimensional, complex, large and time-varying molecular structures. The report presents a taxonomy that demonstrates which areas of molecular visualization have already been extensively investigated and where the field is currently heading. It discusses visualizations for molecular structures, strategies for efficient display regarding image quality and frame rate, covers different aspects of level of detail and reviews visualizations illustrating the dynamic aspects of molecular simulation data. The survey concludes with an outlook on promising and important research topics to foster further success in the development of tools that help to reveal molecular secrets.
Ancient Egyptian papyri are often folded, rolled up or kept as small packages, sometimes even sealed. Physically unrolling or unfolding these packages might severely damage them. We demonstrate a way to get access to the hidden script without physical unfolding by employing computed tomography and mathematical algorithms for virtual unrolling and unfolding. Our algorithmic approaches are combined with manual interaction. This provides the necessary flexibility to enable the unfolding of even complicated and partly damaged papyrus packages. In addition, it allows us to cope with challenges posed by the structure of ancient papyrus, which is rather irregular, compared to other writing substrates like metallic foils or parchment. Unfolding of packages is done in two stages. In the first stage, we virtually invert the physical folding process step by step until the partially unfolded package is topologically equivalent to a scroll or a papyrus sheet folded only along one fold line. To minimize distortions at this stage, we apply the method of moving least squares. In the second stage, the papyrus is simply flattened, which requires the definition of a medial surface. We have applied our software framework to several papyri. In this work, we present the results of applying our approaches to mockup papyri that were either rolled or folded along perpendicular fold lines. In the case of the folded papyrus, our approach represents the first attempt to address the unfolding of such complicated folds.
Ancient Egyptian papyri are often folded, rolled up or kept as small packages, sometimes even sealed. Physically unrolling or unfolding these packages might severely damage them. We demonstrate a way to get access to the hidden script without physical unfolding by employing computed tomography and mathematical algorithms for virtual unrolling and unfolding. Our algorithmic approaches are combined with manual interaction. This provides the necessary flexibility to enable the unfolding of even complicated and partly damaged papyrus packages. In addition, it allows us to cope with challenges posed by the structure of ancient papyrus, which is rather irregular, compared to other writing substrates like metallic foils or parchment. Unfolding of packages is done in two stages. In the first stage, we virtually invert the physical folding process step by step until the partially unfolded package is topologically equivalent to a scroll or a papyrus sheet folded only along one fold line. To minimize distortions at this stage, we apply the method of moving least squares. In the second stage, the papyrus is simply flattened, which requires the definition of a medial surface. We have applied our software framework to several papyri. In this work, we present the results of applying our approaches to mockup papyri that were either rolled or folded along perpendicular fold lines. In the case of the folded papyrus, our approach represents the first attempt to address the unfolding of such complicated folds.
Biological strategies for fatique and wear avoidance: lessons from stingray skeletons and teeth
(2016)
In this report we review and structure the branch of molecular visualization that is concerned with the visual analysis of cavities in macromolecular protein structures. First the necessary background, the domain terminology, and the goals of analytical reasoning are introduced. Based on a comprehensive collection of relevant research works, we present a novel classification for cavity detection approaches and structure them into four distinct classes: grid-based, Voronoi-based, surface-based, and probe-based methods. The subclasses are then formed by their combinations. We match these approaches with corresponding visualization technologies starting with direct 3D visualization, followed with non-spatial visualization techniques that for example abstract the interactions between structures into a relational graph, straighten the cavity of interest to see its profile in one view, or aggregate the time sequence into a single contour plot. We also discuss the current state of methods for the visual analysis of cavities in dynamic data such as molecular dynamics simulations. Finally, we give an overview of the most common tools that are actively developed and used in the structural biology and biochemistry research. Our report is concluded by an outlook on future challenges in the field.
In this report we review and structure the branch of molecular visualization that is concerned with the visual analysis of cavities in macromolecular protein structures. First the necessary background, the domain terminology, and the goals of analytical reasoning are introduced. Based on a comprehensive collection of relevant research works, we present a novel classification for cavity detection approaches and structure them into four distinct classes: grid-based, Voronoi-based, surface-based, and probe-based methods. The subclasses are then formed by their combinations. We match these approaches with corresponding visualization technologies starting with direct 3D visualization, followed with non-spatial visualization techniques that for example abstract the interactions between structures into a relational graph, straighten the cavity of interest to see its profile in one view, or aggregate the time sequence into a single contour plot. We also discuss the current state of methods for the visual analysis of cavities in dynamic data such as molecular dynamics simulations. Finally, we give an overview of the most common tools that are actively developed and used in the structural biology and biochemistry research. Our report is concluded by an outlook on future challenges in the field.
We compute trajectories of dust grains starting from a homogeneous surface activity-profile on a irregularly shaped cometary nucleus. Despite the initially homogeneous dust distribution a collimation in jet-like structures becomes visible. The fine structure is caused by concave topographical features with similar bundles of normal vectors. The model incorporates accurately determined gravitational forces, rotation of the nucleus, and gas-dust interaction. Jet-like dust structures are obtained for a wide range of gas-dust interactions. For the comet 67P/Churyumov-Gerasimenko, we derive the global dust distribution around the nucleus and find several areas of agreement between the homogeneous dust emission model and the Rosetta observation of dust jets, including velocity-dependent bending of trajectories.
Many natural objects contain pores and cavities that are filled with the same material that also surrounds the object. When such objects are imaged using, for example, computed tomography, the pores and cavities cannot be distinguished from the surrounding material by considering gray values and texture properties of the image. In this case, morphological operations are often used to fill the inner region. This is efficient, if the pore and cavity structures are small compared to the overall size of the object and if the object’s shape is mainly convex. If this is not the case, the segmentation might be very difficult and may result in a lot of noise. We propose the usage of ambient occlusion for the segmentation of pores and cavities. One nice property of ambient occlusion is that it generates smooth scalar fields. Due to this smoothness property, a segmentation based on those fields will result in smooth boundaries at the pore and cavity openings. This is often desired, particularly when dealing with natural objects.
Biological tissues achieve a wide range of properties and function, however with limited components. The organization of these constituent parts is a decisive factor in the impressive properties of biological materials, with tissues often exhibiting complex arrangements of hard and soft materials. The “tessellated” cartilage of the endoskeleton of sharks and rays, for example, is a natural composite of mineralized polygonal tiles (tesserae), collagen fiber bundles, and unmineralized cartilage, resulting in a material that is both flexible and strong, with optimal stiffness. The properties of the materials and the tiling geometry are vital to the growth and mechanics of the system, but had not been investigated due to the technical challenges involved.
We use high-resolution materials characterization techniques (qBEI, µCT) to show that tesserae exhibit great variability in mineral density, supporting theories of accretive growth mechanisms. We present a developmental series of tesserae and outline the development of unique structural features that appear to function in load bearing and energy dissipation, with some structural features far exceeding cortical bone’s mineral content and tissue stiffness. To examine interactions among tesserae, we developed an advanced tiling-recognition-algorithm to semi-automatically detect and isolate individual tiles in microCT scans of tesseral mats. The method allows quantification of shape variation across a wide area, allowing localization of regions of high/low reinforcement or flexibility in the skeleton. The combination of our material characterization and visualization techniques allows the first quantitative 3d description of anatomy and material properties of tesserae and the organization of tesseral networks in elasmobranch mineralized cartilage, providing insight into form-function relationships of the repeating tiled pattern. We aim to combine detailed knowledge of intra-tesseral morphology and mineralization to model the relationships of tesseral shapes and skeletal surface curvature, to understand fundamental tiling laws important for complex, mechanically loaded 3d objects.
The cartilaginous endoskeletons of sharks and rays are covered by tiles of mineralized cartilage called tesserae that enclose areas of unmineralized cartilage. These tesselated layers are vital to the growth as well as the material properties of the skeleton, providing both flexibility and strength. An understanding of the principles behind the tiling of the mineralized layer requires a quantitative analysis of shark and ray skeletal tessellation. However, since a single skeletal element comprises several thousand tesserae, manual segmentation is infeasible. We developed an automated segmentation pipeline that, working from micro-CT data, allows quantification of all tesserae in a skeletal element in less than an hour. Our segmentation algorithm relies on aspects we have learned of general tesseral morphology. In micro-CT scans, tesserae usually appear as round or star-shaped plate-like tiles, wider than deep and connected by mineralized intertesseral joints. Based on these observations, we exploit the distance map of the mineralized layer to separate individual tiles using a hierarchical watershed algorithm. Utilizing a two-dimensional distance map that measures the distance in the plane of the mineralized layer only greatly improves the segmentation. We developed post-processing techniques to quickly correct segmentation errors in regions where tesseral shape differs from the assumed shape. Evaluation of our results is done qualitatively by visual comparison with raw datasets, and quantitatively by comparison to manual segmentations. Furthermore, we generate two-dimensional abstractions of the tiling network based on the neighborhood, allowing representation of complex, biological forms as simpler geometries. We apply our newly developed techniques to the analysis of the left and right hyomandibulae of four ages of stingray enabling the first quantitative analyses of the tesseral tiling structure, while clarifying how these patterns develop across ontogeny.
Understanding the Tiling Rules of the Tessellated Mineralized Endoskeleton of Sharks and Rays
(2016)
The endoskeletons of sharks and rays are composed of an unmineralized cartilaginous core, covered in an outer layer of mineralized tiles called tesserae. The tessellated layer is vital to the growth as well as the material properties of the skeletal element, providing both flexibility and strength. However, characterizing the relationship between tesseral size and shape, and skeletal growth and mechanics is challenging because tesserae are small (a few hundred micrometers wide), anchored to the surrounding tissue in complex three-dimensional ways, and occur in huge numbers. Using a custom-made semi-automatic segmentation algorithm, we present the first quantitative and three-dimensional description of tesserae in micro-CT scans of whole skeletal elements. Our segmentation algorithm relies on aspects we have learned of general tesseral morphology. We exploit the distance map of the mineralized layer to separate individual tiles using a hierarchical watershed algorithm. Additionally, we have developed post-processing techniques to quickly correct segmentation errors. Our data reveals that the tessellation is not regular, with tesserae showing a great range of shapes, sizes and number of neighbors. This is partly region-dependent: for example, thick, columnar tesserae are arranged in series along convex edges with small radius of curvature (RoC), whereas more brick-or disc-shaped tesserae are found in planar areas. We apply our newly developed techniques on the left and right hyomandibula (skeletal elements supporting the jaws) from four different ages of a stingray species, to clarify how tiling patterns develop across ontogeny and differ within and between individuals. We evaluate the functional consequences of tesseral morphologies using finite element analysis and 3d-printing, for a better understanding of shark skeletal mechanics, but also to extract fundamental engineering design principles of tiling arrangements on load-bearing three-dimensional objects.
In civil engineering, the corrosion of steel reinforcements in structural elements of concrete bares a risk of
stability-reduction, mainly caused by the exposure to chlorides. 3D computed tomography (CT) reveals the inner
structure of concrete and allows one to investigate the corrosion with non-destructive testing methods. To carry
out such investigations, specimens with a large artificial crack and an embedded steel rebar have been
manufactured. 3D CT images of those specimens were acquired in the original state. Subsequently three cycles
of electrochemical pre-damaging together with CT imaging were applied. These time series have been evaluated
by means of image processing algorithms to segment and quantify the corrosion products. Visualization of the
results supports the understanding of how corrosion propagates into cracks and pores. Furthermore, pitting of
structural elements can be seen without dismantling. In this work, several image processing and visualization
techniques are presented that have turned out to be particularly effective for the visualization and segmentation
of corrosion products. Their combination to a workflow for corrosion analysis is the main contribution of this
work.