Baum, Daniel
Refine
Year of publication
Document Type
- Article (67)
- ZIB-Report (28)
- In Proceedings (24)
- Poster (6)
- Research data (5)
- In Collection (2)
- Book chapter (1)
- Doctoral Thesis (1)
- Master's Thesis (1)
- Software (1)
Is part of the Bibliography
- no (136)
Keywords
- 2D distance map (1)
- Amira (1)
- Beton (1)
- Bildverarbeitung (1)
- Bron-Kerbosch algorithm (1)
- Computertomografie (1)
- Cultural Heritage (1)
- DNA (1)
- Geometry processing (1)
- HCI (1)
Background: Despite recent advances in cellular cryo-electron tomography (CET), developing automated tools for macromolecule identification in submolecular resolution remains challenging due to the lack of annotated data and high structural complexities. To date, the extent of the deep learning methods constructed for this problem is limited to conventional Convolutional Neural Networks (CNNs). Identifying macromolecules of different types and sizes is a tedious and time-consuming task. In this paper, we employ a capsule-based architecture to automate the task of macro- molecule identification, that we refer to as 3D-UCaps. In particular, the architecture is composed of three components: feature extractor, capsule encoder, and CNN decoder. The feature extractor converts voxel intensities of input sub-tomograms to activities of local features. The encoder is a 3D Capsule Network (CapsNet) that takes local features to generate a low-dimensional representation of the input. Then, a 3D CNN decoder reconstructs the sub-tomograms from the given representation by upsampling.
Results: We performed binary and multi-class localization and identification tasks on synthetic and experimental data. We observed that the 3D-UNet and the 3D-UCaps had an F1−score mostly above 60% and 70%, respectively, on the test data. In both network architectures, we observed degradation of at least 40% in the F1-score when identifying very small particles (PDB entry 3GL1) compared to a large particle (PDB entry 4D8Q). In the multi-class identification task of experimental data, 3D-UCaps had an F1-score of 91% on the test data in contrast to 64% of the 3D-UNet. The better F1-score of 3D-UCaps compared to 3D-UNet is obtained by a higher precision score. We speculate this to be due to the capsule network employed in the encoder. To study the effect of the CapsNet-based encoder architecture further, we performed an ablation study and perceived that the F1-score is boosted as network depth is increased which
is in contrast to the previously reported results for the 3D-UNet. To present a reproducible work, source code, trained models, data as well as visualization results are made publicly available.
Conclusion: Quantitative and qualitative results show that 3D-UCaps successfully perform various downstream tasks including identification and localization of macro- molecules and can at least compete with CNN architectures for this task. Given that the capsule layers extract both the existence probability and the orientation of the molecules, this architecture has the potential to lead to representations of the data that are better interpretable than those of 3D-UNet.
During cell division, kinetochore microtubules (KMTs) provide a physical linkage between the chromosomes and the rest of the spindle. KMTs in mammalian cells are organized into bundles, so-called kinetochore-fibers (k-fibers), but the ultrastructure of these fibers is currently not well characterized. Here we show by large-scale electron tomography that each k-fiber in HeLa cells in metaphase is composed of approximately nine KMTs, only half of which reach the spindle pole. Our comprehensive reconstructions allowed us to analyze the three-dimensional (3D) morphology of k-fibers and their surrounding MTs in detail. We found that k-fibers exhibit remarkable variation in circumference and KMT density along their length, with the pole-proximal side showing a broadening. Extending our structural analysis then to other MTs in the spindle, we further observed that the association of KMTs with non-KMTs predominantly occurs in the spindle pole regions. Our 3D reconstructions have implications for KMT growth and k-fiber self-organization models as covered in a parallel publication applying complementary live-cell imaging in combination with biophysical modeling (Conway et al., 2022). Finally, we also introduce a new visualization tool allowing an interactive display of our 3D spindle data that will serve as a resource for further structural studies on mitosis in human cells.
3D shapes provide substantially more information than 2D images. However, the acquisition of 3D shapes is sometimes very difficult or even impossible in comparison with acquiring 2D images, making it necessary to derive the 3D shape from 2D images. Although this is, in general, a mathematically ill-posed problem, it might be solved by constraining the problem formulation using prior information. Here, we present a new approach based on Kendall’s shape space to reconstruct 3D shapes from single monocular 2D images. The work is motivated by an application to study the feeding behavior of the basking shark, an endangered species whose massive size and mobility render 3D shape data nearly impossible to obtain, hampering understanding of their feeding behaviors and ecology. 2D images of these animals in feeding position, however, are readily available. We compare our approach with state-of-the-art shape-based approaches both on human stick models and on shark head skeletons. Using a small set of training shapes, we show that the Kendall shape space approach is substantially more robust than previous methods and always results in plausible shapes. This is essential for the motivating application in which specimens are rare and therefore only few training shapes are available.
The present dataset contains the 3D models analyzed in Berio, F., Bayle, Y., Baum, D., Goudemand, N., and Debiais-Thibaud, M. 2022. Hide and seek shark teeth in Random Forests: Machine learning applied to Scyliorhinus canicula. It contains the head surfaces of 56 North Atlantic and Mediterranean small-spotted catsharks Scyliorhinus canicula, from which tooth surfaces were further extracted to perform geometric morphometrics and machine learning.
Shark populations that are distributed alongside a latitudinal gradient often display body size differences at sexual maturity and vicariance patterns related to their number of tooth files. Previous works have demonstrated that Scyliorhinus canicula exhibits distinct genetic structures, life history traits, and body size differences between populations inhabiting the North Atlantic Ocean and the Mediterranean Sea. In this work, we sample more than 3,000 S. canicula teeth from 56 specimens and provide and use a dataset containing their shape coordinates. We investigate tooth shape and form differences between a Mediterranean and an Atlantic S. canicula population using two approaches. Classification results show that the classical geometric morphometric framework is outperformed by an original Random Forests-based framework. Visually, both S. canicula populations share similar ontogenetic trends and timing of gynandric heterodonty emergence but the Atlantic population has bigger, blunter teeth, and less numerous accessory cusps than the Mediterranean population. According to the models, the populations are best differentiated based on their lateral tooth edges, which bear accessory cusps, and the tooth centroid sizes significantly improve classification performances. The differences observed are discussed in light of dietary and behavioural habits of the populations considered. The method proposed in this study could be further adapted to complement DNA analyses to identify shark species or populations based on tooth morphologies. This process would be of particular interest for fisheries management and identification of shark fossils.
Biological armors derive their mechanical integrity in part from their geometric architectures, often involving tessellations: individual structural elements tiled together to form surface shells. The carapace of boxfish, for example, is comprised of mineralized polygonal plates, called scutes, arranged in a complex geometric pattern and nearly completely encasing the body. In contrast to artificial armors, the boxfish exoskeleton grows with the fish; the relationship between the tessellation and the gross structure of the armor is therefore critical to sustained protection throughout growth. To clarify whether or how the boxfish tessellation is maintained or altered with age, we quantify architectural aspects of the tessellated carapace of the longhorn cowfish Lactoria cornuta through ontogeny (across nearly an order of magnitude in standard length) and in a high-throughput fashion, using high-resolution microCT data and segmentation algorithms to characterize the hundreds of scutes that cover each individual. We show that carapace growth is canalized with little variability across individuals: rather than continually adding scutes to enlarge the carapace surface, the number of scutes is surprisingly constant, with scutes increasing in volume, thickness, and especially width with age. As cowfish and their scutes grow, scutes become comparatively thinner, with the scutes at the edges (weak points in a boxy architecture) being some of the thickest and most reinforced in younger animals and thinning most slowly across ontogeny. In contrast, smaller scutes with more variable curvature were found in the limited areas of more complex topology (e.g. around fin insertions, mouth, and anus). Measurements of Gaussian and mean curvature illustrate that cowfish are essentially tessellated boxes throughout life: predominantly zero curvature surfaces comprised of mostly flat scutes, and with scutes with sharp bends used sparingly to form box edges. Since growth of a curved, tiled surface with a fixed number of tiles would require tile restructuring to accommodate the surface’s changing radius of curvature, our results therefore illustrate a previously unappreciated advantage of the odd boxfish morphology: by having predominantly flat surfaces, it is the box-like body form that in fact permits a relatively straightforward growth system of this tessellated architecture (i.e. where material is added to scute edges). Our characterization of the ontogeny and maintenance of the carapace tessellation provides insights into the potentially conflicting mechanical, geometric and developmental constraints of this species, but also perspectives into natural strategies for constructing mutable tiled architectures.
Our ability to grasp and understand complex phenomena is essentially based on recognizing structures and relating these to each other. For example, any meteorological description of a weather condition and explanation of its evolution recurs to meteorological structures, such as convection and circulation structures, cloud fields and rain fronts. All of these are spatiotemporal structures, defined by time-dependent patterns in the underlying fields. Typically, such a structure is defined by a verbal description that corresponds to the more or less uniform, often somewhat vague mental images of the experts.
However, a precise, formal definition of the structures or, more generally, concepts is often desirable, e.g., to enable automated data analysis or the development of phenomenological models. Here, we present a systematic approach and an interactive tool to obtain formal definitions of spatiotemporal structures. The tool enables experts to evaluate and compare different structure definitions on the basis of data sets with time-dependent fields that contain the respective structure. Since structure definitions are typically parameterized, an essential part is to identify parameter ranges that lead to desired structures in all time steps. In addition, it is important to allow a quantitative assessment of the resulting structures simultaneously. We demonstrate the use of the tool by applying it to two meteorological examples: finding structure definitions for vortex cores and center lines of temporarily evolving tropical cyclones.
Ideally, structure definitions should be objective and applicable to as many data sets as possible. However, finding such definitions, e.g., for the common atmospheric structures in meteorology, can only be a long-term goal. The proposed procedure, together with the presented tool, is just a first systematic approach aiming at facilitating this long and arduous way.
The Hemiptera is the largest non-endopterygote insect order comprising approximately 98,000 recent species. All species of the suborders Cicadomorpha (leafhoppers, spittlebugs, treehoppers and cicadas) and Fulgoromorpha (planthoppers) feed by sucking sap from plant tissues and are thus often vectors for economically important phytopathogens. Except for the cicadas (Cicadomorpha: Cicadoidea: Cicadidae) which produce air-borne sounds, all species of the suborders Cicadomorpha and Fulgoromorpha communicate by vibrational (substrate-borne) signals. While the generation of these signals has been extensively investigated, the mechanisms of perception are poorly understood. This study provides a full description and 3D reconstruction of a large and complex array of six paired chordotonal organs in the first abdominal segments of the Rhododendron leafhopper Graphocephala fennahi (Cicadomorpha: Membracoidea: Cicadellidae). Further we were able to identify homologous organs in the closely related spittlebug Philaenus spumarius (Cicadomorpha: Cercopoidea: Aphrophoridae) and the planthopper Issus coleoptratus (Fulgoromorpha: Fulgoroidea: Issidae). The configuration is congruent with the abdominal chordotonal organs in cicadas, where one of them is an elaborate tympanal organ. This indicates that these organs, together with the tymbal organ constitute a synapomorphy of the Tymbalia (Hemiptera excl. Sternorrhyncha). Our results contribute to the understanding of the evolution from substrate-borne to airborne communication in insects.
For mating, leafhoppers (Cicadellidae) use substrate-borne vibrational signals to communicate. We provide the first complete description of the abdominal chordotonal organs that enable the perception of these signals. This supplementary data provides the aligned stack of 450 semithin serial sections of the first and second abdominal segment of an adult male Rhododendron leafhopper (Graphocephala fennahi). Further, this supplementary data comprises the segmentation files of five chordotonal organs, the exoskeleton, the segmental nerves and the spiracles of the first and the second abdominal segment. Due to time limitations, the structures of only one half of the body were segmented. The specimen was caught by hand net in September 2018 in Berlin-Tiergarten, Germany. Samples were embedded in Araldite® 502 resin and cut transversally in 1 μm thick sections using a Leica ultramicrotome and a DIATOME Histo Jumbo 6.0 mm diamond knife. Sections were placed on microscopic slides and stained with methylene blue/azur II. The images were taken by means of a 3DHISTECH PANNORAMIC SCAN II slide scanner in the Institute of Pathology Charité in Berlin-Mitte, Germany. Images with a voxel size of 0.273809 μm x 0.273809 μm x 1 μm where obtained. The images were converted from MRXS-files to TIFF-files with the 3DHistech software Slide Converter 2.3. Using Photoshop, the images were cropped to the same canvas size and artefacts were removed. All further steps, such as alignment and segmentation, were done with the software Amira. In order to facilitate the further processing of the dataset, the voxels where resampled to a size of 0.547619 μm x 0.547619 μm x 1 μm.
We present a software-assisted workflow for the alignment and matching of filamentous structures across a three-dimensional (3D) stack of serial images. This is achieved by combining automatic methods, visual validation, and interactive correction. After the computation of an initial automatic matching, the user can continuously improve the result by interactively correcting landmarks or matches of filaments. Supported by a visual quality assessment of regions that have been already inspected, this allows a trade-off between quality and manual labor. The software tool was developed in an interdisciplinary collaboration between computer scientists and cell biologists to investigate cell division by quantitative 3D analysis of microtubules (MTs) in both mitotic and meiotic spindles. For this, each spindle is cut into a series of semi-thick physical sections, of which electron tomograms are acquired. The serial tomograms are then stitched and non-rigidly aligned to allow tracing and connecting of MTs across tomogram boundaries. In practice, automatic stitching alone provides only an incomplete solution, because large physical distortions and a low signal-to-noise ratio often cause experimental difficulties. To derive 3D models of spindles despite dealing with imperfect data related to sample preparation and subsequent data collection, semi-automatic validation and correction is required to remove stitching mistakes. However, due to the large number of MTs in spindles (up to 30k) and their resulting dense spatial arrangement, a naive inspection of each MT is too time-consuming. Furthermore, an interactive visualization of the full image stack is hampered by the size of the data (up to 100 GB). Here, we present a specialized, interactive, semi-automatic solution that considers all requirements for large-scale stitching of filamentous structures in serial-section image stacks. To the best of our knowledge, it is the only currently available tool which is able to process data of the type and size presented here. The key to our solution is a careful design of the visualization and interaction tools for each processing step to guarantee real-time response, and an optimized workflow that efficiently guides the user through datasets. The final solution presented here is the result of an iterative process with tight feedback loops between the involved computer scientists and cell biologists.
This article revisits a complexly folded silver scroll excavated in Jerash, Jordan in 2014 that was digitally examined in 2015. In this article we apply, examine and discuss a new virtual unfolding technique that results in a clearer image of the scroll’s 17 lines of writing. We also compare it to the earlier unfolding and discuss progress in general analytical tools. We publish the original and the new images as well as the unfolded volume data open access in order to make these available to researchers interested in optimising unfolding processes of various complexly folded materials.
Thin, curved structures occur in many volumetric datasets. Their analysis using classical volume rendering is difficult because parts of such structures can bend away or hide behind occluding elements. This problem cannot be fully compensated by effective navigation alone, because structure-adapted navigation in the volume is cumbersome and only parts of the structure are visible in each view.
We solve this problem by rendering a spatially transformed view into the volume so that an unobscured visualization of the entire curved structure is obtained. As a result, simple and intuitive navigation becomes possible. The domain of the spatial transform is defined by a triangle mesh that is topologically equivalent to an open disc and that approximates the structure of interest. The rendering is based on ray-casting in which the rays traverse the original curved sub-volume. In order to carve out volumes of varying thickness, the lengths of the rays as well as the position of the mesh vertices can be easily modified in a view-controlled manner by interactive painting. We describe a prototypical implementation and demonstrate the interactive visual inspection of complex structures from digital humanities, biology, medicine, and materials science. Displaying the structure as a whole enables simple inspection of interesting substructures in their original spatial context.
Overall, we show that transformed views utilizing ray-casting-based volume rendering supported by guiding surface meshes and supplemented by local, interactive modifications of ray lengths and vertex positions, represent a simple but versatile approach to effectively visualize thin, curved structures in volumetric data.
We present a software-assisted workflow for the alignment and matching of filamentous structures across a 3D stack of serial images. This is achieved by combining automatic methods, visual validation, and interactive correction. After an initial alignment, the user can continuously improve the result by interactively correcting landmarks or matches of filaments. Supported by a visual quality assessment of regions that have been already inspected, this allows a trade-off between quality and manual labor. The software tool was developed to investigate cell division by quantitative 3D analysis of microtubules (MTs) in both mitotic and meiotic spindles. For this, each spindle is cut into a series of semi-thick physical sections, of which electron tomograms are acquired. The serial tomograms are then stitched and non-rigidly aligned to allow tracing and connecting of MTs across tomogram boundaries. In practice, automatic stitching alone provides only an incomplete solution, because large physical distortions and a low signal-to-noise ratio often cause experimental difficulties. To derive 3D models of spindles despite the problems related to sample preparation and subsequent data collection, semi-automatic validation and correction is required to remove stitching mistakes. However, due to the large number of MTs in spindles (up to 30k) and their resulting dense spatial arrangement, a naive inspection of each MT is too time consuming. Furthermore, an interactive visualization of the full image stack is hampered by the size of the data (up to 100 GB). Here, we present a specialized, interactive, semi-automatic solution that considers all requirements for large-scale stitching of filamentous structures in serial-section image stacks. The key to our solution is a careful design of the visualization and interaction tools for each processing step to guarantee real-time response, and an optimized workflow that efficiently guides the user through datasets.
The images of D’Arcy Wentworth Thompson’s book “On Growth and Form” got an iconic status and became influential for biometrics and other mathematical approaches to organismic form. In particular, this is true for those of the chapter on the theory of transformation, which even has an impact on art and humanities. Based on his approach, Thompson formulated far-reaching conclusions with a partly anti-Darwinian stance. Here, we use the example of Thompson’s transformation of crab carapaces to test to what degree the transformation of grids, landmarks, and shapes result in congruent images. For comparison, we applied the same series of tests to digitized carapaces of real crabs. Both approaches show similar results. Only the simple transformations show a reasonable form of congruence. In particular, the transformations to majoid spider crabs reveal a complicated transformation of grids with partly crossing lines. By contrast, the carapace of the lithodid species is relatively easily created despite the fact that it is no brachyuran, but evolved a spider crab-like shape convergently from a hermit crab ancestor.
A prerequisite for many analysis tasks in modern comparative biology is the segmentation of 3-dimensional (3D) images of the specimens being investigated (e.g. from microCT data). Depending on the specific imaging technique that was used to acquire the images and on the image resolution, different segmentation tools will be required. While some standard tools exist that can often be applied for specific subtasks, building whole processing pipelines solely from standard tools is often difficult. Some tasks may even necessitate the implementation of manual interaction tools to achieve a quality that is sufficient for the subsequent analysis. In this work, we present a pipeline of segmentation tools that can be used for the semi-automatic segmentation and quantitative analysis of voids in tissue (i.e. internal structural porosity). We use this pipeline to analyze lacuno-canalicular networks in stingray tesserae from 3D images acquired with synchrotron microCT.
* The first step of this processing pipeline, the segmentation of the tesserae, was performed using standard marker-based watershed segmentation. The efficient processing of the next two steps, that is, the segmentation of all lacunae spaces belonging to a specific tessera and the separation of these spaces into individual lacunae required modern, recently developed tools.
* For proofreading, we developed a graph-based interactive method that allowed us to quickly split lacunae that were accidentally merged, and to merge lacunae that were wrongly split.
* Finally, the tesserae and their corresponding lacunae were subdivided into anatomical regions of interest (structural wedges) using a semi- manual approach.
Conflicting hypotheses about the relationships among the major lineages of aculeate Hymenoptera clearly show the necessity of detailed comparative morphological studies. Using micro-computed tomography and 3D reconstructions, the skeletal musculature of the meso- and metathorax and the first and second abdominal segment in Apoidea are described. Females of Sceliphron destillatorium, Sphex (Fernaldina) lucae (both Sphecidae), and Ampulex compressa (Ampulicidae) were examined. The morphological terminology provided by the Hymenoptera Anatomy Ontology is used. Up to 42 muscles were found. The three species differ in certain numerical and structural aspects. Ampulicidae differs significantly from Sphecidae in the metathorax and the anterior abdomen. The metapleural apodeme and paracoxal ridge are weakly developed in Ampulicidae, which affect some muscular structures. Furthermore, the muscles that insert on the coxae and trochanters are broader and longer in Ampulicidae. A conspicuous characteristic of Sphecidae is the absence of the metaphragma. Overall, we identified four hitherto unrecognized muscles. Our work suggests additional investigations on structures discussed in this paper.
A prerequisite for many analysis tasks in modern comparative biology is the segmentation of 3-dimensional (3D) images of the specimens being investigated (e.g. from microCT data). Depending on the specific imaging technique that was used to acquire the images and on the image resolution, different segmentation tools will be required. While some standard tools exist that can often be applied for specific subtasks, building whole processing pipelines solely from standard tools is often difficult. Some tasks may even necessitate the implementation of manual interaction tools to achieve a quality that is sufficient for the subsequent analysis. In this work, we present a pipeline of segmentation tools that can be used for the semi-automatic segmentation and quantitative analysis of voids in tissue (i.e. internal structural porosity). We use this pipeline to analyze lacuno-canalicular networks in stingray tesserae from 3D images acquired with synchrotron microCT.
* The first step of this processing pipeline, the segmentation of the tesserae, was performed using standard marker-based watershed segmentation. The efficient processing of the next two steps, that is, the segmentation of all lacunae spaces belonging to a specific tessera and the separation of these spaces into individual lacunae required modern, recently developed tools.
* For proofreading, we developed a graph-based interactive method that allowed us to quickly split lacunae that were accidentally merged, and to merge lacunae that were wrongly split.
* Finally, the tesserae and their corresponding lacunae were subdivided into anatomical regions of interest (structural wedges) using a semi- manual approach.
An advantageous property of mesh-based geometric morphometrics (GM) towards landmark-based approaches, is the possibility of precisely examining highly irregular shapes and highly topographic surfaces. In case of spherical-harmonics-based GM the main requirement is a completely closed mesh surface, which often is not given, especially when dealing with natural objects. Here we present a methodological workflow to prepare 3D segmentations containing large cavity openings for the conduction of spherical-harmonics-based GM. This will be exemplified with a case study on claws of hermit crabs (Paguroidea, Decapoda, Crustacea), whereby joint openings – between manus and “movable finger” – typify the large-cavity-opening problem. We found a methodology including an ambient-occlusion-based segmentation algorithm leading to results precise and suitable to study the inter- and intraspecific differences in shape of hermit crab claws. Statistical analyses showed a significant separation between all examined diogenid and pagurid claws, whereas the separation between all left and right claws did not show significance. Additionally, the procedure offers other benefits. It is easy to reproduce and creates sparse variance in the data, closures integrate smoothly into the total structures and the algorithm saves a significant amount of time.
In most vertebrates the embryonic cartilaginous skeleton is replaced by bone during development. During this process, cartilage cells (chondrocytes) mineralize the extracellular matrix and undergo apoptosis, giving way to bone cells (osteocytes). In contrast, sharks and rays (elasmobranchs) have cartilaginous skeletons throughout life, where only the surface mineralizes, forming a layer of tiles (tesserae). Elasmobranch chondrocytes, unlike those of other vertebrates, survive cartilage mineralization and are maintained alive in spaces (lacunae) within tesserae. However, the function(s) of the chondrocytes in the mineralized tissue remain unknown. Applying a custom analysis workflow to high-resolution synchrotron microCT scans of tesserae, we characterize the morphologies and arrangements of stingray chondrocyte lacunae, using lacunar morphology as a proxy for chondrocyte morphology. We show that the cell density is comparable in unmineralized and mineralized tissue from our study species and that cells maintain the similar volume even when they have been incorporated into tesserae. This discovery supports previous hypotheses that elasmobranch chondrocytes, unlike those of other taxa, do not proliferate, hypertrophy or undergo apoptosis during mineralization. Tessera lacunae show zonal variation in their shapes—being flatter further from and more spherical closer to the unmineralized cartilage matrix and larger in the center of tesserae— and show pronounced organization into parallel layers and strong orientation toward neighboring tesserae. Tesserae also exhibit local variation in lacunar density, with the density considerably higher near pores passing through the tesseral layer, suggesting pores and cells interact (e.g. that pores contain a nutrient source). We hypothesize that the different lacunar types reflect the stages of the tesserae formation process, while also representing local variation in tissue architecture and cell function. Lacunae are linked by small passages (canaliculi) in the matrix to form elongate series at the tesseral periphery and tight clusters in the center of tesserae, creating a rich connectivity among cells. The network arrangement and the shape variation of chondrocytes in tesserae indicate that cells may interact within and between tesserae and manage mineralization differently from chondrocytes in other vertebrates, perhaps performing analogous roles to osteocytes in bone.
An advantageous property of mesh-based geometric morphometrics (GM) towards landmark-based approaches, is the possibility of precisely examining highly irregular shapes and highly topographic surfaces. In case of spherical-harmonics-based GM the main requirement is a completely closed mesh surface, which often is not given, especially when dealing with natural objects. Here we present a methodological workflow to prepare 3D segmentations containing large cavity openings for the conduction of spherical-harmonics-based GM. This will be exemplified with a case study on claws of hermit crabs (Paguroidea, Decapoda, Crustacea), whereby joint openings – between manus and “movable finger” – typify the large-cavity-opening problem. We found a methodology including an ambient-occlusion-based segmentation algorithm leading to results precise and suitable to study the inter- and intraspecific differences in shape of hermit crab claws. Statistical analyses showed a significant separation between all examined diogenid and pagurid claws, whereas the separation between all left and right claws did not show significance. Additionally, the procedure offers other benefits. It is easy to reproduce and creates sparse variance in the data, closures integrate smoothly into the total structures and the algorithm saves a significant amount of time.
In most vertebrates the embryonic cartilaginous skeleton is replaced by bone during development. During this process, cartilage cells (chondrocytes) mineralize the extracellular matrix and undergo apoptosis, giving way to bone cells (osteocytes). In contrast, sharks and rays (elasmobranchs) have cartilaginous skeletons throughout life, where only the surface mineralizes, forming a layer of tiles (tesserae). Elasmobranch chondrocytes, unlike those of other vertebrates, survive cartilage mineralization and are maintained alive in spaces (lacunae) within tesserae. However, the function(s) of the chondrocytes in the mineralized tissue remain unknown. Applying a custom analysis workflow to high-resolution synchrotron microCT scans of tesserae, we characterize the morphologies and arrangements of stingray chondrocyte lacunae, using lacunar morphology as a proxy for chondrocyte morphology. We show that the cell density is comparable in unmineralized and mineralized tissue from our study species and that cells maintain the similar volume even when they have been incorporated into tesserae. This discovery supports previous hypotheses that elasmobranch chondrocytes, unlike those of other taxa, do not proliferate, hypertrophy or undergo apoptosis during mineralization. Tessera lacunae show zonal variation in their shapes—being flatter further from and more spherical closer to the unmineralized cartilage matrix and larger in the center of tesserae— and show pronounced organization into parallel layers and strong orientation toward neighboring tesserae. Tesserae also exhibit local variation in lacunar density, with the density considerably higher near pores passing through the tesseral layer, suggesting pores and cells interact (e.g. that pores contain a nutrient source). We hypothesize that the different lacunar types reflect the stages of the tesserae formation process, while also representing local variation in tissue architecture and cell function. Lacunae are linked by small passages (canaliculi) in the matrix to form elongate series at the tesseral periphery and tight clusters in the center of tesserae, creating a rich connectivity among cells. The network arrangement and the shape variation of chondrocytes in tesserae indicate that cells may interact within and between tesserae and manage mineralization differently from chondrocytes in other vertebrates, perhaps performing analogous roles to osteocytes in bone.
The temporally and spatially resolved tracking of lithium intercalation and electrode degradation processes are crucial for detecting and understanding performance losses during the operation of lithium-batteries. Here, high-throughput X-ray computed tomography has enabled the identification of mechanical degradation processes in a commercial Li/MnO2 primary battery and the indirect tracking of lithium diffusion; furthermore, complementary neutron computed tomography has identified the direct lithium diffusion process and the electrode wetting by the electrolyte. Virtual electrode unrolling techniques provide a deeper view inside the electrode layers and are used to detect minor fluctuations which are difficult to observe using conventional three dimensional rendering tools. Moreover, the ‘unrolling’ provides a platform for correlating multi-modal image data which is expected to find wider application in battery science and engineering to study diverse effects e.g. electrode degradation or lithium diffusion blocking during battery cycling.
In individuals of similar body mass representing closely related species with different lifestyles, muscle architectural properties can be assumed to reflect adaptation to differing, lifestyle-related functional demands. We here employ a fiber recognition algorithm on contrast-enhanced micro-computed tomography (μCT) scans of one specimen each of an arboreal (Sciurus vulgaris) and a fossorial (Spermophilus citellus) sciuromorph rodent. The automated approach accounts for potential heterogeneity of architectural properties within a muscle by analyzing all fascicles that compose a muscle. Muscle architectural properties (volume, fascicle length, and orientation, and force-generating capacity) were quantified in 14 hindlimb (hip, knee, and ankle) extensor muscles and compared between specimens. We expected the arboreal squirrel to exhibit greater force-generating capacity and a greater capacity for length change allowing more powerful hindlimb extension. Generally and mostly matching our expectations, the S. vulgaris specimen had absolutely and relatively larger extensor muscles than the S. citellus specimen which were thus metabolically more expensive and demonstrate the relatively larger investment into powerful hindlimb extension necessary in the arboreal context. We conclude that detailed quantitative data on hindlimb muscle internal structure as was gathered here for a very limited sample further lends support to the notion that muscle architecture reflects adaptation to differential functional demands in closely related species with different locomotor behaviors and lifestyles.
The historical importance of ancient manuscripts is unique since they provide information about the heritage of ancient cultures. Often texts are hidden in rolled or folded documents. Due to recent impro- vements in sensitivity and resolution, spectacular disclosures of rolled hidden texts were possible by X-ray tomography. However, revealing text on folded manuscripts is even more challenging. Manual unfolding is often too risky in view of the fragile condition of fragments, as it can lead to the total loss of the document. X-ray tomography allows for virtual unfolding and enables non-destructive access to hid- den texts. We have recently demonstrated the procedure and tested unfolding algorithms on a mockup sample. Here, we present results on unfolding ancient papyrus packages from the papyrus collection of the Musée du Louvre, among them objects folded along approximately orthogonal folding lines. In one of the packages, the first identification of a word was achieved, the Coptic word for “Lord”.
The historical importance of ancient manuscripts is unique since they provide information about the heritage of ancient cultures. Often texts are hidden in rolled or folded documents. Due to recent impro- vements in sensitivity and resolution, spectacular disclosures of rolled hidden texts were possible by X-ray tomography. However, revealing text on folded manuscripts is even more challenging. Manual unfolding is often too risky in view of the fragile condition of fragments, as it can lead to the total loss of the document. X-ray tomography allows for virtual unfolding and enables non-destructive access to hid- den texts. We have recently demonstrated the procedure and tested unfolding algorithms on a mockup sample. Here, we present results on unfolding ancient papyrus packages from the papyrus collection of the Musée du Louvre, among them objects folded along approximately orthogonal folding lines. In one of the packages, the first identification of a word was achieved, the Coptic word for “Lord”.
High-Throughput Segmentation of Tiled Biological Structures using Random-Walk Distance Transforms
(2019)
Various 3D imaging techniques are routinely used to examine biological materials, the results of which are usually a stack of grayscale images. In order to quantify structural aspects of the biological materials, however, they must first be extracted from the dataset in a process called segmentation. If the individual structures to be extracted are in contact or very close to each other, distance-based segmentation methods utilizing the Euclidean distance transform are commonly employed. Major disadvantages of the Euclidean distance transform, however, are its susceptibility to noise (very common in biological data), which often leads to incorrect segmentations (i.e. poor separation of objects of interest), and its limitation of being only effective for roundish objects. In the present work, we propose an alternative distance transform method, the random-walk distance transform, and demonstrate its effectiveness in high-throughput segmentation of three microCT datasets of biological tilings (i.e. structures composed of a large number of similar repeating units). In contrast to the Euclidean distance transform, this random-walk approach represents the global, rather than the local, geometric character of the objects to be segmented and, thus, is less susceptible to noise. In addition, it is directly applicable to structures with anisotropic shape characteristics. Using three case studies—stingray tessellated cartilage, starfish dermal endoskeleton, and the prismatic layer of bivalve mollusc shell—we provide a typical workflow for the segmentation of tiled structures, describe core image processing concepts that are underused in biological research, and show that for each study system, large amounts of biologically-relevant data can be rapidly segmented, visualized and analyzed.
High-Throughput Segmentation of Tiled Biological Structures using Random-Walk Distance Transforms
(2019)
Various 3D imaging techniques are routinely used to examine biological materials, the results of which are usually a stack of grayscale images. In order to quantify structural aspects of the biological materials, however, they must first be extracted from the dataset in a process called segmentation. If the individual structures to be extracted are in contact or very close to each other, distance-based segmentation methods utilizing the Euclidean distance transform are commonly employed. Major disadvantages of the Euclidean distance transform, however, are its susceptibility to noise (very common in biological data), which often leads to incorrect segmentations (i.e. poor separation of objects of interest), and its limitation of being only effective for roundish objects. In the present work, we propose an alternative distance transform method, the random-walk distance transform, and demonstrate its effectiveness in high-throughput segmentation of three microCT datasets of biological tilings (i.e. structures composed of a large number of similar repeating units). In contrast to the Euclidean distance transform, this random-walk approach represents the global, rather than the local, geometric character of the objects to be segmented and, thus, is less susceptible to noise. In addition, it is directly applicable to structures with anisotropic shape characteristics. Using three case studies—stingray tessellated cartilage, starfish dermal endoskeleton, and the prismatic layer of bivalve mollusc shell—we provide a typical workflow for the segmentation of tiled structures, describe core image processing concepts that are underused in biological research, and show that for each study system, large amounts of biologically-relevant data can be rapidly segmented, visualized and analyzed.
We show how biologically coherent mesh models of animals can be created from μCT data to generate artificial yet naturally looking intermediate objects. The whole pipeline of processing algorithms is presented, starting from generating topologically equivalent surface meshes, followed by solving the correspondence problem, and, finally, creating a surface morphing. In this pipeline, we address all the challenges that are due to dealing with complex biological, non-isometric objects. For biological objects it is often particularly important to obtain deformations that look as realistic as possible. In addition, spatially non-uniform shape morphings that only change one part of the surface and keep the rest as stable as possible are of interest for evolutionary studies, since functional modules often change independently from one another. We use Poisson interpolation for this purpose and show that it is well suited to generate both global and local shape deformations.
We show how biologically coherent mesh models of animals can be created from μCT data to generate artificial yet naturally looking intermediate objects. The whole pipeline of processing algorithms is presented, starting from generating topologically equivalent surface meshes, followed by solving the correspondence problem, and, finally, creating a surface morphing. In this pipeline, we address all the challenges that are due to dealing with complex biological, non-isometric objects. For biological objects it is often particularly important to obtain deformations that look as realistic as possible. In addition, spatially non-uniform shape morphings that only change one part of the surface and keep the rest as stable as possible are of interest for evolutionary studies, since functional modules often change independently from one another. We use Poisson interpolation for this purpose and show that it is well suited to generate both global and local shape deformations.
The analysis and visualization of nucleic acids (RNA and DNA) is playing an increasingly important role due to their fundamental importance for all forms of life and the growing number of known 3D structures of such molecules. The great complexity of these structures, in particular, those of RNA, demands interactive visualization to get deeper insights into the relationship between the 2D secondary structure motifs and their 3D tertiary structures. Over the last decades, a lot of research in molecular visualization has focused on the visual exploration of protein structures while nucleic acids have only been marginally addressed. In contrast to proteins, which are composed of amino acids, the ingredients of nucleic acids are nucleotides. They form structuring patterns that differ from those of proteins and, hence, also require different visualization and exploration techniques. In order to support interactive exploration of nucleic acids, the computation of secondary structure motifs as well as their visualization in 2D and 3D must be fast. Therefore, in this paper, we focus on the performance of both the computation and visualization of nucleic acid structure. We present a ray casting-based visualization of RNA and DNA secondary and tertiary structures, which enables for the first time real-time visualization of even large molecular dynamics trajectories. Furthermore, we provide a detailed description of all important aspects to visualize nucleic acid secondary and tertiary structures. With this, we close an important gap in molecular visualization.
The analysis and visualization of nucleic acids (RNA and DNA) play an increasingly important role due to the growing number of known 3-dimensional structures of such molecules. The great complexity of these structures, in particular, those of RNA, demands interactive visualization to get deeper insights into the relationship between the 2D secondary structure motifs and their 3D tertiary structures. Over the last decades, a lot of research in molecular visualization has focused on the visual exploration of protein structures while nucleic acids have only been marginally addressed. In contrast to proteins, which are composed of amino acids, the ingredients of nucleic acids are nucleotides. They form structuring patterns that differ from those of proteins and, hence, also require different visualization and exploration techniques. In order to support interactive exploration of nucleic acids, the computation of secondary structure motifs as well as their visualization in 2D and 3D must be fast. Therefore, in this paper, we focus on the performance of both the computation and visualization of nucleic acid structure. For the first time, we present a ray casting-based visualization of RNA and DNA secondary and tertiary structures, which enables real-time visualization of even large molecular dynamics trajectories. Furthermore, we provide a detailed description of all important aspects to visualize nucleic acid secondary and tertiary structures. With this, we close an important gap in molecular visualization.
In molecular structure analysis and visualization, the molecule’s atoms are often modeled as hard spheres parametrized by their positions and radii. While the atom positions result from experiments or molecular simulations, for the radii typically values are taken from literature. Most often, van der Waals (vdW) radii are used, for which diverse values exist. As a consequence, different visualization and analysis tools use different atomic radii, and the analyses are less objective than often believed. Furthermore, for the geometric accessibility analysis of molecular structures, vdW radii are not well suited. The reason is that during the molecular dynamics simulation, depending on the force field and the kinetic energy in the system, non-bonded atoms can come so close to each other that their vdW spheres intersect. In this paper, we introduce a new kind of atomic radius, called atomic accessibility radius’, that better characterizes the accessibility of an atom in a given molecular trajectory. The new radii reflect the movement possibilities of atoms in the simulated physical system. They are computed by solving a linear program that maximizes the radii of the atoms under the constraint that non-bonded spheres do not intersect in the considered molecular trajectory. Using this data-driven approach, the actual accessibility of atoms can be visualized more precisely.
In molecular structure analysis and visualization, the molecule’s atoms are often modeled as hard spheres parametrized by their positions and radii. While the atom positions result from experiments or molecular simulations, for the radii typically values are taken from literature. Most often, van der Waals (vdW) radii are used, for which diverse values exist. As a consequence, different visualization and analysis tools use different atomic radii, and the analyses are less objective than often believed. Furthermore, for the geometric accessibility analysis of molecular structures, vdW radii are not well suited. The reason is that during the molecular dynamics simulation, depending on the force field and the kinetic energy in the system, non-bonded atoms can come so close to each other that their vdW spheres intersect. In this paper, we introduce a new kind of atomic radius, called atomic accessibility radius’, that better characterizes the accessibility of an atom in a given molecular trajectory. The new radii reflect the movement possibilities of atoms in the simulated physical system. They are computed by solving a linear program that maximizes the radii of the atoms under the constraint that non-bonded spheres do not intersect in the considered molecular trajectory. Using this data-driven approach, the actual accessibility of atoms can be visualized more precisely.
During the last decades, X-ray (micro-)computed tomography has gained increasing attention for the description of porous skeletal and shell structures of various organism groups. However, their quantitative analysis is often hampered by the difficulty to discriminate cavities and pores within the object from the surrounding region. Herein, we test the ambient occlusion (AO) algorithm and newly implemented optimisations for the segmentation of cavities (implemented in the software Amira). The segmentation accuracy is evaluated as a function of (i) changes in the ray length input variable, and (ii) the usage of AO (scalar) field and other AO-derived (scalar) fields. The results clearly indicate that the AO field itself outperforms all other AO-derived fields in terms of segmentation accuracy and robustness against variations in the ray length input variable. The newly implemented optimisations improved the AO field-based segmentation only slightly, while the segmentations based on the AO-derived fields improved considerably. Additionally, we evaluated the potential of the AO field and AO-derived fields for the separation and classification of cavities as well as skeletal structures by comparing them with commonly used distance-map-based segmentations. For this, we tested the zooid separation within a bryozoan colony, the stereom classification of an ophiuroid tooth, the separation of bioerosion traces within a marble block and the calice (central cavity)-pore separation within a dendrophyllid coral. The obtained results clearly indicate that the ideal input field depends on the three-dimensional morphology of the object of interest. The segmentations based on the AO-derived fields often provided cavity separations and skeleton classifications that were superior to or impossible to obtain with commonly used distance- map-based segmentations. The combined usage of various AO-derived fields by supervised or unsupervised segmentation algorithms might provide a promising target for future research to further improve the results for this kind of high-end data segmentation and classification. Furthermore, the application of the developed segmentation algorithm is not restricted to X-ray (micro-)computed tomographic data but may potentially be useful for the segmentation of 3D volume data from other sources.
During the last decades, X-ray (micro-)computed tomography has gained increasing attention for the description of porous skeletal and shell structures of various organism groups. However, their quantitative analysis is often hampered by the difficulty to discriminate cavities and pores within the object from the surrounding region. Herein, we test the ambient occlusion (AO) algorithm and newly implemented optimisations for the segmentation of cavities (implemented in the software Amira). The segmentation accuracy is evaluated as a function of (i) changes in the ray length input variable, and (ii) the usage of AO (scalar) field and other AO-derived (scalar) fields. The results clearly indicate that the AO field itself outperforms all other AO-derived fields in terms of segmentation accuracy and robustness against variations in the ray length input variable. The newly implemented optimisations improved the AO field-based segmentation only slightly, while the segmentations based on the AO-derived fields improved considerably. Additionally, we evaluated the potential of the AO field and AO-derived fields for the separation and classification of cavities as well as skeletal structures by comparing them with commonly used distance-map-based segmentations. For this, we tested the zooid separation within a bryozoan colony, the stereom classification of an ophiuroid tooth, the separation of bioerosion traces within a marble block and the calice (central cavity)-pore separation within a dendrophyllid coral. The obtained results clearly indicate that the ideal input field depends on the three-dimensional morphology of the object of interest. The segmentations based on the AO-derived fields often provided cavity separations and skeleton classifications that were superior to or impossible to obtain with commonly used distance- map-based segmentations. The combined usage of various AO-derived fields by supervised or unsupervised segmentation algorithms might provide a promising target for future research to further improve the results for this kind of high-end data segmentation and classification. Furthermore, the application of the developed segmentation algorithm is not restricted to X-ray (micro-)computed tomographic data but may potentially be useful for the segmentation of 3D volume data from other sources.
Comets display with decreasing solar distance an increased emission of gas and dust particles, leading to the formation of the coma and tail. Spacecraft missions provide insight in the temporal and spatial variations of the dust and gas sources located on the cometary nucleus. For the case of comet 67P/Churyumov-Gerasimenko (67P/C-G), the long-term obser- vations from the Rosetta mission point to a homogeneous dust emission across the entire illuminated surface. Despite the homogeneous initial dis- tribution, a collimation in jet-like structures becomes visible. We propose that this observation is linked directly to the complex shape of the nucleus and projects concave topographical features into the dust coma. To test this hypothesis, we put forward a gas-dust description of 67P/C-G, where gravitational and gas forces are accurately determined from the surface mesh and the rotation of the nucleus is fully incorporated. The emerging jet-like structures persist for a wide range of gas-dust interactions and show a dust velocity dependent bending.
Supplementary data to reproduce and understand key results from the related publication, including original image data and processed data. In particular, sections from hyomandibulae harvested from specimens of round stingray Urobatis halleri, donated from another study (DOI: 10.1002/etc.2564). Specimens were from sub-adults/adults collected by beach seine from collection sites in San Diego and Seal Beach, California, USA. The hyomandibulae were mounted in clay, sealed in ethanol-humidified plastic tubes and scanned with a Skyscan 1172 desktop μCT scanner (Bruker μCT, Kontich, Belgium) in association with another study (DOI: 10.1111/joa.12508). Scans for all samples were performed with voxel sizes of 4.89 μm at 59 kV source voltage and 167 μA source current, over 360◦ sample 120 rotation. For our segmentations, the datasets were resampled to a voxel size of 9.78 μm to reduce the size of the images and speed up processing. In addition, the processed data that was generated with the visualization software Amira with techniques described in the related publication based on the mentioned specimens.
Comets display with decreasing solar distance an increased emission of gas and dust particles, leading to the formation of the coma and tail. Spacecraft missions provide insight in the temporal and spatial variations of the dust and gas sources located on the cometary nucleus. For the case of comet 67P/Churyumov-Gerasimenko (67P/C-G), the long-term obser- vations from the Rosetta mission point to a homogeneous dust emission across the entire illuminated surface. Despite the homogeneous initial dis- tribution, a collimation in jet-like structures becomes visible. We propose that this observation is linked directly to the complex shape of the nucleus and projects concave topographical features into the dust coma. To test this hypothesis, we put forward a gas-dust description of 67P/C-G, where gravitational and gas forces are accurately determined from the surface mesh and the rotation of the nucleus is fully incorporated. The emerging jet-like structures persist for a wide range of gas-dust interactions and show a dust velocity dependent bending.
Introduction – Many biological structures show recurring tiling patterns on one structural level or the other. Current image acquisition techniques are able to resolve those tiling patterns to allow quantitative analyses. The resulting image data, however, may contain an enormous number of elements. This renders manual image analysis infeasible, in particular when statistical analysis is to be conducted, requiring a larger number of image data to be analyzed. As a consequence, the analysis process needs to be automated to a large degree. In this paper, we describe a multi-step image segmentation pipeline for the automated segmentation of the calcified cartilage into individual tesserae from computed tomography images of skeletal elements of stingrays.
Methods – Besides applying state-of-the-art algorithms like anisotropic diffusion smoothing, local thresholding for foreground segmentation, distance map calculation, and hierarchical watershed, we exploit a graph-based representation for fast correction of the segmentation. In addition, we propose a new distance map that is computed only in the plane that locally best approximates the calcified cartilage. This distance map drastically improves the separation of individual tesserae. We apply our segmentation pipeline to hyomandibulae from three individuals of the round stingray (Urobatis halleri), varying both in age and size.
Results – Each of the hyomandibula datasets contains approximately 3000 tesserae. To evaluate the quality of the automated segmentation, four expert users manually generated ground truth segmentations of small parts of one hyomandibula. These ground truth segmentations allowed us to compare the segmentation quality w.r.t. individual tesserae. Additionally, to investigate the segmentation quality of whole skeletal elements, landmarks were manually placed on all tesserae and their positions were then compared to the segmented tesserae. With the proposed segmentation pipeline, we sped up the processing of a single skeletal element from days or weeks to a few hours.
Introduction – Many biological structures show recurring tiling patterns on one structural level or the other. Current image acquisition techniques are able to resolve those tiling patterns to allow quantitative analyses. The resulting image data, however, may contain an enormous number of elements. This renders manual image analysis infeasible, in particular when statistical analysis is to be conducted, requiring a larger number of image data to be analyzed. As a consequence, the analysis process needs to be automated to a large degree. In this paper, we describe a multi-step image segmentation pipeline for the automated segmentation of the calcified cartilage into individual tesserae from computed tomography images of skeletal elements of stingrays.
Methods – Besides applying state-of-the-art algorithms like anisotropic diffusion smoothing, local thresholding for foreground segmentation, distance map calculation, and hierarchical watershed, we exploit a graph-based representation for fast correction of the segmentation. In addition, we propose a new distance map that is computed only in the plane that locally best approximates the calcified cartilage. This distance map drastically improves the separation of individual tesserae. We apply our segmentation pipeline to hyomandibulae from three individuals of the round stingray (Urobatis halleri), varying both in age and size.
Results – Each of the hyomandibula datasets contains approximately 3000 tesserae. To evaluate the quality of the automated segmentation, four expert users manually generated ground truth segmentations of small parts of one hyomandibula. These ground truth segmentations allowed us to compare the segmentation quality w.r.t. individual tesserae. Additionally, to investigate the segmentation quality of whole skeletal elements, landmarks were manually placed on all tesserae and their positions were then compared to the segmented tesserae. With the proposed segmentation pipeline, we sped up the processing of a single skeletal element from days or weeks to a few hours.
Adapting trabecular structures for 3D printing: an image processing approach based on µCT data
(2017)
Materials with a trabecular structure notably combine advantages such as lightweight, reasonable strength, and permeability for fluids. This combination of advantages is especially interesting for tissue engineering in trauma surgery and orthopedics. Bone-substituting scaffolds for instance are designed with a trabecular structure in order to allow cell migration for bone ingrowth and vascularization. An emerging and recently very popular technology to produce such complex, porous structures is 3D printing. However, several technological aspects regarding the scaffold architecture, the printable resolution, and the feature size have to be considered when fabricating scaffolds for bone tissue replacement and regeneration.
Here, we present a strategy to assess and prepare realistic trabecular structures for 3D printing using image analysis with the aim of preserving the structural elements. We discuss critical conditions of the printing system and present a 3-stage approach to adapt a trabecular structure from $\mu$CT data while incorporating knowledge about the printing system. In the first stage, an image-based extraction of solid and void structures is performed, which results in voxel- and graph-based representations of the extracted structures. These representations not only allow us to quantify geometrical properties such as pore size or strut geometry and length. But, since the graph represents the geometry and the topology of the initial structure, it can be used in the second stage to modify and adjust feature size, volume and sample size in an easy and consistent way. In the final reconstruction stage, the graph is then converted into a voxel representation preserving the topology of the initial structure. This stage generates a model with respect to the printing conditions to ensure a stable and controlled voxel placement during the printing process.
Geometric morphometrics plays an important role in evolutionary studies. The state-of-the-art in this field are landmark-based methods. Since the landmarks usually need to be placed manually, only a limited number of landmarks are generally used to represent the shape of an anatomical structure. As a result, shape characteristics that cannot be properly represented by small sets of landmarks are disregarded.
In this study, we present a method that is free of this limitation. The method takes into account the whole shape of an anatomical structure, which is represented as a surface, hence the term ‘surface-based morphometrics’. Correspondence between two surfaces is established by defining a partitioning of the surfaces into homologous surface patches. The first step for the generation of a surface partitioning is to place landmarks on the surface. Subsequently, the landmarks are connected by curves lying on the surface. The curves, called ‘surface paths’, might either follow specific anatomical features or they can be geodesics, that is, shortest paths on the surface. One important requirement, however, is that the resulting surface path networks are topologically equivalent across all surfaces. Once the surface path networks have been defined, the surfaces are decomposed into patches according to the path networks.
This approach has several advantages. One of them is that we can discretize the surface by as many points as desired. Thus, even fine shape details can be resolved if this is of interest for the study. Since a point discretization is used, another advantage is that well-established analysis methods for landmark-based morphometrics can be utilized. Finally, the shapes can be easily morphed into one another, thereby greatly supporting the understanding of shape changes across all considered specimens.
To show the potential of the described method for evolutionary studies of biological specimens, we applied the method to the para-basisphenoid complex of the snake genus Eirenis. By using this anatomical structure as example, we present all the steps that are necessary for surface-based morphometrics, including the segmentation of the para-basisphenoid complex from micro-CT data sets. We also show some first results using statistical analysis as well as classification methods based on the presented technique.
Adapting trabecular structures for 3D printing: an image processing approach based on µCT data
(2017)
Materials with a trabecular structure notably combine advantages such as lightweight, reasonable strength, and permeability for fluids. This combination of advantages is especially interesting for tissue engineering in trauma surgery and orthopedics. Bone-substituting scaffolds for instance are designed with a trabecular structure in order to allow cell migration for bone ingrowth and vascularization. An emerging and recently very popular technology to produce such complex, porous structures is 3D printing. However, several technological aspects regarding the scaffold architecture, the printable resolution, and the feature size have to be considered when fabricating scaffolds for bone tissue replacement and regeneration.
Here, we present a strategy to assess and prepare realistic trabecular structures for 3D printing using image analysis with the aim of preserving the structural elements. We discuss critical conditions of the printing system and present a 3-stage approach to adapt a trabecular structure from $\mu$CT data while incorporating knowledge about the printing system. In the first stage, an image-based extraction of solid and void structures is performed, which results in voxel- and graph-based representations of the extracted structures. These representations not only allow us to quantify geometrical properties such as pore size or strut geometry and length. But, since the graph represents the geometry and the topology of the initial structure, it can be used in the second stage to modify and adjust feature size, volume and sample size in an easy and consistent way. In the final reconstruction stage, the graph is then converted into a voxel representation preserving the topology of the initial structure. This stage generates a model with respect to the printing conditions to ensure a stable and controlled voxel placement during the printing process.