Refine
Year of publication
Document Type
- Article (66)
- ZIB-Report (28)
- In Proceedings (24)
- Poster (6)
- Research data (4)
- In Collection (2)
- Book chapter (1)
- Doctoral Thesis (1)
- Other (1)
- Software (1)
Is part of the Bibliography
- no (134)
Keywords
- 2D distance map (1)
- Amira (1)
- Beton (1)
- Bildverarbeitung (1)
- Bron-Kerbosch algorithm (1)
- Computertomografie (1)
- Cultural Heritage (1)
- DNA (1)
- Geometry processing (1)
- HCI (1)
Background: Despite recent advances in cellular cryo-electron tomography (CET), developing automated tools for macromolecule identification in submolecular resolution remains challenging due to the lack of annotated data and high structural complexities. To date, the extent of the deep learning methods constructed for this problem is limited to conventional Convolutional Neural Networks (CNNs). Identifying macromolecules of different types and sizes is a tedious and time-consuming task. In this paper, we employ a capsule-based architecture to automate the task of macro- molecule identification, that we refer to as 3D-UCaps. In particular, the architecture is composed of three components: feature extractor, capsule encoder, and CNN decoder. The feature extractor converts voxel intensities of input sub-tomograms to activities of local features. The encoder is a 3D Capsule Network (CapsNet) that takes local features to generate a low-dimensional representation of the input. Then, a 3D CNN decoder reconstructs the sub-tomograms from the given representation by upsampling.
Results: We performed binary and multi-class localization and identification tasks on synthetic and experimental data. We observed that the 3D-UNet and the 3D-UCaps had an F1−score mostly above 60% and 70%, respectively, on the test data. In both network architectures, we observed degradation of at least 40% in the F1-score when identifying very small particles (PDB entry 3GL1) compared to a large particle (PDB entry 4D8Q). In the multi-class identification task of experimental data, 3D-UCaps had an F1-score of 91% on the test data in contrast to 64% of the 3D-UNet. The better F1-score of 3D-UCaps compared to 3D-UNet is obtained by a higher precision score. We speculate this to be due to the capsule network employed in the encoder. To study the effect of the CapsNet-based encoder architecture further, we performed an ablation study and perceived that the F1-score is boosted as network depth is increased which
is in contrast to the previously reported results for the 3D-UNet. To present a reproducible work, source code, trained models, data as well as visualization results are made publicly available.
Conclusion: Quantitative and qualitative results show that 3D-UCaps successfully perform various downstream tasks including identification and localization of macro- molecules and can at least compete with CNN architectures for this task. Given that the capsule layers extract both the existence probability and the orientation of the molecules, this architecture has the potential to lead to representations of the data that are better interpretable than those of 3D-UNet.
Structural properties of molecules are of primary concern in many fields. This report provides a comprehensive overview on techniques that have been developed in the fields of molecular graphics and visualization with a focus on applications in structural biology. The field heavily relies on computerized geometric and visual representations of three-dimensional, complex, large and time-varying molecular structures. The report presents a taxonomy that demonstrates which areas of molecular visualization have already been extensively investigated and where the field is currently heading. It discusses visualizations for molecular structures, strategies for efficient display regarding image quality and frame rate, covers different aspects of level of detail and reviews visualizations illustrating the dynamic aspects of molecular simulation data. The survey concludes with an outlook on promising and important research topics to foster further success in the development of tools that help to reveal molecular secrets.
Structural properties of molecules are of primary concern in many fields. This report provides a comprehensive overview on techniques that have been developed in the fields of molecular graphics and visualization with a focus on applications in structural biology. The field heavily relies on computerized geometric and visual representations of three-dimensional, complex, large, and time-varying molecular structures. The report presents a taxonomy that demonstrates which areas of molecular visualization have already been extensively investigated and where the field is currently heading. It discusses visualizations for molecular structures, strategies for efficient display regarding image quality and frame rate, covers different aspects of level of detail, and reviews visualizations illustrating the dynamic aspects of molecular simulation data. The survey concludes with an outlook on promising and important research topics to foster further success in the development of tools that help to reveal molecular secrets.
Structural properties of molecules are of primary concern in many fields. This report provides a comprehensive overview on techniques that have been developed in the fields of molecular graphics and visualization with a focus on applications in structural biology. The field heavily relies on computerized geometric and visual representations of three-dimensional, complex, large, and time-varying molecular structures. The report presents a taxonomy that demonstrates which areas of molecular visualization have already been extensively investigated and where the field is currently heading. It discusses visualizations for molecular structures, strategies for efficient display regarding image quality and frame rate, covers different aspects of level of detail, and reviews visualizations illustrating the dynamic aspects of molecular simulation data. The report concludes with an outlook on promising and important research topics to enable further success in advancing the knowledge about interaction of molecular structures.
In this report we review and structure the branch of molecular visualization that is concerned with the visual analysis of cavities in macromolecular protein structures. First the necessary background, the domain terminology, and the goals of analytical reasoning are introduced. Based on a comprehensive collection of relevant research works, we present a novel classification for cavity detection approaches and structure them into four distinct classes: grid-based, Voronoi-based, surface-based, and probe-based methods. The subclasses are then formed by their combinations. We match these approaches with corresponding visualization technologies starting with direct 3D visualization, followed with non-spatial visualization techniques that for example abstract the interactions between structures into a relational graph, straighten the cavity of interest to see its profile in one view, or aggregate the time sequence into a single contour plot. We also discuss the current state of methods for the visual analysis of cavities in dynamic data such as molecular dynamics simulations. Finally, we give an overview of the most common tools that are actively developed and used in the structural biology and biochemistry research. Our report is concluded by an outlook on future challenges in the field.
In this report we review and structure the branch of molecular visualization that is concerned with the visual analysis of cavities in macromolecular protein structures. First the necessary background, the domain terminology, and the goals of analytical reasoning are introduced. Based on a comprehensive collection of relevant research works, we present a novel classification for cavity detection approaches and structure them into four distinct classes: grid-based, Voronoi-based, surface-based, and probe-based methods. The subclasses are then formed by their combinations. We match these approaches with corresponding visualization technologies starting with direct 3D visualization, followed with non-spatial visualization techniques that for example abstract the interactions between structures into a relational graph, straighten the cavity of interest to see its profile in one view, or aggregate the time sequence into a single contour plot. We also discuss the current state of methods for the visual analysis of cavities in dynamic data such as molecular dynamics simulations. Finally, we give an overview of the most common tools that are actively developed and used in the structural biology and biochemistry research. Our report is concluded by an outlook on future challenges in the field.
The historical importance of ancient manuscripts is unique since they provide information about the heritage of ancient cultures. Often texts are hidden in rolled or folded documents. Due to recent impro- vements in sensitivity and resolution, spectacular disclosures of rolled hidden texts were possible by X-ray tomography. However, revealing text on folded manuscripts is even more challenging. Manual unfolding is often too risky in view of the fragile condition of fragments, as it can lead to the total loss of the document. X-ray tomography allows for virtual unfolding and enables non-destructive access to hid- den texts. We have recently demonstrated the procedure and tested unfolding algorithms on a mockup sample. Here, we present results on unfolding ancient papyrus packages from the papyrus collection of the Musée du Louvre, among them objects folded along approximately orthogonal folding lines. In one of the packages, the first identification of a word was achieved, the Coptic word for “Lord”.
The historical importance of ancient manuscripts is unique since they provide information about the heritage of ancient cultures. Often texts are hidden in rolled or folded documents. Due to recent impro- vements in sensitivity and resolution, spectacular disclosures of rolled hidden texts were possible by X-ray tomography. However, revealing text on folded manuscripts is even more challenging. Manual unfolding is often too risky in view of the fragile condition of fragments, as it can lead to the total loss of the document. X-ray tomography allows for virtual unfolding and enables non-destructive access to hid- den texts. We have recently demonstrated the procedure and tested unfolding algorithms on a mockup sample. Here, we present results on unfolding ancient papyrus packages from the papyrus collection of the Musée du Louvre, among them objects folded along approximately orthogonal folding lines. In one of the packages, the first identification of a word was achieved, the Coptic word for “Lord”.
When physical unfolding/unrolling of papyri is not possible or too dangerous for preserving the precious object, tomographic approaches may be the ap- propriate alternative. Requirements are the resolution and the contrast to distinguish writing and substrate. The steps to be performed are the following: (1) Select the object of interest (archaeological arguments, cultural back- ground of the object, etc.). (2) Find the proper physical procedure, especially with respect to contrast, take the tomographic data, e.g. by absorption x-ray tomography. (3) Apply mathematical unfolding transformations to the tomographic data, in order to obtain a 2d-planar reconstruction of text.
Understanding the Tiling Rules of the Tessellated Mineralized Endoskeleton of Sharks and Rays
(2016)
The endoskeletons of sharks and rays are composed of an unmineralized cartilaginous core, covered in an outer layer of mineralized tiles called tesserae. The tessellated layer is vital to the growth as well as the material properties of the skeletal element, providing both flexibility and strength. However, characterizing the relationship between tesseral size and shape, and skeletal growth and mechanics is challenging because tesserae are small (a few hundred micrometers wide), anchored to the surrounding tissue in complex three-dimensional ways, and occur in huge numbers. Using a custom-made semi-automatic segmentation algorithm, we present the first quantitative and three-dimensional description of tesserae in micro-CT scans of whole skeletal elements. Our segmentation algorithm relies on aspects we have learned of general tesseral morphology. We exploit the distance map of the mineralized layer to separate individual tiles using a hierarchical watershed algorithm. Additionally, we have developed post-processing techniques to quickly correct segmentation errors. Our data reveals that the tessellation is not regular, with tesserae showing a great range of shapes, sizes and number of neighbors. This is partly region-dependent: for example, thick, columnar tesserae are arranged in series along convex edges with small radius of curvature (RoC), whereas more brick-or disc-shaped tesserae are found in planar areas. We apply our newly developed techniques on the left and right hyomandibula (skeletal elements supporting the jaws) from four different ages of a stingray species, to clarify how tiling patterns develop across ontogeny and differ within and between individuals. We evaluate the functional consequences of tesseral morphologies using finite element analysis and 3d-printing, for a better understanding of shark skeletal mechanics, but also to extract fundamental engineering design principles of tiling arrangements on load-bearing three-dimensional objects.
Two new species of cheilostome Bryozoa are described from continental-slope habitats off Mauritania, including canyon and coldwater-coral (mound) habitats. Internal structures of both species were visualised and quantified using micro-computed tomographic (micro-CT) methods. Cellaria bafouri n. sp. is characterised by the arrangement of zooids in alternating longitudinal rows, a smooth cryptocyst, and the presence of an ooecial plate with denticles. Smittina imragueni n. sp. exhibits many similarities with Smittina cervicornis (Pallas, 1766), but differs especially in the shape and orientation of the suboral avicularium. Observations on Smittina imragueni and material labelled as Smittina cervicornis suggest that the latter represents a species group, members of which have not yet been discriminated, possibly because of high intracolony variation and marked astogenetic changes in surface morphology. Both new species are known only from the habitats where they were collected, probably reflecting the paucity of bryozoan sampling from this geographic area and depth range. Both species are able to tolerate low oxygen concentration, which is assumed to be compensated by the high nutrient supply off Mauritania. The application of micro-CT for the semiautomatic quantification of zooidal skeletal characters was successfully tested. We were able to automatically distinguish individual zooidal cavities and acquire corresponding morphological datasets. Comparing the obtained results with conventional SEM measurements allowed ascertaining the reliability of this new method. The employment of micro-CT allows the observation and quantification of previously un- seen characters that can be used in describing and differentiating species that were previously indistinguishable. Further- more, this method might help elucidate processes of colony growth and the function of individual zooids during this process.
The endoskeleton of sharks and rays (elasmobranchs) is comprised of a cartilaginous core, covered by thousands of mineralized tiles, called tesserae. Characterizing the relationship between tesseral morphometrics, skeletal growth and mechanics is challenging because tesserae are small (a few hundred micrometers wide), anchored to the surrounding tissue in complex three-dimensional ways, and occur in huge numbers. We integrate material property, histology, electron microscopy and synchrotron and laboratory µCT scans of skeletal elements from an ontogenetic series of round stingray Urobatis halleri, to gain insights into the generation and maintenance of a natural tessellated system. Using a custom-made semiautomatic segmentation algorithm, we present the first quantitative and 3d description of tesserae across whole skeletal elements. The tessellation is not interlocking or regular, with tesserae showing a great range of shapes, sizes and number of neighbors. This is partly region-dependent: for example, thick, columnar tesserae are arranged in series along convex edges with small radius of curvature (RoC), whereas more brick- or disc-shaped tesserae are found in planar/flatter areas. Comparison of the tessellation across ontogeny, shows that in younger animals, the forming tesseral network is less densely packed, appearing as a covering of separate, poorly mineralized islands that grow together with age to form a complete surface. Some gaps in the tessellation are localized to specific regions in all samples, indicating they are real features, perhaps either regions of delayed mineralization or of tendon insertion. We will use the structure of elasmobranch skeletons as a road map for understanding shark and ray skeletal mechanics, but also to extract fundamental engineering principles for tiled composite materials.
During cell division, kinetochore microtubules (KMTs) provide a physical linkage between the chromosomes and the rest of the spindle. KMTs in mammalian cells are organized into bundles, so-called kinetochore-fibers (k-fibers), but the ultrastructure of these fibers is currently not well characterized. Here we show by large-scale electron tomography that each k-fiber in HeLa cells in metaphase is composed of approximately nine KMTs, only half of which reach the spindle pole. Our comprehensive reconstructions allowed us to analyze the three-dimensional (3D) morphology of k-fibers and their surrounding MTs in detail. We found that k-fibers exhibit remarkable variation in circumference and KMT density along their length, with the pole-proximal side showing a broadening. Extending our structural analysis then to other MTs in the spindle, we further observed that the association of KMTs with non-KMTs predominantly occurs in the spindle pole regions. Our 3D reconstructions have implications for KMT growth and k-fiber self-organization models as covered in a parallel publication applying complementary live-cell imaging in combination with biophysical modeling (Conway et al., 2022). Finally, we also introduce a new visualization tool allowing an interactive display of our 3D spindle data that will serve as a resource for further structural studies on mitosis in human cells.
Thin, curved structures occur in many volumetric datasets. Their analysis using classical volume rendering is difficult because parts of such structures can bend away or hide behind occluding elements. This problem cannot be fully compensated by effective navigation alone, because structure-adapted navigation in the volume is cumbersome and only parts of the structure are visible in each view.
We solve this problem by rendering a spatially transformed view into the volume so that an unobscured visualization of the entire curved structure is obtained. As a result, simple and intuitive navigation becomes possible. The domain of the spatial transform is defined by a triangle mesh that is topologically equivalent to an open disc and that approximates the structure of interest. The rendering is based on ray-casting in which the rays traverse the original curved sub-volume. In order to carve out volumes of varying thickness, the lengths of the rays as well as the position of the mesh vertices can be easily modified in a view-controlled manner by interactive painting. We describe a prototypical implementation and demonstrate the interactive visual inspection of complex structures from digital humanities, biology, medicine, and materials science. Displaying the structure as a whole enables simple inspection of interesting substructures in their original spatial context.
Overall, we show that transformed views utilizing ray-casting-based volume rendering supported by guiding surface meshes and supplemented by local, interactive modifications of ray lengths and vertex positions, represent a simple but versatile approach to effectively visualize thin, curved structures in volumetric data.
Geometric morphometrics plays an important role in evolutionary studies. The state-of-the-art in this field are landmark-based methods. Since the landmarks usually need to be placed manually, only a limited number of landmarks are generally used to represent the shape of an anatomical structure. As a result, shape characteristics that cannot be properly represented by small sets of landmarks are disregarded.
In this study, we present a method that is free of this limitation. The method takes into account the whole shape of an anatomical structure, which is represented as a surface, hence the term ‘surface-based morphometrics’. Correspondence between two surfaces is established by defining a partitioning of the surfaces into homologous surface patches. The first step for the generation of a surface partitioning is to place landmarks on the surface. Subsequently, the landmarks are connected by curves lying on the surface. The curves, called ‘surface paths’, might either follow specific anatomical features or they can be geodesics, that is, shortest paths on the surface. One important requirement, however, is that the resulting surface path networks are topologically equivalent across all surfaces. Once the surface path networks have been defined, the surfaces are decomposed into patches according to the path networks.
This approach has several advantages. One of them is that we can discretize the surface by as many points as desired. Thus, even fine shape details can be resolved if this is of interest for the study. Since a point discretization is used, another advantage is that well-established analysis methods for landmark-based morphometrics can be utilized. Finally, the shapes can be easily morphed into one another, thereby greatly supporting the understanding of shape changes across all considered specimens.
To show the potential of the described method for evolutionary studies of biological specimens, we applied the method to the para-basisphenoid complex of the snake genus Eirenis. By using this anatomical structure as example, we present all the steps that are necessary for surface-based morphometrics, including the segmentation of the para-basisphenoid complex from micro-CT data sets. We also show some first results using statistical analysis as well as classification methods based on the presented technique.