TY - JOUR A1 - Mikula, Natalia A1 - Dörffel, Tom A1 - Baum, Daniel A1 - Hege, Hans-Christian T1 - An Interactive Approach for Identifying Structure Definitions JF - Computer Graphics Forum N2 - Our ability to grasp and understand complex phenomena is essentially based on recognizing structures and relating these to each other. For example, any meteorological description of a weather condition and explanation of its evolution recurs to meteorological structures, such as convection and circulation structures, cloud fields and rain fronts. All of these are spatiotemporal structures, defined by time-dependent patterns in the underlying fields. Typically, such a structure is defined by a verbal description that corresponds to the more or less uniform, often somewhat vague mental images of the experts. However, a precise, formal definition of the structures or, more generally, concepts is often desirable, e.g., to enable automated data analysis or the development of phenomenological models. Here, we present a systematic approach and an interactive tool to obtain formal definitions of spatiotemporal structures. The tool enables experts to evaluate and compare different structure definitions on the basis of data sets with time-dependent fields that contain the respective structure. Since structure definitions are typically parameterized, an essential part is to identify parameter ranges that lead to desired structures in all time steps. In addition, it is important to allow a quantitative assessment of the resulting structures simultaneously. We demonstrate the use of the tool by applying it to two meteorological examples: finding structure definitions for vortex cores and center lines of temporarily evolving tropical cyclones. Ideally, structure definitions should be objective and applicable to as many data sets as possible. However, finding such definitions, e.g., for the common atmospheric structures in meteorology, can only be a long-term goal. The proposed procedure, together with the presented tool, is just a first systematic approach aiming at facilitating this long and arduous way. Y1 - 2022 U6 - https://doi.org/10.1111/cgf.14543 VL - 41 IS - 3 SP - 321 EP - 332 ER - TY - JOUR A1 - Berio, Fidji A1 - Bayle, Yann A1 - Baum, Daniel A1 - Goudemand, Nicolas A1 - Debiais-Thibaud, Mélanie T1 - Hide and seek shark teeth in Random Forests: Machine learning applied to Scyliorhinus canicula populations JF - PeerJ - Aquatic Biology N2 - Shark populations that are distributed alongside a latitudinal gradient often display body size differences at sexual maturity and vicariance patterns related to their number of tooth files. Previous works have demonstrated that Scyliorhinus canicula exhibits distinct genetic structures, life history traits, and body size differences between populations inhabiting the North Atlantic Ocean and the Mediterranean Sea. In this work, we sample more than 3,000 S. canicula teeth from 56 specimens and provide and use a dataset containing their shape coordinates. We investigate tooth shape and form differences between a Mediterranean and an Atlantic S. canicula population using two approaches. Classification results show that the classical geometric morphometric framework is outperformed by an original Random Forests-based framework. Visually, both S. canicula populations share similar ontogenetic trends and timing of gynandric heterodonty emergence but the Atlantic population has bigger, blunter teeth, and less numerous accessory cusps than the Mediterranean population. According to the models, the populations are best differentiated based on their lateral tooth edges, which bear accessory cusps, and the tooth centroid sizes significantly improve classification performances. The differences observed are discussed in light of dietary and behavioural habits of the populations considered. The method proposed in this study could be further adapted to complement DNA analyses to identify shark species or populations based on tooth morphologies. This process would be of particular interest for fisheries management and identification of shark fossils. Y1 - 2022 U6 - https://doi.org/10.7717/peerj.13575 SP - 10:e13575 ER - TY - GEN A1 - Berio, Fidji A1 - Bayle, Yann A1 - Agret, Sylvie A1 - Baum, Daniel A1 - Goudemand, Nicolas A1 - Debiais-Thibaud, Mélanie T1 - 3D models related to the publication: Hide and seek shark teeth in Random Forests: Machine learning applied to Scyliorhinus canicula T2 - MorphoMuseuM N2 - The present dataset contains the 3D models analyzed in Berio, F., Bayle, Y., Baum, D., Goudemand, N., and Debiais-Thibaud, M. 2022. Hide and seek shark teeth in Random Forests: Machine learning applied to Scyliorhinus canicula. It contains the head surfaces of 56 North Atlantic and Mediterranean small-spotted catsharks Scyliorhinus canicula, from which tooth surfaces were further extracted to perform geometric morphometrics and machine learning. Y1 - 2022 U6 - https://doi.org/10.18563/journal.m3.164 ER - TY - JOUR A1 - Ehlers, Sarah A1 - Baum, Daniel A1 - Mühlethaler, Roland A1 - Hoch, Hannelore A1 - Bräunig, Peter T1 - Large abdominal mechanoreceptive sense organs in small plant-dwelling insects JF - Biology Letters N2 - The Hemiptera is the largest non-endopterygote insect order comprising approximately 98,000 recent species. All species of the suborders Cicadomorpha (leafhoppers, spittlebugs, treehoppers and cicadas) and Fulgoromorpha (planthoppers) feed by sucking sap from plant tissues and are thus often vectors for economically important phytopathogens. Except for the cicadas (Cicadomorpha: Cicadoidea: Cicadidae) which produce air-borne sounds, all species of the suborders Cicadomorpha and Fulgoromorpha communicate by vibrational (substrate-borne) signals. While the generation of these signals has been extensively investigated, the mechanisms of perception are poorly understood. This study provides a full description and 3D reconstruction of a large and complex array of six paired chordotonal organs in the first abdominal segments of the Rhododendron leafhopper Graphocephala fennahi (Cicadomorpha: Membracoidea: Cicadellidae). Further we were able to identify homologous organs in the closely related spittlebug Philaenus spumarius (Cicadomorpha: Cercopoidea: Aphrophoridae) and the planthopper Issus coleoptratus (Fulgoromorpha: Fulgoroidea: Issidae). The configuration is congruent with the abdominal chordotonal organs in cicadas, where one of them is an elaborate tympanal organ. This indicates that these organs, together with the tymbal organ constitute a synapomorphy of the Tymbalia (Hemiptera excl. Sternorrhyncha). Our results contribute to the understanding of the evolution from substrate-borne to airborne communication in insects. Y1 - 2022 U6 - https://doi.org/10.1098/rsbl.2022.0078 VL - 18 IS - 4 ER - TY - CHAP A1 - Paskin, Martha A1 - Dean, Mason A1 - Baum, Daniel A1 - von Tycowicz, Christoph T1 - A Kendall Shape Space Approach to 3D Shape Estimation from 2D Landmarks T2 - Computer Vision -- ECCV 2022 N2 - 3D shapes provide substantially more information than 2D images. However, the acquisition of 3D shapes is sometimes very difficult or even impossible in comparison with acquiring 2D images, making it necessary to derive the 3D shape from 2D images. Although this is, in general, a mathematically ill-posed problem, it might be solved by constraining the problem formulation using prior information. Here, we present a new approach based on Kendall’s shape space to reconstruct 3D shapes from single monocular 2D images. The work is motivated by an application to study the feeding behavior of the basking shark, an endangered species whose massive size and mobility render 3D shape data nearly impossible to obtain, hampering understanding of their feeding behaviors and ecology. 2D images of these animals in feeding position, however, are readily available. We compare our approach with state-of-the-art shape-based approaches both on human stick models and on shark head skeletons. Using a small set of training shapes, we show that the Kendall shape space approach is substantially more robust than previous methods and always results in plausible shapes. This is essential for the motivating application in which specimens are rare and therefore only few training shapes are available. Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-20086-1_21 SP - 363 EP - 379 PB - Springer Nature Switzerland ER - TY - GEN A1 - Paskin, Martha A1 - Baum, Daniel A1 - Dean, Mason N. A1 - von Tycowicz, Christoph T1 - A Kendall Shape Space Approach to 3D Shape Estimation from 2D Landmarks -- Source Code and Data N2 - Source code and novel dataset of basking shark head skeletons facilitating the reproduction of the results presented in 'A Kendall Shape Space Approach to 3D Shape Estimation from 2D Landmarks' - ECCV 2022. Y1 - 2022 U6 - https://doi.org/10.12752/8730 ER - TY - JOUR A1 - Hajarolasvadi, Noushin A1 - Sunkara, Vikram A1 - Khavnekar, Sagar A1 - Beck, Florian A1 - Brandt, Robert A1 - Baum, Daniel T1 - Volumetric macromolecule identification in cryo-electron tomograms using capsule networks JF - BMC Bioinformatics N2 - Background: Despite recent advances in cellular cryo-electron tomography (CET), developing automated tools for macromolecule identification in submolecular resolution remains challenging due to the lack of annotated data and high structural complexities. To date, the extent of the deep learning methods constructed for this problem is limited to conventional Convolutional Neural Networks (CNNs). Identifying macromolecules of different types and sizes is a tedious and time-consuming task. In this paper, we employ a capsule-based architecture to automate the task of macro- molecule identification, that we refer to as 3D-UCaps. In particular, the architecture is composed of three components: feature extractor, capsule encoder, and CNN decoder. The feature extractor converts voxel intensities of input sub-tomograms to activities of local features. The encoder is a 3D Capsule Network (CapsNet) that takes local features to generate a low-dimensional representation of the input. Then, a 3D CNN decoder reconstructs the sub-tomograms from the given representation by upsampling. Results: We performed binary and multi-class localization and identification tasks on synthetic and experimental data. We observed that the 3D-UNet and the 3D-UCaps had an F1−score mostly above 60% and 70%, respectively, on the test data. In both network architectures, we observed degradation of at least 40% in the F1-score when identifying very small particles (PDB entry 3GL1) compared to a large particle (PDB entry 4D8Q). In the multi-class identification task of experimental data, 3D-UCaps had an F1-score of 91% on the test data in contrast to 64% of the 3D-UNet. The better F1-score of 3D-UCaps compared to 3D-UNet is obtained by a higher precision score. We speculate this to be due to the capsule network employed in the encoder. To study the effect of the CapsNet-based encoder architecture further, we performed an ablation study and perceived that the F1-score is boosted as network depth is increased which is in contrast to the previously reported results for the 3D-UNet. To present a reproducible work, source code, trained models, data as well as visualization results are made publicly available. Conclusion: Quantitative and qualitative results show that 3D-UCaps successfully perform various downstream tasks including identification and localization of macro- molecules and can at least compete with CNN architectures for this task. Given that the capsule layers extract both the existence probability and the orientation of the molecules, this architecture has the potential to lead to representations of the data that are better interpretable than those of 3D-UNet. Y1 - 2022 U6 - https://doi.org/10.1186/s12859-022-04901-w VL - 23 IS - 360 ER - TY - JOUR A1 - Schmitt, Kira A1 - Titschack, Jürgen A1 - Baum, Daniel T1 - Polyp-Cavity Segmentation of Cold-Water Corals guided by Ambient Occlusion and Ambient Curvature JF - Eurographics Workshop on Visual Computing for Biology and Medicine (VCBM) N2 - The segmentation of cavities in three-dimensional images of arbitrary objects is a difficult problem since the cavities are usually connected to the outside of the object without any difference in image intensity. Hence, the information whether a voxel belongs to a cavity or the outside needs to be derived from the ambient space. If a voxel is enclosed by object material, it is very likely that this voxel belongs to a cavity. However, there are dense structures where a voxel might still belong to the outside even though it is surrounded to a large degree by the object. This is, for example, the case for coral colonies. Therefore, additional information needs to be considered to distinguish between those cases. In this paper, we introduce the notion of ambient curvature, present an efficient way to compute it, and use it to segment coral polyp cavities by integrating it into the ambient occlusion framework. Moreover, we combine the ambient curvature with other ambient information in a Gaussian mixture model, trained from a few user scribbles, resulting in a significantly improved cavity segmentation. We showcase the superiority of our approach using four coral colonies of very different morphological types. While in this paper we restrict ourselves to coral data, we believe that the concept of ambient curvature is also useful for other data. Furthermore, our approach is not restricted to curvature but can be easily extended to exploit any properties given on an object's surface, thereby adjusting it to specific applications. Y1 - 2022 U6 - https://doi.org/10.2312/vcbm.20221189 ER - TY - JOUR A1 - Brence, Blaž A1 - Brummer, Josephine A1 - Dercksen, Vincent J. A1 - Özel, Mehmet Neset A1 - Kulkarni, Abhishkek A1 - Wolterhoff, Neele A1 - Prohaska, Steffen A1 - Hiesinger, Peter Robin A1 - Baum, Daniel T1 - Semi-automatic Geometrical Reconstruction and Analysis of Filopodia Dynamics in 4D Two-Photon Microscopy Images JF - bioRxiv N2 - Background: Filopodia are thin and dynamic membrane protrusions that play a crucial role in cell migration, axon guidance, and other processes where cells explore and interact with their surroundings. Historically, filopodial dynamics have been studied in great detail in 2D in cultured cells, and more recently in 3D culture as well as living brains. However, there is a lack of efficient tools to trace and track filopodia in 4D images of complex brain cells. Results: To address this issue, we have developed a semi-automatic workflow for tracing filopodia in 3D images and tracking the traced filopodia over time. The workflow was developed based on high-resolution data of photoreceptor axon terminals in the in vivo context of normal Drosophila brain development, but devised to be applicable to filopodia in any system, including at different temporal and spatial scales. In contrast to the pre-existing methods, our workflow relies solely on the original intensity images without the requirement for segmentation or complex preprocessing. The workflow was realized in C++ within the Amira software system and consists of two main parts, dataset pre-processing, and geometrical filopodia reconstruction, where each of the two parts comprises multiple steps. In this paper, we provide an extensive workflow description and demonstrate its versatility for two different axo-dendritic morphologies, R7 and Dm8 cells. Finally, we provide an analysis of the time requirements for user input and data processing. Conclusion: To facilitate simple application within Amira or other frameworks, we share the source code, which is available athttps://github.com/zibamira/filopodia-tool. Y1 - 2025 U6 - https://doi.org/10.1101/2025.05.20.654789 ER - TY - JOUR A1 - Brence, Blaž A1 - Wandelt, Laura R. A1 - Walter, Sophie A1 - Sigrist, Stephan J. A1 - Petzoldt, Astrid G. A1 - Baum, Daniel T1 - Semi-automatic 3D-quantification of in-vivo synapse formation JF - ResearchSquare N2 - Background: Synapses, as specialised cell-cell contacts, allow for a faithful and controlled signal transmission between a neuron and a target cell. Presynapses, the sites of neurotransmitter release, form de novo throughout the development of an organism. Although this process is fundamental to the development and function of synaptic circuits, how developing neurons control number and distribution of individual synapses remains poorly understood. In-vivo imaging analysis of synapse formation at the neuromuscular junction of anaesthetised Drosophila third instar larvae allows for spatial and temporal resolution of the underlying molecular processes. However, high-throughput, comprehensive analysis are hampered by the manual and time-consuming imaging analysis methods applied hitherto. Here, we focus on the early presynaptic formation steps, that is, the presynaptic seeding, initiated by the formation of transient Liprin-a/SYD1 seeding sites, either stabilised or disintegrated over a time span of 30-90 min. Results: To investigate the dynamics of the Liprin-a/SYD1 seeding sites, we developed an automated analysis pipeline for 3D confocal images from in-vivo imaging at distinct time points to analyse fluorescently labelled presynaptic protein dynamics during early synapse formation. The workflow is realised in the data analysis software Amira, utilising the hierarchical watershed algorithm, and was designed for automatic processing with an option for manual proofreading. Compared to the previous 2D manual quantification, this automated approach provides a higher sensitivity in single Liprin-a seeding site detection in low-intensity areas and in regions of dense seeding sites.In addition, it substantially reduces the work time. To account for possible errors occurring in the automated processing, we implemented an additional proofreading step allowing for a manual correction of Liprin-a seeding site segmentation and assignment, thus greatly improving the analysis while only marginally increasing work time by 10% to a total work time reduction of 80% compared to the 2D manual analysis paradigm. Conclusion: The process of synaptogenesis underlies the general principles of locomotion, learning and memory formation. The developed fast and accurate semi-automated 3D workflow provides a substantial progress in the analysis of this molecular process and its application can be easily extended to other dynamic in-vivo research approaches across species. Y1 - 2025 U6 - https://doi.org/10.21203/rs.3.rs-6073150/v1 ER - TY - JOUR A1 - Brence, Blaž A1 - Brummer, Josephine A1 - Dercksen, Vincent J. A1 - Özel, Mehmet Neset A1 - Kulkarni, Abhishek A1 - Wolterhoff, Neele A1 - Prohaska, Steffen A1 - Hiesinger, Peter Robin A1 - Baum, Daniel T1 - Semi-automatic geometrical reconstruction and analysis of filopodia dynamics in 4D two-photon microscopy images JF - BMC Bioinformatics N2 - Background: Filopodia are thin and dynamic membrane protrusions that play a crucial role in cell migration, axon guidance, and other processes where cells explore and interact with their surroundings. Historically, filopodial dynamics have been studied in great detail in 2D in cultured cells, and more recently in 3D culture as well as living brains. However, there is a lack of efficient tools to trace and track filopodia in 4D images of complex brain cells. Results: To address this issue, we have developed a semi-automatic workflow for tracing filopodia in 3D images and tracking the traced filopodia over time. The workflow was developed based on high-resolution data of photoreceptor axon terminals in the in vivo context of normal Drosophila brain development, but devised to be applicable to filopodia in any system, including at different temporal and spatial scales. In contrast to the pre-existing methods, our workflow relies solely on the original intensity images without the requirement for segmentation or complex preprocessing. The workflow was realized in C++ within the Amira software system and consists of two main parts, dataset pre-processing, and geometrical filopodia reconstruction, where each of the two parts comprises multiple steps. In this paper, we provide an extensive workflow description and demonstrate its versatility for two different axo-dendritic morphologies, R7 and Dm8 cells. Finally, we provide an analysis of the time requirements for user input and data processing. Conclusion: To facilitate simple application within Amira or other frameworks, we share the source code, which is available at https://github.com/zibamira/filopodia-tool. Y1 - 2026 U6 - https://doi.org/10.1186/s12859-026-06385-4 VL - 27 ER - TY - JOUR A1 - Eigen, Lennart A1 - Ladenburger, Pius A1 - Brence, Blaž A1 - Shubitidze, Ani A1 - Baum, Daniel A1 - Hildebrandt, Thomas A1 - Brecht, Michael T1 - Elephant trunk tip musculature reflects species differences in grasping behavior JF - Communications Biology N2 - Elephants use their trunks, muscular hydrostats, to perform a plethora of tasks. Trunk tip morphology as well as grasping behavior differ between elephant species. While African savanna elephants (Loxodonta africana) use their dorsal and ventral finger for pinching movements, Asian elephants (Elephas maximus) prefer to wrap around objects with their one dorsal finger and ventral bulb trunk tip lip. Moreover, E. maximus can flip their ventral bulb backwards to clamp objects behind the trunk tip. Whether trunk tip musculature differs between elephant species and muscle architecture is reflected by preferred grasping behavior is, however, not clear. In this study, we performed dense muscle fascicle reconstruction of three L. africana and three E. maximus hemi-trunk tips using a combination of manual and automated segmentation of high-resolution microfocus tomography (microCT) scans. We distinguish three types of muscle fascicles: longitudinal (bending and shortening), radial (elongating) and transversal muscle fascicles (elongating). We found that trunk tips of L. africana consist to one third of longitudinal and two thirds radial/transversal muscle fascicles, likely aiding in their grasping behavior, while E. maximus trunk tips consist to two thirds of longitudinal and one third radial/transversal muscle fascicles, which is advantageous for their wrapping and backward clamping behavior. Y1 - 2025 U6 - https://doi.org/10.1038/s42003-025-08998-6 VL - 8 ER - TY - JOUR A1 - Schmitt, Kira A1 - Titschack, Jürgen A1 - Baum, Daniel T1 - CoDA: Interactive Segmentation and Morphological Analysis of Dendroid Structures Exemplified on Stony Cold-Water Corals JF - IEEE Transactions on Visualization and Computer Graphics Y1 - 2026 U6 - https://doi.org/10.1109/TVCG.2026.3656066 ER - TY - JOUR A1 - Ngokingha Tchouto, Mireille A1 - Mehl, Julia A1 - Khomeijani Farahani, Saeed A1 - Baum, Daniel A1 - Duda, Georg T1 - Novel image registration approach for combining 2D Osterix and collagen bundles images with 3D µCT JF - Journal of Bone and Mineral Research Y1 - 2026 U6 - https://doi.org/10.1093/jbmrpl/ziag009 VL - 10 IS - 3 ER -