TY - JOUR A1 - Oehme, Stephan A1 - Moewis, Philippe A1 - Boeth, Heide A1 - Bartek, Benjamin A1 - Lippert, Annika A1 - von Tycowicz, Christoph A1 - Ehrig, Rainald A1 - Duda, Georg A1 - Jung, Tobias T1 - PCL insufficient patients with increased translational and rotational passive knee joint laxity have no increased range of anterior–posterior and rotational tibiofemoral motion during level walking JF - Scientific Reports Y1 - 2022 U6 - https://doi.org/10.1038/s41598-022-17328-3 VL - 12 IS - 1 SP - 1 EP - 11 ER - TY - JOUR A1 - Sipiran, Ivan A1 - Lazo, Patrick A1 - Lopez, Cristian A1 - Bagewadi, Nihar A1 - Bustos, Benjamin A1 - Dao, Hieu A1 - Gangisetty, Shankar A1 - Hanik, Martin A1 - Ho-Thi, Ngoc-Phuong A1 - Holenderski, Mike A1 - Jarnikov, Dmitri A1 - Labrada, Arniel A1 - Lengauer, Stefan A1 - Licandro, Roxane A1 - Nguyen, Dinh-Huan A1 - Nguyen-Ho, Thang-Long A1 - Pérez Rey, Luis A. A1 - Pham, Bang-Dang A1 - Pham, Minh-Khoi A1 - Preiner, Reinhold A1 - Schreck, Tobias A1 - Trinh, Quoc-Huy A1 - Tonnaer, Loek A1 - von Tycowicz, Christoph A1 - Vu-Le, The-Anh T1 - SHREC 2021: Retrieval of Cultural Heritage Objects JF - Computers and Graphics N2 - This paper presents the methods and results of the SHREC’21 contest on a dataset of cultural heritage (CH) objects. We present a dataset of 938 scanned models that have varied geometry and artistic styles. For the competition, we propose two challenges: the retrieval-by-shape challenge and the retrieval-by-culture challenge. The former aims at evaluating the ability of retrieval methods to discriminate cultural heritage objects by overall shape. The latter focuses on assessing the effectiveness of retrieving objects from the same culture. Both challenges constitute a suitable scenario to evaluate modern shape retrieval methods in a CH domain. Ten groups participated in the contest: thirty runs were submitted for the retrieval-by-shape task, and twenty-six runs were submitted for the retrieval-by-culture challenge. The results show a predominance of learning methods on image-based multi-view representations to characterize 3D objects. Nevertheless, the problem presented in our challenges is far from being solved. We also identify the potential paths for further improvements and give insights into the future directions of research. Y1 - 2021 U6 - https://doi.org/10.1016/j.cag.2021.07.010 VL - 100 SP - 1 EP - 20 ER - TY - JOUR A1 - Picht, Thomas A1 - Le Calve, Maxime A1 - Tomasello, Rosario A1 - Fekonja, Lucius A1 - Gholami, Mohammad Fardin A1 - Bruhn, Matthias A1 - Zwick, Carola A1 - Rabe, Jürgen P. A1 - Müller-Birn, Claudia A1 - Vajkoczy, Peter A1 - Sauer, Igor M. A1 - Zachow, Stefan A1 - Nyakatura, John A. A1 - Ribault, Patricia A1 - Pulvermüller, Friedemann T1 - A note on neurosurgical resection and why we need to rethink cutting JF - Neurosurgery Y1 - 2021 U6 - https://doi.org/10.1093/neuros/nyab326 VL - 89 IS - 5 SP - 289 EP - 291 ER - TY - JOUR A1 - Moewis, Philippe A1 - Kaiser, René A1 - Trepczynski, Adam A1 - von Tycowicz, Christoph A1 - Krahl, Leonie A1 - Ilg, Ansgar A1 - Holz, Johannes A1 - Duda, Georg T1 - Patient specific resurfacing implant knee surgery in subjects with early osteoarthritis results in medial pivot and lateral femoral rollback during flexion: A retrospective pilot study JF - Knee Surgery, Sports Traumatology, Arthroscopy N2 - Purpose. Metallic resurfacing implants have been developed for the treatment of early, focal, small, condylar and trochlear osteoarthritis (OA) lesions. They represent an option for patients who are either too young to fulfill the criteria for total knee arthroplasty (TKA) or too old for biological treatment. Although relevant clinical evidence has been collected for different resurfacing types, the in vivo post-operative knee kinematics remains unknown. The present study aims to measure and analyse the knee joint kinematics in subjects with patient-specific Episealer implants Methods. Retrospective study design. Fluoroscopic analyses during high flexion activities (unloaded flexion-extension and loaded lunge) were conducted at >12 months post-surgery in ten Episealer knees. The post-operative knee joint kinematics was compared to equally assessed kinematic from ten healthy knees, twenty G-Curve TKA knees and 10 J-Curve knees. Pre- and postoperative clinical data of the Episealer knees were collected using a visual analog scale (VAS), the EQ 5d Health Questionnaire and the Knee Injury and Osteoarthritis Outcome Score (KOOS). Results. During unloaded flexion-extension and loaded lunge, the medial condyle in the Episealer knees remained relative stationary, indicating a medial pivot, while the lateral condyle translated consistently towards posterior. Similarly, reduced movement of the medial condyle and posterior translation of the lateral condyle was also observed in the healthy knees, although to a lesser extent. In contrast, the kinematics of both TKA cohorts during unloaded flexion-extension showed a tendency towards anterior displacement in the medial compartment, which led to significant differences in comparison with the Episealer knees. In the lateral compartment, a certain degree of femoral rollback was noted in the G-Curve TKA cohort. Improved scores were observed in the Episealer subjects between the preoperative and 1-year postoperative follow-up. Conclusion. At 12 months postsurgery, a physiological-like knee kinematics was observed in the group of patient-specific reconstructed chondral/osteochondral lesions by means of a resurfacing Episealer implant strategy. Considering that these patients are physically active and do not fulfill the criteria for TKA, the group is hard to be compared to TKA patients which usually are less active and more challenging. Nevertheless, the comparison to either healthy knee kinematics as well as to TKA reconstructed knees with different implant designs showed a more physiological-like kinematics in the resurfacing implants that seems more appropriate for such a patient group. Despite positive results, careful clinical follow-up of treated patients is recommended for the long-term OA progression. Further investigations need to be encouraged not only in larger patient groups but also in a prospective manner to assess the pre- to postoperative kinematic changes. Y1 - 2021 U6 - https://doi.org/10.1007/s00167-021-06749-8 ER - TY - JOUR A1 - Doerffel, Tom A1 - Papke, Ariane A1 - Klein, Rupert A1 - Ernst, Natalia A1 - Smolarkiewicz, Piotr K. T1 - Dynamics of tilted atmospheric vortices under asymmetric diabatic heating JF - Theoretical and Computational Fluid Dynamics N2 - Päschke et al. (J Fluid Mech, 2012) studied the nonlinear dynamics of strongly tilted vortices subject to asymmetric diabatic heating by asymptotic methods. They found, inter alia, that an azimuthal Fourier mode 1 heating pattern can intensify or attenuate such a vortex depending on the relative orientation of the tilt and the heating asymmetries. The theory originally addressed the gradient wind regime which, asymptotically speaking, corresponds to vortex Rossby numbers of order unity in the limit. Formally, this restricts the applicability of the theory to rather weak vortices. It is shown below that said theory is, in contrast, uniformly valid for vanishing Coriolis parameter and thus applicable to vortices up to low hurricane strengths. An extended discussion of the asymptotics as regards their physical interpretation and their implications for the overall vortex dynamics is also provided in this context. The paper’s second contribution is a series of three-dimensional numerical simulations examining the effect of different orientations of dipolar diabatic heating on idealized tropical cyclones. Comparisons with numerical solutions of the asymptotic equations yield evidence that supports the original theoretical predictions of Päschke et al. In addition, the influence of asymmetric diabatic heating on the time evolution of the vortex centerline is further analyzed, and a steering mechanism that depends on the orientation of the heating dipole is revealed. Finally, the steering mechanism is traced back to the correlation of dipolar perturbations of potential temperature, induced by the vortex tilt, and vertical velocity, for which diabatic heating not necessarily needs to be responsible, but which may have other origins. Y1 - 2021 U6 - https://doi.org/10.1007/s00162-021-00591-x VL - 35 IS - 6 SP - 831 EP - 873 ER - TY - THES A1 - Punjabi, Dev T1 - Orientation-invariant Dense Correspondence using Graph Convolutional Neural Networks Y1 - 2021 ER - TY - GEN A1 - Hanik, Martin A1 - von Tycowicz, Christoph T1 - Triangle meshes of shadow-recieving surfaces of ancient sundials N2 - This repository contains triangle meshes of the shadow-recieving surfaces of 13 ancient sundials; three of them are from Greece and 10 from Italy. The meshes are in correspondence. Y1 - 2022 U6 - https://doi.org/10.12752/8425 ER - TY - JOUR A1 - Boelts, Jan A1 - Harth, Philipp A1 - Gao, Richard A1 - Udvary, Daniel A1 - Yanez, Felipe A1 - Baum, Daniel A1 - Hege, Hans-Christian A1 - Oberlaender, Marcel A1 - Macke, Jakob H T1 - Simulation-based inference for efficient identification of generative models in connectomics JF - bioRxiv N2 - Recent advances in connectomics research enable the acquisition of increasing amounts of data about the connectivity patterns of neurons. How can we use this wealth of data to efficiently derive and test hypotheses about the principles underlying these patterns? A common approach is to simulate neural networks using a hypothesized wiring rule in a generative model and to compare the resulting synthetic data with empirical data. However, most wiring rules have at least some free parameters and identifying parameters that reproduce empirical data can be challenging as it often requires manual parameter tuning. Here, we propose to use simulation-based Bayesian inference (SBI) to address this challenge. Rather than optimizing a single rule to fit the empirical data, SBI considers many parametrizations of a wiring rule and performs Bayesian inference to identify the parameters that are compatible with the data. It uses simulated data from multiple candidate wiring rules and relies on machine learning methods to estimate a probability distribution (the `posterior distribution over rule parameters conditioned on the data') that characterizes all data-compatible rules. We demonstrate how to apply SBI in connectomics by inferring the parameters of wiring rules in an in silico model of the rat barrel cortex, given in vivo connectivity measurements. SBI identifies a wide range of wiring rule parameters that reproduce the measurements. We show how access to the posterior distribution over all data-compatible parameters allows us to analyze their relationship, revealing biologically plausible parameter interactions and enabling experimentally testable predictions. We further show how SBI can be applied to wiring rules at different spatial scales to quantitatively rule out invalid wiring hypotheses. Our approach is applicable to a wide range of generative models used in connectomics, providing a quantitative and efficient way to constrain model parameters with empirical connectivity data. Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-89890 ER - TY - JOUR A1 - Vohra, Sumit Kumar A1 - Harth, Philipp A1 - Isoe, Yasuko A1 - Bahl, Armin A1 - Fotowat, Haleh A1 - Engert, Florian A1 - Hege, Hans-Christian A1 - Baum, Daniel T1 - A Visual Interface for Exploring Hypotheses about Neural Circuits JF - IEEE Transactions on Visualization and Computer Graphics N2 - One of the fundamental problems in neurobiological research is to understand how neural circuits generate behaviors in response to sensory stimuli. Elucidating such neural circuits requires anatomical and functional information about the neurons that are active during the processing of the sensory information and generation of the respective response, as well as an identification of the connections between these neurons. With modern imaging techniques, both morphological properties of individual neurons as well as functional information related to sensory processing, information integration and behavior can be obtained. Given the resulting information, neurobiologists are faced with the task of identifying the anatomical structures down to individual neurons that are linked to the studied behavior and the processing of the respective sensory stimuli. Here, we present a novel interactive tool that assists neurobiologists in the aforementioned task by allowing them to extract hypothetical neural circuits constrained by anatomical and functional data. Our approach is based on two types of structural data: brain regions that are anatomically or functionally defined, and morphologies of individual neurons. Both types of structural data are interlinked and augmented with additional information. The presented tool allows the expert user to identify neurons using Boolean queries. The interactive formulation of these queries is supported by linked views, using, among other things, two novel 2D abstractions of neural circuits. The approach was validated in two case studies investigating the neural basis of vision-based behavioral responses in zebrafish larvae. Despite this particular application, we believe that the presented tool will be of general interest for exploring hypotheses about neural circuits in other species, genera and taxa. Y1 - 2024 U6 - https://doi.org/10.1109/TVCG.2023.3243668 VL - 30 IS - 7 SP - 3945 EP - 3958 ER - TY - GEN A1 - Vohra, Sumit Kumar A1 - Harth, Philipp A1 - Isoe, Yasuko A1 - Bahl, Armin A1 - Fotowat, Haleh A1 - Engert, Florian A1 - Hege, Hans-Christian A1 - Baum, Daniel T1 - A Visual Interface for Exploring Hypotheses about Neural Circuits N2 - One of the fundamental problems in neurobiological research is to understand how neural circuits generate behaviors in response to sensory stimuli. Elucidating such neural circuits requires anatomical and functional information about the neurons that are active during the processing of the sensory information and generation of the respective response, as well as an identification of the connections between these neurons. With modern imaging techniques, both morphological properties of individual neurons as well as functional information related to sensory processing, information integration and behavior can be obtained. Given the resulting information, neurobiologists are faced with the task of identifying the anatomical structures down to individual neurons that are linked to the studied behavior and the processing of the respective sensory stimuli. Here, we present a novel interactive tool that assists neurobiologists in the aforementioned task by allowing them to extract hypothetical neural circuits constrained by anatomical and functional data. Our approach is based on two types of structural data: brain regions that are anatomically or functionally defined, and morphologies of individual neurons. Both types of structural data are interlinked and augmented with additional information. The presented tool allows the expert user to identify neurons using Boolean queries. The interactive formulation of these queries is supported by linked views, using, among other things, two novel 2D abstractions of neural circuits. The approach was validated in two case studies investigating the neural basis of vision-based behavioral responses in zebrafish larvae. Despite this particular application, we believe that the presented tool will be of general interest for exploring hypotheses about neural circuits in other species, genera and taxa. T3 - ZIB-Report - 23-07 Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-89932 SN - 1438-0064 ER - TY - JOUR A1 - Melnyk, Kateryna A1 - Weimann, Kuba A1 - Conrad, Tim T1 - Understanding microbiome dynamics via interpretable graph representation learning JF - Scientific Reports N2 - Large-scale perturbations in the microbiome constitution are strongly correlated, whether as a driver or a consequence, with the health and functioning of human physiology. However, understanding the difference in the microbiome profiles of healthy and ill individuals can be complicated due to the large number of complex interactions among microbes. We propose to model these interactions as a time-evolving graph whose nodes are microbes and edges are interactions among them. Motivated by the need to analyse such complex interactions, we develop a method that learns a low-dimensional representation of the time-evolving graph and maintains the dynamics occurring in the high-dimensional space. Through our experiments, we show that we can extract graph features such as clusters of nodes or edges that have the highest impact on the model to learn the low-dimensional representation. This information can be crucial to identify microbes and interactions among them that are strongly correlated with clinical diseases. We conduct our experiments on both synthetic and real-world microbiome datasets. Y1 - 2023 U6 - https://doi.org/10.1038/s41598-023-29098-7 VL - 13 SP - 2058 ER - TY - THES A1 - Şirin, Ege T1 - Probabilistic Image Segmentation With Continuous Shape Representations Y1 - 2023 ER - TY - JOUR A1 - Tomholt, Lara A1 - Baum, Daniel A1 - Wood, Robert J. A1 - Weaver, James C. T1 - High-throughput segmentation, data visualization, and analysis of sea star skeletal networks JF - Journal of Structural Biology N2 - The remarkably complex skeletal systems of the sea stars (Echinodermata, Asteroidea), consisting of hundreds to thousands of individual elements (ossicles), have intrigued investigators for more than 150 years. While the general features and structural diversity of isolated asteroid ossicles have been well documented in the literature, the task of mapping the spatial organization of these constituent skeletal elements in a whole-animal context represents an incredibly laborious process, and as such, has remained largely unexplored. To address this unmet need, particularly in the context of understanding structure-function relationships in these complex skeletal systems, we present an integrated approach that combines micro-computed tomography, semi-automated ossicle segmentation, data visualization tools, and the production of additively manufactured tangible models to reveal biologically relevant structural data that can be rapidly analyzed in an intuitive manner. In the present study, we demonstrate this high-throughput workflow by segmenting and analyzing entire skeletal systems of the giant knobby star, Pisaster giganteus, at four different stages of growth. The in-depth analysis, presented herein, provides a fundamental understanding of the three-dimensional skeletal architecture of the sea star body wall, the process of skeletal maturation during growth, and the relationship between skeletal organization and morphological characteristics of individual ossicles. The widespread implementation of this approach for investigating other species, subspecies, and growth series has the potential to fundamentally improve our understanding of asteroid skeletal architecture and biodiversity in relation to mobility, feeding habits, and environmental specialization in this fascinating group of echinoderms. Y1 - 2023 U6 - https://doi.org/10.1016/j.jsb.2023.107955 VL - 215 IS - 2 SP - 107955 ER - TY - JOUR A1 - Navayazdani, Esfandiar A1 - Ambellan, Felix A1 - Hanik, Martin A1 - von Tycowicz, Christoph T1 - Sasaki Metric for Spline Models of Manifold-Valued Trajectories JF - Computer Aided Geometric Design N2 - We propose a generic spatiotemporal framework to analyze manifold-valued measurements, which allows for employing an intrinsic and computationally efficient Riemannian hierarchical model. Particularly, utilizing regression, we represent discrete trajectories in a Riemannian manifold by composite Bézier splines, propose a natural metric induced by the Sasaki metric to compare the trajectories, and estimate average trajectories as group-wise trends. We evaluate our framework in comparison to state-of-the-art methods within qualitative and quantitative experiments on hurricane tracks. Notably, our results demonstrate the superiority of spline-based approaches for an intensity classification of the tracks. Y1 - 2023 U6 - https://doi.org/10.1016/j.cagd.2023.102220 VL - 104 SP - 102220 ER - TY - THES A1 - Grewe, Martin T1 - An Extended 3D Morphable Face Model with Applications in Experimental Psychology N2 - Our faces and facial expressions are an important means of communication and social interaction. One goal of the behavioral sciences is to better understand how the features of the faces that we look at influence our behavior. These include static features like facial proportions or the shape and color of certain parts of a face which primarily constitute facial identity, as well as dynamic movements resulting from the activation of the mimic musculature. Experimental psychology provides an empirical approach to this endeavor. In experiments, participants are typically exposed to images or videos of realistic faces with specifically controlled features. By analysis of the reactions to such stimuli, conclusions can be drawn about the influence of facial features on the participants’ behavior. Psychologists today mostly generate face stimuli with the help of digital tools. Image editing with Photoshop is highly flexible, but also time-consuming and subjective. Using tools like Psychomorph or Fantamorph is easier and more objective, but does not allow specific control over facial features. In contrast, stimulus generation with 3D Morphable Face Models (3DMMs) offers a better balance between objectivity, ease of use, and flexibility. 3DMMs are statistical models which have been determined from 3D scans of real people’s faces and facial expressions. After these training scans have been brought into correspondence, methods like principal component analysis (PCA) can be used to determine the major modes of variation of facial shape and texture in the data. Such modes typically vary the overall facial proportions, expressions, or skin color. They can be individually controlled and flexibly combined to generate new faces and facial expressions. The plausibility of the generated faces can be ensured by having the mode combinations follow the multivariate distribution of the training data. 3DMMs have been mostly used by psychologists for the generation of stimulus images of faces with neutral expression. Static and dynamic stimuli of facial expressions are also of great interest, but generation with 3DMMs is less common. A problem is that the majority of current 3DMMs can only generate facial movements according to the six prototypic expressions of anger, disgust, fear, happiness, sadness, and surprise. More diverse or subtle expressions are often impossible. Among other reasons, this is due to the difficulty in establishing accurate correspondence in the training data. Further, the modes of most 3DMMs were created by means of PCA. These modes often lack interpretability, fail to generate facial details, and rarely provide psychologists a specific control over identity or expression features. Some 3DMMs also generate subtle artifacts that might lead to undesired effects during face perception. They are also less realistic than faces which were designed by artistic experts for recent computer games and animated movies. Last but not least, current 3DMMs have probably not yet been used for interactive experiments in virtual reality (VR) for technical reasons. Although they provide many advantages also beyond the generation of static or dynamic stimuli, the limitations of current 3DMMs have so far prevented a widespread usage in experimental psychology. The goal of this dissertation is to foster the creation and usage of 3DMMs in this context. To this end, we make three major contributions. First, we describe a matching method that establishes correspondence for 3D face scans with a very high accuracy. Unlike the most commonly used methods, it transforms the facial features into a 2D intermediate representation so that they can be aligned to a reference using image registration. We perform experiments with a large database of 3D scans of faces and facial expressions showing that our method outperforms previous approaches. Second, the 3D scans which were previously brought into correspondence are used for the creation of a 3DMM whose resolution is an order of magnitude higher than that of most existing models. We learn a variety of meaningful modes that, e.g., vary features only in specific regions of the face, or that are related to demographic factors such as ethnicity and age. Further, modes of local facial movements are established that can be flexibly combined into a large variety of expressions. We evaluate the quality of the newly created 3DMM in two experiments. Our results show its advantages over previous models, especially the higher degree of realism of dynamic stimuli of facial expressions which were created with our model. Third, we demonstrate that 3DMMs can not only be used for the generation of stimuli. We develop two experimental methods that are readily applicable in experimental psychology. Initially, we create 3D avatar faces with our 3DMM that are readily applicable in VR. They are used in a new open source framework for virtual mirror experiments on self-face perception. A study is conducted which demonstrates the advantages of the framework over previous methods. Furthermore, our 3DMM is used to create a method for improved control of facial asymmetry in existing stimulus photographs. We show that the method accounts for different dimensions of facial asymmetry and is less sensitive than previous approaches to extrinsic factors like the posture of the head. The different methods are evaluated in a study investigating the influence of facial asymmetry on ratings of attractiveness, femininity, and masculinity. The results indicate the benefits and validity of our method. KW - facial modeling KW - 3D morphable face model KW - facial analysis KW - experimental psychology Y1 - 2023 U6 - https://doi.org/10.14279/depositonce-18589 ER - TY - JOUR A1 - Jung, Christian A1 - Nowacka, Anna A1 - Barisin, Tin A1 - Meinel, Dietmar A1 - Paetsch, Olaf A1 - Grzesiak, Szymon A1 - Salamon, Michael A1 - Schladitz, Katja A1 - Redenbach, Claudia A1 - Pahn, Matthias T1 - 3d imaging and analysis of cracks in loaded concrete samples. 12th Conference on Industrial Computed Tomography (iCT) 2023, 27 February - 2 March 2023 in Fürth, Germany JF - e-Journal of Nondestructive Testing N2 - Concrete plays a central role as the standard building material in civil engineering. Experimental characterization of the concrete microstructure and a description of failure mechanisms are important to understand the concrete’s mechanical properties. Computed tomography is a powerful source of information as it yields 3d images of concrete specimens. However, complete visual inspection is often infeasible due to very large image sizes. Hence, automatic methods for crack detection and segmentation are needed. A region-growing algorithm and a 3d U-Net showed promising results in a previous study. Cracks in normal concrete and high-performance concrete that were initiated via tensile tests were investigated. Here, the methods are validated on a more diverse set of concrete types and crack characteristics. Adequate adaptions of the methods are necessary to deal with the complex crack structures. The segmentation results are assessed qualitatively and compared to those of a template matching algorithm which is well-established in industry. Y1 - 2023 U6 - https://doi.org/10.58286/27721 VL - 28 IS - 3 ER - TY - CHAP A1 - Siqueira Rodrigues, Lucas A1 - Nyakatura, John A1 - Zachow, Stefan A1 - Israel, Johann Habakuk T1 - An Immersive Virtual Paleontology Application T2 - 13th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2022 N2 - Virtual paleontology studies digital fossils through data analysis and visualization systems. The discipline is growing in relevance for the evident advantages of non-destructive imaging techniques over traditional paleontological methods, and it has made significant advancements during the last few decades. However, virtual paleontology still faces a number of technological challenges, amongst which are interaction shortcomings of image segmentation applications. Whereas automated segmentation methods are seldom applicable to fossil datasets, manual exploration of these specimens is extremely time-consuming as it impractically delves into three-dimensional data through two-dimensional visualization and interaction means. This paper presents an application that employs virtual reality and haptics to virtual paleontology in order to evolve its interaction paradigms and address some of its limitations. We provide a brief overview of the challenges faced by virtual paleontology practitioners, a description of our immersive virtual paleontology prototype, and the results of a heuristic evaluation of our design. Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-06249-0 SP - 478 EP - 481 ER - TY - THES A1 - Sahu, Manish T1 - Vision-based Context-awareness in Minimally Invasive Surgical Video Streams N2 - Surgical interventions are becoming increasingly complex thanks to modern assistance systems (imaging, robotics, etc.). Minimally invasive surgery in particular places high demands on surgeons due to added surgical complexity and information overload. Therefore, there is a growing need of developing context-aware systems that recognize the current surgical situation in order to derive and present the relevant information to the surgical staff for assistance. Current approaches for deriving contextual cues either utilize specialized hardware that is disruptive to the surgical workflow, or utilize vision-based approaches that require valuable time of surgeons, especially for manual annotations. The main objective of this cumulative dissertation is to improve the existing approaches for three important sub-problems of vision-based context-aware systems, namely surgical phase recognition, surgical instrument recognition and surgical instrument segmentation, while tackling the vision and manual annotation challenges related to these problems. This dissertation demonstrates that vision-based approaches for the three named clinical sub-problems of context-aware systems can be developed in an annotation-scarce setting by employing: domain-specific, deep learning based transfer learning techniques for the surgical instrument and phase recognition tasks; and deep learning based simulation-to-real unsupervised domain adaptation techniques for the surgical instrument segmentation task. The efficacy and real-time performance of the developed approaches have been evaluated on publicly available datasets containing real surgical videos (laparoscopic procedures) that were acquired in an uncontrolled surgical environment. These proposed approaches advance the state-of-the-art for the aforementioned research problems of context-aware systems in the OR and can potentially be utilized for real-time notification of the surgical phase, surgical instrument usage and image-based localization of surgical instruments. Y1 - 2022 ER - TY - GEN A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - Geodesic B-Score for Improved Assessment of Knee Osteoarthritis N2 - Three-dimensional medical imaging enables detailed understanding of osteoarthritis structural status. However, there remains a vast need for automatic, thus, reader-independent measures that provide reliable assessment of subject-specific clinical outcomes. To this end, we derive a consistent generalization of the recently proposed B-score to Riemannian shape spaces. We further present an algorithmic treatment yielding simple, yet efficient computations allowing for analysis of large shape populations with several thousand samples. Our intrinsic formulation exhibits improved discrimination ability over its Euclidean counterpart, which we demonstrate for predictive validity on assessing risks of total knee replacement. This result highlights the potential of the geodesic B-score to enable improved personalized assessment and stratification for interventions. T3 - ZIB-Report - 21-09 KW - Statistical shape analysis KW - Osteoarthritis KW - Geometric statistics KW - Riemannian manifolds Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-81930 SN - 1438-0064 ER - TY - JOUR A1 - Sunkara, Vikram A1 - Heinz, Gitta A. A1 - Heinrich, Frederik F. A1 - Durek, Pawel A1 - Mobasheri, Ali A1 - Mashreghi, Mir-Farzin A1 - Lang, Annemarie T1 - Combining segmental bulk- and single-cell RNA-sequencing to define the chondrocyte gene expression signature in the murine knee joint JF - Osteoarthritis and Cartilage Y1 - 2021 U6 - https://doi.org/10.1016/j.joca.2021.03.007 VL - 29 IS - 6 SP - 905 EP - 914 ER - TY - JOUR A1 - Herter, Felix A1 - Hege, Hans-Christian A1 - Hadwiger, Markus A1 - Lepper, Verena A1 - Baum, Daniel T1 - Thin-Volume Visualization on Curved Domains JF - Computer Graphics Forum N2 - Thin, curved structures occur in many volumetric datasets. Their analysis using classical volume rendering is difficult because parts of such structures can bend away or hide behind occluding elements. This problem cannot be fully compensated by effective navigation alone, because structure-adapted navigation in the volume is cumbersome and only parts of the structure are visible in each view. We solve this problem by rendering a spatially transformed view into the volume so that an unobscured visualization of the entire curved structure is obtained. As a result, simple and intuitive navigation becomes possible. The domain of the spatial transform is defined by a triangle mesh that is topologically equivalent to an open disc and that approximates the structure of interest. The rendering is based on ray-casting in which the rays traverse the original curved sub-volume. In order to carve out volumes of varying thickness, the lengths of the rays as well as the position of the mesh vertices can be easily modified in a view-controlled manner by interactive painting. We describe a prototypical implementation and demonstrate the interactive visual inspection of complex structures from digital humanities, biology, medicine, and materials science. Displaying the structure as a whole enables simple inspection of interesting substructures in their original spatial context. Overall, we show that transformed views utilizing ray-casting-based volume rendering supported by guiding surface meshes and supplemented by local, interactive modifications of ray lengths and vertex positions, represent a simple but versatile approach to effectively visualize thin, curved structures in volumetric data. Y1 - 2021 U6 - https://doi.org/10.1111/cgf.14296 VL - 40 IS - 3 SP - 147 EP - 157 PB - Wiley-Blackwell Publishing Ltd. CY - United Kingdom ER - TY - JOUR A1 - Baum, Daniel A1 - Herter, Felix A1 - Larsen, John Møller A1 - Lichtenberger, Achim A1 - Raja, Rubina T1 - Revisiting the Jerash Silver Scroll: a new visual data analysis approach JF - Digital Applications in Archaeology and Cultural Heritage N2 - This article revisits a complexly folded silver scroll excavated in Jerash, Jordan in 2014 that was digitally examined in 2015. In this article we apply, examine and discuss a new virtual unfolding technique that results in a clearer image of the scroll’s 17 lines of writing. We also compare it to the earlier unfolding and discuss progress in general analytical tools. We publish the original and the new images as well as the unfolded volume data open access in order to make these available to researchers interested in optimising unfolding processes of various complexly folded materials. Y1 - 2021 U6 - https://doi.org/10.1016/j.daach.2021.e00186 VL - 21 SP - e00186 ER - TY - JOUR A1 - Liang, YongTian A1 - Piao, Chengji A1 - Beuschel, Christine B. A1 - Toppe, David A1 - Kollipara, Laxmikanth A1 - Bogdanow, Boris A1 - Maglione, Marta A1 - Lützkendorf, Janine A1 - See, Jason Chun Kit A1 - Huang, Sheng A1 - Conrad, Tim A1 - Kintscher, Ulrich A1 - Madeo, Frank A1 - Liu, Fan A1 - Sickmann, Albert A1 - Sigrist, Stephan J. T1 - eIF5A hypusination, boosted by dietary spermidine, protects from premature brain aging and mitochondrial dysfunction JF - Cell Reports Y1 - 2021 U6 - https://doi.org/10.1016/j.celrep.2021.108941 VL - 35 IS - 2 ER - TY - JOUR A1 - Melnyk, Kateryna A1 - Montavon, Grègoire A1 - Klus, Stefan A1 - Conrad, Tim T1 - Graph Kernel Koopman Embedding for Human Microbiome Analysis JF - Applied Network Science N2 - More and more diseases have been found to be strongly correlated with disturbances in the microbiome constitution, e.g., obesity, diabetes, or some cancer types. Thanks to modern high-throughput omics technologies, it becomes possible to directly analyze human microbiome and its influence on the health status. Microbial communities are monitored over long periods of time and the associations between their members are explored. These relationships can be described by a time-evolving graph. In order to understand responses of the microbial community members to a distinct range of perturbations such as antibiotics exposure or diseases and general dynamical properties, the time-evolving graph of the human microbial communities has to be analyzed. This becomes especially challenging due to dozens of complex interactions among microbes and metastable dynamics. The key to solving this problem is the representation of the time-evolving graphs as fixed-length feature vectors preserving the original dynamics. We propose a method for learning the embedding of the time-evolving graph that is based on the spectral analysis of transfer operators and graph kernels. We demonstrate that our method can capture temporary changes in the time-evolving graph on both synthetic data and real-world data. Our experiments demonstrate the efficacy of the method. Furthermore, we show that our method can be applied to human microbiome data to study dynamic processes. Y1 - 2020 U6 - https://doi.org/10.1007/s41109-020-00339-2 VL - 5 IS - 96 ER - TY - JOUR A1 - Iravani, Sahar A1 - Conrad, Tim T1 - An Interpretable Deep Learning Approach for Biomarker Detection in LC-MS Proteomics Data JF - IEEE/ACM Transactions on Computational Biology and Bioinformatics N2 - Analyzing mass spectrometry-based proteomics data with deep learning (DL) approaches poses several challenges due to the high dimensionality, low sample size, and high level of noise. Additionally, DL-based workflows are often hindered to be integrated into medical settings due to the lack of interpretable explanation. We present DLearnMS, a DL biomarker detection framework, to address these challenges on proteomics instances of liquid chromatography-mass spectrometry (LC-MS) - a well-established tool for quantifying complex protein mixtures. Our DLearnMS framework learns the clinical state of LC-MS data instances using convolutional neural networks. Based on the trained neural networks, we show how biomarkers can be identified using layer-wise relevance propagation. This enables detecting discriminating regions of the data and the design of more robust networks. One of the main advantages over other established methods is that no explicit preprocessing step is needed in our DLearnMS framework. Our evaluation shows that DLearnMS outperforms conventional LC-MS biomarker detection approaches in identifying fewer false positive peaks while maintaining a comparable amount of true positives peaks. Y1 - 2023 U6 - https://doi.org/10.1109/tcbb.2022.3141656 VL - 20 IS - 1 SP - 151 EP - 161 ER - TY - JOUR A1 - Rams, Mona A1 - Conrad, Tim T1 - Dictionary learning allows model-free pseudotime estimation of transcriptomics data JF - BMC Genomics Y1 - 2022 U6 - https://doi.org/10.1186/s12864-021-08276-9 VL - 23 PB - BioMed Central ER - TY - JOUR A1 - Fröhler, Bernhard A1 - Elberfeld, Tim A1 - Möller, Torsten A1 - Hege, Hans-Christian A1 - De Beenhouwer, Jan A1 - Sijbers, Jan A1 - Kastner, Johann A1 - Heinzl, Christoph T1 - Analysis and comparison of algorithms for the tomographic reconstruction of curved fibres JF - Nondestructive Testing and Evaluation N2 - We present visual methods for the analysis and comparison of the results of curved fibre reconstruction algorithms, i.e., of algorithms extracting characteristics of curved fibres from X-ray computed tomography scans. In this work, we extend previous methods for the analysis and comparison of results of different fibre reconstruction algorithms or parametrisations to the analysis of curved fibres. We propose fibre dissimilarity measures for such curved fibres and apply these to compare multiple results to a specified reference. We further propose visualisation methods to analyse differences between multiple results quantitatively and qualitatively. In two case studies, we show that the presented methods provide valuable insights for advancing and parametrising fibre reconstruction algorithms, and support in improving their results in characterising curved fibres. Y1 - 2020 U6 - https://doi.org/10.1080/10589759.2020.1774583 VL - 35 IS - 3 SP - 328 EP - 341 ER - TY - THES A1 - Dill, Sabrina T1 - Joint Feature Learning and Classification - Deep Learning for Surgical Phase Detection N2 - In this thesis we investigate the task of automatically detecting phases in surgical workflow in endoscopic video data. For this, we employ deep learning approaches that solely rely on frame-wise visual information, instead of using additional signals or handcrafted features. While previous work has mainly focused on tool presence and temporal information for this task, we reason that additional global information about the context of a frame might benefit the phase detection task. We propose novel deep learning architectures: a convolutional neural network (CNN) based model for the tool detection task only, called Clf-Net, as well as a model which performs joint (context) feature learning and tool classification to incorporate information about the context, which we name Context-Clf-Net. For the phase detection task lower-dimensional feature vectors are extracted, which are used as input to recurrent neural networks in order to enforce temporal constraints. We compare the performance of an online model, which only considers previous frames up to the current time step, to that of an offline model that has access to past and future information. Experimental results indicate that the tool detection task benefits strongly from the introduction of context information, as we outperform both Clf-Net results and stateof-the-art methods. Regarding the phase detection task our results do not surpass state-of-the-art methods. Furthermore, no improvement of using features learned by the Context-Clf-Net is observed in the phase detection task for both online and offline versions Y1 - 2018 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-81745 ER - TY - JOUR A1 - Weimann, K. A1 - Conrad, Tim T1 - Transfer Learning for ECG Classification JF - Scientific Reports N2 - Remote monitoring devices, which can be worn or implanted, have enabled a more effective healthcare for patients with periodic heart arrhythmia due to their ability to constantly monitor heart activity. However, these devices record considerable amounts of electrocardiogram (ECG) data that needs to be interpreted by physicians. Therefore, there is a growing need to develop reliable methods for automatic ECG interpretation to assist the physicians. Here, we use deep convolutional neural networks (CNN) to classify raw ECG recordings. However, training CNNs for ECG classification often requires a large number of annotated samples, which are expensive to acquire. In this work, we tackle this problem by using transfer learning. First, we pretrain CNNs on the largest public data set of continuous raw ECG signals. Next, we finetune the networks on a small data set for classification of Atrial Fibrillation, which is the most common heart arrhythmia. We show that pretraining improves the performance of CNNs on the target task by up to 6.57%, effectively reducing the number of annotations required to achieve the same performance as CNNs that are not pretrained. We investigate both supervised as well as unsupervised pretraining approaches, which we believe will increase in relevance, since they do not rely on the expensive ECG annotations. The code is available on GitHub at https://github.com/kweimann/ecg-transfer-learning. Y1 - 2021 U6 - https://doi.org/10.1038/s41598-021-84374-8 VL - 11 ER - TY - JOUR A1 - Le Duc, Huy A1 - Conrad, Tim T1 - A light-weight and highly flexible software system for analyzing large bio-medical datasets JF - Future Generation Computer Systems Y1 - 2020 ER - TY - JOUR A1 - Juds, Carmen A1 - Schmidt, Johannes A1 - Weller, Michael A1 - Lange, Thorid A1 - Conrad, Tim A1 - Boerner, Hans T1 - Combining Phage Display and Next-generation Sequencing for Materials Sciences: A Case Study on Probing Polypropylene Surfaces JF - Journal of the American Chemical Society N2 - Phage display biopanning with Illumina next-generation sequencing (NGS) is applied to reveal insights into peptide-based adhesion domains for polypropylene (PP). One biopanning round followed by NGS selects robust PP-binding peptides that are not evident by Sanger sequencing. NGS provides a significant statistical base that enables motif analysis, statistics on positional residue depletion/enrichment, and data analysis to suppress false-positive sequences from amplification bias. The selected sequences are employed as water-based primers for PP?metal adhesion to condition PP surfaces and increase adhesive strength by 100\% relative to nonprimed PP. Y1 - 2020 U6 - https://doi.org/10.1021/jacs.0c03482 VL - 142 IS - 24 SP - 10624 EP - 10628 ER - TY - JOUR A1 - Cvetkovic, Nada A1 - Conrad, Tim A1 - Lie, Han Cheng T1 - A Convergent Discretisation Method for Transition Path Theory for Diffusion Processes JF - Multiscale Modeling & Simulation Y1 - 2021 U6 - https://doi.org/10.1137/20M1329354 VL - 19 IS - 1 SP - 242 EP - 266 PB - Society for Industrial and Applied Mathematics ER - TY - JOUR A1 - Grewe, Carl Martin A1 - Liu, Tuo A1 - Kahl, Christoph A1 - Andrea, Hildebrandt A1 - Zachow, Stefan T1 - Statistical Learning of Facial Expressions Improves Realism of Animated Avatar Faces JF - Frontiers in Virtual Reality Y1 - 2021 U6 - https://doi.org/10.3389/frvir.2021.619811 VL - 2 SP - 1 EP - 13 PB - Frontiers ER - TY - THES A1 - Lüdke, David T1 - Neural flow-based deformations for statistical shape modelling N2 - Statistical shape models learn to capture the most characteristic geometric variations of anatomical structures given samples from their population. Accordingly, shape models have become an essential tool for many medical applications and are used in, for example, shape generation, reconstruction, and classification tasks. However, established statistical shape models require precomputed dense correspondence between shapes, often lack robustness, and ignore the global surface topology. This thesis presents a novel neural flow-based shape model that does not require any precomputed correspondence. The proposed model relies on continuous flows of a neural ordinary differential equation to model shapes as deformations of a template. To increase the expressivity of the neural flow and disentangle global, low-frequency deformations from the generation of local, high- frequency details, we propose to apply a hierarchy of flows. We evaluate the performance of our model on two anatomical structures, liver, and distal femur. Our model outperforms state-of-the-art methods in providing an expressive and robust shape prior, as indicated by its generalization ability and specificity. More so, we demonstrate the effectiveness of our shape model on shape reconstruction tasks and find anatomically plausible solutions. Finally, we assess the quality of the emerging shape representation in an unsupervised setting and discriminate healthy from pathological shapes. KW - statistical shape model KW - statistical shape analysis KW - representation learning Y1 - 2022 UR - https://publikationen.ub.uni-frankfurt.de/frontdoor/index/index/searchtype/authorsearch/author/David+L%C3%BCdke/docId/70904/start/0/rows/10 ER - TY - JOUR A1 - Glatzeder, Korbinian A1 - Komnik, Igor A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - Potthast, Wolfgang T1 - Dynamic pressure analysis of novel interpositional knee spacer implants in 3D-printed human knee models JF - Scientific Reports N2 - Alternative treatment methods for knee osteoarthritis (OA) are in demand, to delay the young (< 50 Years) patient’s need for osteotomy or knee replacement. Novel interpositional knee spacers shape based on statistical shape model (SSM) approach and made of polyurethane (PU) were developed to present a minimally invasive method to treat medial OA in the knee. The implant should be supposed to reduce peak strains and pain, restore the stability of the knee, correct the malalignment of a varus knee and improve joint function and gait. Firstly, the spacers were tested in artificial knee models. It is assumed that by application of a spacer, a significant reduction in stress values and a significant increase in the contact area in the medial compartment of the knee will be registered. Biomechanical analysis of the effect of novel interpositional knee spacer implants on pressure distribution in 3D-printed knee model replicas: the primary purpose was the medial joint contact stress-related biomechanics. A secondary purpose was a better understanding of medial/lateral redistribution of joint loading. Six 3D printed knee models were reproduced from cadaveric leg computed tomography. Each of four spacer implants was tested in each knee geometry under realistic arthrokinematic dynamic loading conditions, to examine the pressure distribution in the knee joint. All spacers showed reduced mean stress values by 84–88% and peak stress values by 524–704% in the medial knee joint compartment compared to the non-spacer test condition. The contact area was enlarged by 462–627% as a result of the inserted spacers. Concerning the appreciable contact stress reduction and enlargement of the contact area in the medial knee joint compartment, the premises are in place for testing the implants directly on human knee cadavers to gain further insights into a possible tool for treating medial knee osteoarthritis. Y1 - 2022 U6 - https://doi.org/10.1038/s41598-022-20463-6 VL - 12 ER - TY - JOUR A1 - Becker, Kaitlyn P A1 - Teeple, Clark A1 - Charles, Nicholas A1 - Jung, Yeonsu A1 - Baum, Daniel A1 - Weaver, James C A1 - Mahadevan, L. A1 - Wood, Robert J T1 - Active entanglement enables stochastic, topological grasping JF - PNAS N2 - Grasping, in both biological and engineered mechanisms, can be highly sensitive to the gripper and object morphology, as well as perception and motion planning. Here we circumvent the need for feedback or precise planning by using an array of fluidically-actuated slender hollow elastomeric filaments to actively entangle with objects that vary in geometric and topological complexity. The resulting stochastic interactions enable a unique soft and conformable grasping strategy across a range of target objects that vary in size, weight, and shape. We experimentally evaluate the grasping performance of our strategy, and use a computational framework for the collective mechanics of flexible filaments in contact with complex objects to explain our findings. Overall, our study highlights how active collective entanglement of a filament array via an uncontrolled, spatially distributed scheme provides new options for soft, adaptable grasping. Y1 - 2022 U6 - https://doi.org/10.1073/pnas.2209819119 VL - 119 IS - 42 SP - e2209819119 ER - TY - THES A1 - Paskin, Martha T1 - Estimating 3D Shape of the Head Skeleton of Basking Sharks Using Annotated Landmarks on a 2D Image N2 - Basking sharks are thought to be one of the most efficient filter-feeding fish in terms of the throughput of water filtered through their gills. Details about the underlying morphology of their branchial region have not been studied due to various challenges in acquiring real-world data. The present thesis aims to facilitate this, by developing a mathematical shape model which constructs the 3D structure of the head skeleton of a basking shark using annotated landmarks on a single 2D image. This is an ill-posed problem as estimating the depth of a 3D object from a single 2D view is, in general, not possible. To reduce this ambiguity, we create a set of pre-defined training shapes in 3D from CT scans of basking sharks. First, the damaged structures of the sharks in the scans are corrected via solving a set of optimization problems, before using them as accurate 3D representations of the object. Then, two approaches are employed for the 2D-to-3D shape fitting problem–an Active Shape Model approach and a Kendall’s Shape Space approach. The former represents a shape as a point on a high-dimensional Euclidean space, whereas the latter represents a shape as an equivalence class of points in this Euclidean space. Kendall’s shape space approach is a novel technique that has not yet been applied in this context, and a comprehensive comparison of the two approaches suggests this approach to be superior for the problem at hand. This can be credited to an improved interpolation of the training shapes. N2 - Riesenhaie zählen zu den effizientesten Filtrierern hinsichtlich des durch die Kiemen gefilterten Wasservolumens. Die Kiemenregion dieser Tiere besitzt eine markante Morphologie, die jedoch bisher nicht umfassend erforscht werden konnte, da es schwierig ist, reale Daten dieser Tiere zu erheben. Die vorliegende Arbeit zielt darauf ab, dies durch die Entwicklung eines mathematischen Formmodels zu ermöglichen, das es erlaubt, die 3D-Struktur des Schädelskeletts anhand von Landmarken, die auf einem 2D-Bild platziert werden, zu rekonstruieren. Die hierzu benötigte Tiefenbestimmung der Landmarken aus einer 2D-Projektion ist ein unterbestimmtes Problem. Wir lösen dies durch die Hinzunahme von Trainingsformen, welche wir aus CT-Scans von Riesenhaien gewinnen. Der Zustand der tomografierten Exemplare erfordert jedoch einen vorhergehenden Korrekturschritt, den wir mit Hilfe eines Optimierungsansatzes lösen, bevor die extrahierten Strukturen als 3D-Trainingsformen dienen können. Um die 3D-Struktur des Schädelskelettes aus 2D-Landmarken zu rekonstruieren, vergleichen wir zwei Ansätze – den sogenannten Active-Shape-Model (ASM)-Ansatz und einen Ansatz basierend auf Kendalls Formenraum. Während eine Form des ASM-Ansatzes durch einen Punkt in einem hochdimensionalen Euklidischen Raum repräsentiert ist, repräsentiert eine Form im Kendall-Formenraum eine Äquivalenzklasse von Punkten des Euklidischen Raumes. Die Anwendung des Kendall-Formenraumes für das beschriebene Problem ist neu und ein umfassender Vergleich der Methoden hat ergeben, dass dieser Ansatz für die spezielle Anwendung zu besseren Ergebnissen führt. Wir führen dies auf die überlegene Interpolation der Trainingsformen in diesem Raum zurück. Y1 - 2022 UR - https://arxiv.org/abs/2207.12687 ER - TY - JOUR A1 - Tuncay, Erhun Giray A1 - Erdur, Rıza Cenk A1 - Conrad, Tim T1 - Parallel Exchange of Randomized SubGraphs for Optimization of Network Alignment: PERSONA JF - IEEE/ACM Transactions on Computational Biology and Bioinformatics N2 - The aim of Network Alignment in Protein-Protein Interaction Networks is discovering functionally similar regions between compared organisms. One major compromise for solving a network alignment problem is the trade-off among multiple similarity objectives while applying an alignment strategy. An alignment may lose its biological relevance while favoring certain objectives upon others due to the actual relevance of unfavored objectives. One possible solution for solving this issue may be blending the stronger aspects of various alignment strategies until achieving mature solutions. This study proposes a parallel approach called PERSONA that allows aligners to share their partial solutions continuously while they progress. All these aligners pursue their particular heuristics as part of a particle swarm that searches for multi-objective solutions of the same alignment problem in a reactive actor environment. The actors use the stronger portion of a solution as a subgraph that they receive from leading or other actors and send their own stronger subgraphs back upon evaluation of those partial solutions. Moreover, the individual heuristics of each actor takes randomized parameter values at each cycle of parallel execution so that the problem search space can thoroughly be investigated. The results achieved with PERSONA are remarkably optimized and balanced for both topological and node similarity objectives. Y1 - 2023 U6 - https://doi.org/10.1109/TCBB.2022.3231489 VL - 20 IS - 3 SP - 2064 EP - 2077 ER - TY - JOUR A1 - Laguillo-Diego, Alejandra A1 - Kiewisz, Robert A1 - Martí-Gómez, Carlos A1 - Baum, Daniel A1 - Müller-Reichert, Thomas A1 - Vernos, Isabelle T1 - MCRS1 modulates the heterogeneity of microtubule minus-end morphologies in mitotic spindles JF - Molecular Biology of the Cell N2 - Faithful chromosome segregation requires the assembly of a bipolar spindle, consisting of two antiparallel microtubule (MT) arrays having most of their minus ends focused at the spindle poles and their plus ends overlapping in the spindle midzone. Spindle assembly, chromosome alignment and segregation require highly dynamic MTs. The plus ends of MTs have been extensively investigated; instead, their minus end structure remains poorly characterized. Here, we used large-scale electron tomography to study the morphology of the MT minus ends in 3D-reconstructed metaphase spindles in HeLa cells. In contrast to the homogeneous open morphology of the MT plus ends at the kinetochores, we found that MT minus ends are heterogeneous showing either open or closed morphologies. Silencing the minus-end specific stabilizer, MCRS1 increased the proportion of open MT minus ends. Altogether, these data suggest a correlation between the morphology and the dynamic state of the MT ends. Taking this heterogeneity of the MT minus end morphologies into account, our work indicates an unsynchronized behavior of MTs at the spindle poles, thus laying the ground for further studies on the complexity of MT dynamics regulation. Y1 - 2022 U6 - https://doi.org/10.1091/mbc.E22-08-0306-T VL - 34 IS - 1 ER - TY - JOUR A1 - Mohammadzadeh, Saeed A1 - H. Nascimento, Vítor A1 - C. de Lamare, Rodrigo A1 - Hajarolasvadi, Noushin T1 - Robust Beamforming Based on Complex-Valued Convolutional Neural Networks for Sensor Arrays JF - IEEE Signal Processing Letters N2 - Robust adaptive beamforming (RAB) plays a vital role in modern communications by ensuring the reception of high-quality signals. This article proposes a deep learning approach to robust adaptive beamforming. In particular, we propose a novel RAB approach where the sample covariance matrix (SCM) is used as the input of a deep 1D Complex-Valued Convolutional Neural Network (CVCNN). The network employs complex convolutional and pooling layers, as well as a Cartesian Scaled Exponential Linear Unit activation function to directly compute the nearly-optimum weight vector through the training process and without prior knowledge about the direction of arrival of the desired signal. This means that reconstruction of the interference plus noise (IPN) covariance matrix is not required. The trained CVCNN accurately computes the nearly-optimum weight vector for data not used during training. The computed weight vector is employed to estimate the signal-to-interference plus noise ratio. Simulations show that the proposed RAB can provide performance close to that of the optimal beamformer. Y1 - 2022 U6 - https://doi.org/10.1109/LSP.2022.3212637 VL - 29 SP - 2018 EP - 2021 ER - TY - THES A1 - Ambellan, Felix T1 - Efficient Riemannian Statistical Shape Analysis with Applications in Disease Assessment N2 - In this work, we address the challenge of developing statistical shape models that account for the non-Euclidean nature inherent to (anatomical) shape variation and at the same time offer fast, numerically robust processing and as much invariance as possible regarding translation and rotation, i.e. Euclidean motion. With the aim of doing that we formulate a continuous and physically motivated notion of shape space based on deformation gradients. We follow two different tracks endowing this differential representation with a Riemannian structure to establish a statistical shape model. (1) We derive a model based on differential coordinates as elements in GL(3)+. To this end, we adapt the notion of bi-invariant means employing an affine connection structure on GL(3)+. Furthermore, we perform second-order statistics based on a family of Riemannian metrics providing the most possible invariance, viz. GL(3)+-left-invariance and O(3)-right-invariance. (2) We endow the differential coordinates with a non-Euclidean structure, that stems from a product Lie group of stretches and rotations. This structure admits a bi-invariant metric and thus allows for a consistent analysis via manifold-valued Riemannian statistics. This work further presents a novel shape representation based on discrete fundamental forms that is naturally invariant under Euclidean motion, namely the fundamental coordinates. We endow this representation with a Lie group structure that admits bi-invariant metrics and therefore allows for consistent analysis using manifold-valued statistics based on the Riemannian framework. Furthermore, we derive a simple, efficient, robust, yet accurate (i.e. without resorting to model approximations) solver for the inverse problem that allows for interactive applications. Beyond statistical shape modeling the proposed framework is amenable for surface processing such as quasi-isometric flattening. Additionally, the last part of the thesis aims on shape-based, continuous disease stratification to provide means that objectify disease assessment over the current clinical practice of ordinal grading systems. Therefore, we derive the geodesic B-score, a generalization of the of the Euclidean B-score, in order to assess knee osteoarthritis. In this context we present a Newton-type fixed point iteration for projection onto geodesics in shape space. On the application side, we show that the derived geodesic B-score features, in comparison to its Euclidean counterpart, an improved predictive performance on assessing the risk of total knee replacement surgery. Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:188-refubium-37016-3 ER - TY - THES A1 - Rams, Mona Milena T1 - New approaches for unsupervised transcriptomic data analysis based on Dictionary learning Y1 - 2022 ER - TY - JOUR A1 - Sunkara, Vikram A1 - Lewis, Angus A1 - Nguyen, Giang T. A1 - O'Reilly, Malgorzata M. A1 - Bean, Nigel T1 - A discontinuous Galerkin method for approximating the stationary distribution of stochastic fluid-fluid processes JF - Methodology and Computing in Applied Probability Y1 - 2022 U6 - https://doi.org/10.1007/s11009-022-09945-2 ER - TY - JOUR A1 - Lang, Annemarie A1 - Vester, Antja A1 - Ferreira-Gomes, M. A1 - Guerra, G.M. A1 - Heinrich, Fredrich R. A1 - Götzke, C.C. A1 - Kurmies, Sebastian A1 - Sunkara, Vikram A1 - Durek, Pawel A1 - Boerckel, Joel D. A1 - Mashreghi, Mir-Farzin T1 - PIPELINE FOR SINGLE CELL SEQUENCING OF HUMAN CHONDROCYTE PELLET CULTURES TO DELINEATE IL-1β MODULATED CHANGES IN CELL HETEROGENEITY JF - Osteoarthritis and Cartilage Y1 - 2022 U6 - https://doi.org/10.1016/j.joca.2022.02.112 VL - 30 IS - Supplement 1 SP - S90 ER - TY - JOUR A1 - Schulze, Kenrick A1 - Peppert, Felix A1 - Schütte, Christof A1 - Sunkara, Vikram T1 - Chimeric U-Net – Modifying the standard U-Net towards Explainability JF - Artificial Intelligence N2 - Healthcare guided by semantic segmentation has the potential to improve our quality of life through early and accurate disease detection. Convolutional Neural Networks, especially the U-Net-based architectures, are currently the state-of-the-art learning-based segmentation methods and have given unprecedented performances. However, their decision-making processes are still an active field of research. In order to reliably utilize such methods in healthcare, explainability of how the segmentation was performed is mandated. To date, explainability is studied and applied heavily in classification tasks. In this work, we propose the Chimeric U-Net, a U-Net architecture with an invertible decoder unit, that inherently brings explainability into semantic segmentation tasks. We find that having the restriction of an invertible decoder does not hinder the performance of the segmentation task. However, the invertible decoder helps to disentangle the class information in the latent space embedding and to construct meaningful saliency maps. Furthermore, we found that with a simple k-Nearest-Neighbours classifier, we could predict the Intersection over Union scores of unseen data, demonstrating that the latent space, constructed by the Chimeric U-Net , encodes an interpretable representation of the segmentation quality. Explainability is an emerging field, and in this work, we propose an alternative approach, that is, rather than building tools for explaining a generic architecture, we propose constraints on the architecture which induce explainability. With this approach, we could peer into the architecture to reveal its class correlations and local contextual dependencies, taking an insightful step towards trustworthy and reliable AI. Code to build and utilize the Chimeric U-Net is made available under: https://github.com/kenrickschulze/Chimeric-UNet---Half-invertible-UNet-in-Pytorch Y1 - 2025 U6 - https://doi.org/10.1016/j.artint.2024.104240 VL - 338 ER - TY - CHAP A1 - Mayer, Julius A1 - Baum, Daniel A1 - Ambellan, Felix A1 - von Tycowicz, Christoph T1 - A Soft-Correspondence Approach to Shape-based Disease Grading with Graph Convolutional Networks T2 - Proceedings of Machine Learning Research N2 - Shape analysis provides principled means for understanding anatomical structures from medical images. The underlying notions of shape spaces, however, come with strict assumptions prohibiting the analysis of incomplete and/or topologically varying shapes. This work aims to alleviate these limitations by adapting the concept of soft correspondences. In particular, we present a graph-based learning approach for morphometric classification of disease states that is based on a generalized notion of shape correspondences in terms of functional maps. We demonstrate the performance of the derived classifier on the open-access ADNI database for differentiating normal controls and subjects with Alzheimer’s disease. Notably, our experiment shows that our approach can improve over state-of-the-art from geometric deep learning. Y1 - 2022 VL - 194 SP - 85 EP - 95 ER - TY - JOUR A1 - Alchikh, Maren A1 - Conrad, Tim A1 - Obermeier, Patrick A1 - Ma, Xiaolin A1 - Schweiger, Brunhilde A1 - Opota, Onya A1 - Rath, Barbara T1 - Disease Burden and Inpatient Management of Children with Acute Respiratory Viral Infections during the Pre-COVID Era in Germany: A Cost-of-Illness Study JF - Viruses N2 - Respiratory viral infections (RVIs) are common reasons for healthcare consultations. The inpatient management of RVIs consumes significant resources. From 2009 to 2014, we assessed the costs of RVI management in 4776 hospitalized children aged 0–18 years participating in a quality improvement program, where all ILI patients underwent virologic testing at the National Reference Centre followed by detailed recording of their clinical course. The direct (medical or non-medical) and indirect costs of inpatient management outside the ICU (‘non-ICU’) versus management requiring ICU care (‘ICU’) added up to EUR 2767.14 (non-ICU) vs. EUR 29,941.71 (ICU) for influenza, EUR 2713.14 (non-ICU) vs. EUR 16,951.06 (ICU) for RSV infections, and EUR 2767.33 (non-ICU) vs. EUR 14,394.02 (ICU) for human rhinovirus (hRV) infections, respectively. Non-ICU inpatient costs were similar for all eight RVIs studied: influenza, RSV, hRV, adenovirus (hAdV), metapneumovirus (hMPV), parainfluenza virus (hPIV), bocavirus (hBoV), and seasonal coronavirus (hCoV) infections. ICU costs for influenza, however, exceeded all other RVIs. At the time of the study, influenza was the only RVI with antiviral treatment options available for children, but only 9.8% of influenza patients (non-ICU) and 1.5% of ICU patients with influenza received antivirals; only 2.9% were vaccinated. Future studies should investigate the economic impact of treatment and prevention of influenza, COVID-19, and RSV post vaccine introduction. Y1 - 2024 U6 - https://doi.org/10.3390/v16040507 VL - 16 IS - 4 ER - TY - JOUR A1 - Sherratt, Katharine A1 - Srivastava, Ajitesh A1 - Ainslie, Kylie A1 - Singh, David E. A1 - Cublier, Aymar A1 - Marinescu, Maria Cristina A1 - Carretero, Jesus A1 - Garcia, Alberto Cascajo A1 - Franco, Nicolas A1 - Willem, Lander A1 - Abrams, Steven A1 - Faes, Christel A1 - Beutels, Philippe A1 - Hens, Niel A1 - Müller, Sebastian A1 - Charlton, Billy A1 - Ewert, Ricardo A1 - Paltra, Sydney A1 - Rakow, Christian A1 - Rehmann, Jakob A1 - Conrad, Tim A1 - Schütte, Christof A1 - Nagel, Kai A1 - Abbott, Sam A1 - Grah, Rok A1 - Niehus, Rene A1 - Prasse, Bastian A1 - Sandmann, Frank A1 - Funk, Sebastian T1 - Characterising information gains and losses when collecting multiple epidemic model outputs JF - Epidemics N2 - Collaborative comparisons and combinations of epidemic models are used as policy-relevant evidence during epidemic outbreaks. In the process of collecting multiple model projections, such collaborations may gain or lose relevant information. Typically, modellers contribute a probabilistic summary at each time-step. We compared this to directly collecting simulated trajectories. We aimed to explore information on key epidemic quantities; ensemble uncertainty; and performance against data, investigating potential to continuously gain information from a single cross-sectional collection of model results. Methods We compared July 2022 projections from the European COVID-19 Scenario Modelling Hub. Five modelling teams projected incidence in Belgium, the Netherlands, and Spain. We compared projections by incidence, peaks, and cumulative totals. We created a probabilistic ensemble drawn from all trajectories, and compared to ensembles from a median across each model’s quantiles, or a linear opinion pool. We measured the predictive accuracy of individual trajectories against observations, using this in a weighted ensemble. We repeated this sequentially against increasing weeks of observed data. We evaluated these ensembles to reflect performance with varying observed data. Results. By collecting modelled trajectories, we showed policy-relevant epidemic characteristics. Trajectories contained a right-skewed distribution well represented by an ensemble of trajectories or a linear opinion pool, but not models’ quantile intervals. Ensembles weighted by performance typically retained the range of plausible incidence over time, and in some cases narrowed this by excluding some epidemic shapes. Conclusions. We observed several information gains from collecting modelled trajectories rather than quantile distributions, including potential for continuously updated information from a single model collection. The value of information gains and losses may vary with each collaborative effort’s aims, depending on the needs of projection users. Understanding the differing information potential of methods to collect model projections can support the accuracy, sustainability, and communication of collaborative infectious disease modelling efforts. Data availability All code and data available on Github: https://github.com/covid19-forecast-hub-europe/aggregation-info-loss KW - Virology KW - Infectious Diseases KW - Public Health, Environmental and Occupational Health KW - Microbiology KW - Parasitology KW - Epidemiology Y1 - 2024 U6 - https://doi.org/10.1016/j.epidem.2024.100765 SN - 1755-4365 VL - 47 PB - Elsevier BV ER - TY - JOUR A1 - Kofler, Andreas A1 - Wald, Christian A1 - Kolbitsch, Christoph A1 - von Tycowicz, Christoph A1 - Ambellan, Felix T1 - Joint Reconstruction and Segmentation in Undersampled 3D Knee MRI combining Shape Knowledge and Deep Learning JF - Physics in Medicine and Biology N2 - Task-adapted image reconstruction methods using end-to-end trainable neural networks (NNs) have been proposed to optimize reconstruction for subsequent processing tasks, such as segmentation. However, their training typically requires considerable hardware resources and thus, only relatively simple building blocks, e.g. U-Nets, are typically used, which, albeit powerful, do not integrate model-specific knowledge. In this work, we extend an end-to-end trainable task-adapted image reconstruction method for a clinically realistic reconstruction and segmentation problem of bone and cartilage in 3D knee MRI by incorporating statistical shape models (SSMs). The SSMs model the prior information and help to regularize the segmentation maps as a final post-processing step. We compare the proposed method to a state-of-the-art (SOTA) simultaneous multitask learning approach for image reconstruction and segmentation (MTL) and to a complex SSMs-informed segmentation pipeline (SIS). Our experiments show that the combination of joint end-to-end training and SSMs to further regularize the segmentation maps obtained by MTL highly improves the results, especially in terms of mean and maximal surface errors. In particular, we achieve the segmentation quality of SIS and, at the same time, a substantial model reduction that yields a five-fold decimation in model parameters and a computational speedup of an order of magnitude. Remarkably, even for undersampling factors of up to R=8, the obtained segmentation maps are of comparable quality to those obtained by SIS from ground-truth images. Y1 - 2024 U6 - https://doi.org/10.1088/1361-6560/ad3797 VL - 69 IS - 9 ER - TY - JOUR A1 - Gaskin, Thomas A1 - Conrad, Tim A1 - Pavliotis, Grigorios A. A1 - Schütte, Christof T1 - Neural parameter calibration and uncertainty quantification for epidemic forecasting JF - PLOS ONE N2 - The recent COVID-19 pandemic has thrown the importance of accurately forecasting contagion dynamics and learning infection parameters into sharp focus. At the same time, effective policy-making requires knowledge of the uncertainty on such predictions, in order, for instance, to be able to ready hospitals and intensive care units for a worst-case scenario without needlessly wasting resources. In this work, we apply a novel and powerful computational method to the problem of learning probability densities on contagion parameters and providing uncertainty quantification for pandemic projections. Using a neural network, we calibrate an ODE model to data of the spread of COVID-19 in Berlin in 2020, achieving both a significantly more accurate calibration and prediction than Markov-Chain Monte Carlo (MCMC)-based sampling schemes. The uncertainties on our predictions provide meaningful confidence intervals e.g. on infection figures and hospitalisation rates, while training and running the neural scheme takes minutes where MCMC takes hours. We show convergence of our method to the true posterior on a simplified SIR model of epidemics, and also demonstrate our method's learning capabilities on a reduced dataset, where a complex model is learned from a small number of compartments for which data is available. Y1 - 2024 U6 - https://doi.org/10.1371/journal.pone.0306704 VL - 19 IS - 10 ER - TY - JOUR A1 - Amiranashvili, Tamaz A1 - Lüdke, David A1 - Li, Hongwei Bran A1 - Zachow, Stefan A1 - Menze, Bjoern T1 - Learning continuous shape priors from sparse data with neural implicit functions JF - Medical Image Analysis N2 - Statistical shape models are an essential tool for various tasks in medical image analysis, including shape generation, reconstruction and classification. Shape models are learned from a population of example shapes, which are typically obtained through segmentation of volumetric medical images. In clinical practice, highly anisotropic volumetric scans with large slice distances are prevalent, e.g., to reduce radiation exposure in CT or image acquisition time in MR imaging. For existing shape modeling approaches, the resolution of the emerging model is limited to the resolution of the training shapes. Therefore, any missing information between slices prohibits existing methods from learning a high-resolution shape prior. We propose a novel shape modeling approach that can be trained on sparse, binary segmentation masks with large slice distances. This is achieved through employing continuous shape representations based on neural implicit functions. After training, our model can reconstruct shapes from various sparse inputs at high target resolutions beyond the resolution of individual training examples. We successfully reconstruct high-resolution shapes from as few as three orthogonal slices. Furthermore, our shape model allows us to embed various sparse segmentation masks into a common, low-dimensional latent space — independent of the acquisition direction, resolution, spacing, and field of view. We show that the emerging latent representation discriminates between healthy and pathological shapes, even when provided with sparse segmentation masks. Lastly, we qualitatively demonstrate that the emerging latent space is smooth and captures characteristic modes of shape variation. We evaluate our shape model on two anatomical structures: the lumbar vertebra and the distal femur, both from publicly available datasets. Y1 - 2024 U6 - https://doi.org/10.1016/j.media.2024.103099 VL - 94 SP - 103099 ER - TY - JOUR A1 - Navayazdani, Esfandiar T1 - On Geodesics in the Spaces of Constrained Curves JF - Journal of Differential Geometry and its Applications N2 - In this work, we study the geodesics of the space of certain geometrically and physically motivated subspaces of the space of immersed curves endowed with a first order Sobolev metric. This includes elastic curves and also an extension of some results on planar concentric circles to surfaces. The work focuses on intrinsic and constructive approaches. Y1 - 2024 U6 - https://doi.org/https://doi.org/10.1016/j.difgeo.2024.102209 VL - 97 SP - 102209 ER - TY - JOUR A1 - Hanik, Martin A1 - Navayazdani, Esfandiar A1 - von Tycowicz, Christoph T1 - De Casteljau's Algorithm in Geometric Data Analysis: Theory and Application JF - Computer Aided Geometric Design N2 - For decades, de Casteljau's algorithm has been used as a fundamental building block in curve and surface design and has found a wide range of applications in fields such as scientific computing, and discrete geometry to name but a few. With increasing interest in nonlinear data science, its constructive approach has been shown to provide a principled way to generalize parametric smooth curves to manifolds. These curves have found remarkable new applications in the analysis of parameter-dependent, geometric data. This article provides a survey of the recent theoretical developments in this exciting area as well as its applications in fields such as geometric morphometrics and longitudinal data analysis in medicine, archaeology, and meteorology. Y1 - 2024 U6 - https://doi.org/10.1016/j.cagd.2024.102288 VL - 110 SP - 102288 ER - TY - CHAP A1 - Navayazdani, Esfandiar T1 - Elastic Analysis of Augmented Curves and Constrained Surfaces T2 - Proc. of IAPR Third International Conference on Discrete Geometry and Mathematical Morphology Y1 - 2024 U6 - https://doi.org/10.1007/978-3-031-57793-2_27 SP - 353 EP - 363 PB - Springer ER - TY - THES A1 - Peter, Clea T1 - Improving the Realism of Synthetic Cryogenic Electron Micrographs Using Generative Adversarial Networks N2 - This thesis addresses the problem of synthetic-to-real image refinement applied to tilt series of cryogenic electron micrographs. It explores the possibility of improving the realism of synthesized micrographs using generative adversarial networks, which could help to improve the automatic segmentation of cellular structures based on deep learning methods. For image refinement, three image-to-image translation networks were used to transfer the appearance of real micrographs to synthetic micrographs while preserving their original content, including the location and shape of particles. The first model, called SimGAN, was unable to produce any meaningful refinement. Instead, the content of the synthetic micrographs was corrupted by the addition of extensive noise, making SimGAN unsuitable for the problem of this thesis. As a result, CycleGAN was introduced and its refinement of synthetic micrographs matches the appearance of real micrographs very well. However, structural changes in the position and shape of particles were observed after translation. To avoid this behavior, CUT was used as a third model on an exploratory basis but its performance was inferior to that of CycleGAN. In conclusion, CycleGAN proved to be the most promising image-to-image translation model for the images presented, although it does not solve the main problem of this thesis. In order to do so, further modifications, such as the addition of a structural constraint during translation, are required. Y1 - 2023 ER - TY - THES A1 - Tack, Alexander T1 - Machine Learning-based Assessment of Multiple Anatomical Structures in Medical Image Data for Diagnosis and Prediction of Knee Osteoarthritis N2 - Knee osteoarthritis (KOA) is a degenerative disease that leads to pain and loss of function. It is estimated to affect over 500 million humans world-wide and is one of the most common reasons for disability. KOA is usually diagnosed by radiologists or clinical experts by anamnesis, physical examination, and by assessing medical image data. The latter is typically acquired using X-Ray or magnetic resonance imaging. Since manual image reading is subjective, tedious and time-consuming, automated methods are required for a fast and objective decision support and for a better understanding of the pathogenesis of KOA. This thesis sets a foundation towards automated computation of image-based KOA biomarkers for holistic assessment of the knee. This involves the assessment of multiple knee bones and soft tissues. An assessment of particular structures requires localization of these tissues. In order to automate a faithful localization of anatomical structures, deep learning-based methods are investigated and utilized. Additionally, convolutional neural networks (CNNs) are used for classification of medical image data, i.e., for a direct determination of the disease status and to detect anatomical structures and landmarks. The automatically computed anatomical volumes, locations, and other measurements are finally compared to values acquired by clinical experts and evaluated for clustering of KOA groups, classification of KOA severity, prediction of KOA progression, and prediction of total knee replacement. In various experiments it is shown that CNN-based methods are suitable for accurate medical image segmentation, object detection, landmark detection, and direct classification of disease stages from the image data. Computed features related to the menisci are found to be most expressive in terms of clustering of KOA groups and predicting of future disease states, thus allowing diagnosis of current KOA conditions and prediction of future conditions. The conclusion of this thesis is that machine learning-based, fully automated processing of medical image data shows potential for diagnosis and prediction of KOA grades. Future studies could investigate additional features in order to achieve an assessment of the whole knee or validate the findings of this work in clinical studies. KW - Deep learning KW - cartilage KW - meniscus KW - segmentation KW - classification KW - prediction KW - incident osteoarthritis KW - total knee replacement KW - landmark detection KW - hip-knee-ankle angle Y1 - 2024 U6 - https://doi.org/10.14279/depositonce-19738 ER - TY - JOUR A1 - Hanik, Martin A1 - Steidl, Gabriele A1 - von Tycowicz, Christoph T1 - Manifold GCN: Diffusion-based Convolutional Neural Network for Manifold-valued Graphs N2 - We propose two graph neural network layers for graphs with features in a Riemannian manifold. First, based on a manifold-valued graph diffusion equation, we construct a diffusion layer that can be applied to an arbitrary number of nodes and graph connectivity patterns. Second, we model a tangent multilayer perceptron by transferring ideas from the vector neuron framework to our general setting. Both layers are equivariant with respect to node permutations and isometries of the feature manifold. These properties have been shown to lead to a beneficial inductive bias in many deep learning tasks. Numerical examples on synthetic data as well as on triangle meshes of the right hippocampus to classify Alzheimer's disease demonstrate the very good performance of our layers. Y1 - 2024 ER - TY - JOUR A1 - Mikula, Natalia A1 - Dörffel, Tom A1 - Baum, Daniel A1 - Hege, Hans-Christian T1 - An Interactive Approach for Identifying Structure Definitions JF - Computer Graphics Forum N2 - Our ability to grasp and understand complex phenomena is essentially based on recognizing structures and relating these to each other. For example, any meteorological description of a weather condition and explanation of its evolution recurs to meteorological structures, such as convection and circulation structures, cloud fields and rain fronts. All of these are spatiotemporal structures, defined by time-dependent patterns in the underlying fields. Typically, such a structure is defined by a verbal description that corresponds to the more or less uniform, often somewhat vague mental images of the experts. However, a precise, formal definition of the structures or, more generally, concepts is often desirable, e.g., to enable automated data analysis or the development of phenomenological models. Here, we present a systematic approach and an interactive tool to obtain formal definitions of spatiotemporal structures. The tool enables experts to evaluate and compare different structure definitions on the basis of data sets with time-dependent fields that contain the respective structure. Since structure definitions are typically parameterized, an essential part is to identify parameter ranges that lead to desired structures in all time steps. In addition, it is important to allow a quantitative assessment of the resulting structures simultaneously. We demonstrate the use of the tool by applying it to two meteorological examples: finding structure definitions for vortex cores and center lines of temporarily evolving tropical cyclones. Ideally, structure definitions should be objective and applicable to as many data sets as possible. However, finding such definitions, e.g., for the common atmospheric structures in meteorology, can only be a long-term goal. The proposed procedure, together with the presented tool, is just a first systematic approach aiming at facilitating this long and arduous way. Y1 - 2022 U6 - https://doi.org/10.1111/cgf.14543 VL - 41 IS - 3 SP - 321 EP - 332 ER - TY - JOUR A1 - Kostré, Margarita A1 - Sunkara, Vikram A1 - Schütte, Christof A1 - Djurdjevac Conrad, Natasa T1 - Understanding the Romanization Spreading on Historical Interregional Networks in Northern Tunisia JF - Applied Network Science N2 - Spreading processes are important drivers of change in social systems. To understand the mechanisms of spreading it is fundamental to have information about the underlying contact network and the dynamical parameters of the process. However, in many real-wold examples, this information is not known and needs to be inferred from data. State-of-the-art spreading inference methods have mostly been applied to modern social systems, as they rely on availability of very detailed data. In this paper we study the inference challenges for historical spreading processes, for which only very fragmented information is available. To cope with this problem, we extend existing network models by formulating a model on a mesoscale with temporal spreading rate. Furthermore, we formulate the respective parameter inference problem for the extended model. We apply our approach to the romanization process of Northern Tunisia, a scarce dataset, and study properties of the inferred time-evolving interregional networks. As a result, we show that (1) optimal solutions consist of very different network structures and spreading rate functions; and that (2) these diverse solutions produce very similar spreading patterns. Finally, we discuss how inferred dominant interregional connections are related to available archaeological traces. Historical networks resulting from our approach can help understanding complex processes of cultural change in ancient times. KW - mesoscale spreading process KW - network inference KW - time-evolving network KW - romanization spreading KW - scarce data Y1 - 2022 U6 - https://doi.org/10.1007/s41109-022-00492-w VL - 7 PB - Springer Nature ER - TY - JOUR A1 - Caputo, Ariel A1 - Emporio, Marco A1 - Giachetti, Andrea A1 - Cristani, Marco A1 - Borghi, Guido A1 - D'Eusanio, Andrea A1 - Le, Minh-Quan A1 - Nguyen, Hai-Dang A1 - Tran, Minh-Triet A1 - Ambellan, Felix A1 - Hanik, Martin A1 - Navayazdani, Esfandiar A1 - Tycowicz, Christoph von T1 - SHREC 2022 Track on Online Detection of Heterogeneous Gestures JF - Computers and Graphics N2 - This paper presents the outcomes of a contest organized to evaluate methods for the online recognition of heterogeneous gestures from sequences of 3D hand poses. The task is the detection of gestures belonging to a dictionary of 16 classes characterized by different pose and motion features. The dataset features continuous sequences of hand tracking data where the gestures are interleaved with non-significant motions. The data have been captured using the Hololens 2 finger tracking system in a realistic use-case of mixed reality interaction. The evaluation is based not only on the detection performances but also on the latency and the false positives, making it possible to understand the feasibility of practical interaction tools based on the algorithms proposed. The outcomes of the contest's evaluation demonstrate the necessity of further research to reduce recognition errors, while the computational cost of the algorithms proposed is sufficiently low. Y1 - 2022 U6 - https://doi.org/10.1016/j.cag.2022.07.015 VL - 107 SP - 241 EP - 251 ER - TY - JOUR A1 - Kiewisz, Robert A1 - Fabig, Gunar A1 - Conway, William A1 - Baum, Daniel A1 - Needleman, Daniel A1 - Müller-Reichert, Thomas T1 - Three-dimensional structure of kinetochore-fibers in human mitotic spindles JF - eLife N2 - During cell division, kinetochore microtubules (KMTs) provide a physical linkage between the chromosomes and the rest of the spindle. KMTs in mammalian cells are organized into bundles, so-called kinetochore-fibers (k-fibers), but the ultrastructure of these fibers is currently not well characterized. Here we show by large-scale electron tomography that each k-fiber in HeLa cells in metaphase is composed of approximately nine KMTs, only half of which reach the spindle pole. Our comprehensive reconstructions allowed us to analyze the three-dimensional (3D) morphology of k-fibers and their surrounding MTs in detail. We found that k-fibers exhibit remarkable variation in circumference and KMT density along their length, with the pole-proximal side showing a broadening. Extending our structural analysis then to other MTs in the spindle, we further observed that the association of KMTs with non-KMTs predominantly occurs in the spindle pole regions. Our 3D reconstructions have implications for KMT growth and k-fiber self-organization models as covered in a parallel publication applying complementary live-cell imaging in combination with biophysical modeling (Conway et al., 2022). Finally, we also introduce a new visualization tool allowing an interactive display of our 3D spindle data that will serve as a resource for further structural studies on mitosis in human cells. Y1 - 2022 U6 - https://doi.org/10.7554/eLife.75459 VL - 11 SP - e75459 ER - TY - GEN A1 - Kostré, Margarita A1 - Sunkara, Vikram A1 - Schütte, Christof A1 - Djurdjevac Conrad, Nataša T1 - Understanding the Romanization Spreading on Historical Interregional Networks in Northern Tunisia N2 - Spreading processes are important drivers of change in social systems. To understand the mechanisms of spreading it is fundamental to have information about the underlying contact network and the dynamical parameters of the process. However, in many real-wold examples, this information is not known and needs to be inferred from data. State-of-the-art spreading inference methods have mostly been applied to modern social systems, as they rely on availability of very detailed data. In this paper we study the inference challenges for historical spreading processes, for which only very fragmented information is available. To cope with this problem, we extend existing network models by formulating a model on a mesoscale with temporal spreading rate. Furthermore, we formulate the respective parameter inference problem for the extended model. We apply our approach to the romanization process of Northern Tunisia, a scarce dataset, and study properties of the inferred time-evolving interregional networks. As a result, we show that (1) optimal solutions consist of very different network structures and spreading rate functions; and that (2) these diverse solutions produce very similar spreading patterns. Finally, we discuss how inferred dominant interregional connections are related to available archaeological traces. Historical networks resulting from our approach can help understanding complex processes of cultural change in ancient times. T3 - ZIB-Report - 22-10 KW - mesoscale spreading process, network inference, time-evolving network, romanization spreading, scarce data Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-86764 SN - 1438-0064 ER - TY - JOUR A1 - Berio, Fidji A1 - Bayle, Yann A1 - Baum, Daniel A1 - Goudemand, Nicolas A1 - Debiais-Thibaud, Mélanie T1 - Hide and seek shark teeth in Random Forests: Machine learning applied to Scyliorhinus canicula populations JF - PeerJ - Aquatic Biology N2 - Shark populations that are distributed alongside a latitudinal gradient often display body size differences at sexual maturity and vicariance patterns related to their number of tooth files. Previous works have demonstrated that Scyliorhinus canicula exhibits distinct genetic structures, life history traits, and body size differences between populations inhabiting the North Atlantic Ocean and the Mediterranean Sea. In this work, we sample more than 3,000 S. canicula teeth from 56 specimens and provide and use a dataset containing their shape coordinates. We investigate tooth shape and form differences between a Mediterranean and an Atlantic S. canicula population using two approaches. Classification results show that the classical geometric morphometric framework is outperformed by an original Random Forests-based framework. Visually, both S. canicula populations share similar ontogenetic trends and timing of gynandric heterodonty emergence but the Atlantic population has bigger, blunter teeth, and less numerous accessory cusps than the Mediterranean population. According to the models, the populations are best differentiated based on their lateral tooth edges, which bear accessory cusps, and the tooth centroid sizes significantly improve classification performances. The differences observed are discussed in light of dietary and behavioural habits of the populations considered. The method proposed in this study could be further adapted to complement DNA analyses to identify shark species or populations based on tooth morphologies. This process would be of particular interest for fisheries management and identification of shark fossils. Y1 - 2022 U6 - https://doi.org/10.7717/peerj.13575 SP - 10:e13575 ER - TY - GEN A1 - Berio, Fidji A1 - Bayle, Yann A1 - Agret, Sylvie A1 - Baum, Daniel A1 - Goudemand, Nicolas A1 - Debiais-Thibaud, Mélanie T1 - 3D models related to the publication: Hide and seek shark teeth in Random Forests: Machine learning applied to Scyliorhinus canicula T2 - MorphoMuseuM N2 - The present dataset contains the 3D models analyzed in Berio, F., Bayle, Y., Baum, D., Goudemand, N., and Debiais-Thibaud, M. 2022. Hide and seek shark teeth in Random Forests: Machine learning applied to Scyliorhinus canicula. It contains the head surfaces of 56 North Atlantic and Mediterranean small-spotted catsharks Scyliorhinus canicula, from which tooth surfaces were further extracted to perform geometric morphometrics and machine learning. Y1 - 2022 U6 - https://doi.org/10.18563/journal.m3.164 ER - TY - JOUR A1 - Nava-Yazdani, Esfandiar A1 - Hege, Hans-Christian A1 - von Tycowicz, Christoph T1 - A Hierarchical Geodesic Model for Longitudinal Analysis on Manifolds JF - Journal of Mathematical Imaging and Vision N2 - In many applications, geodesic hierarchical models are adequate for the study of temporal observations. We employ such a model derived for manifold-valued data to Kendall's shape space. In particular, instead of the Sasaki metric, we adapt a functional-based metric, which increases the computational efficiency and does not require the implementation of the curvature tensor. We propose the corresponding variational time discretization of geodesics and employ the approach for longitudinal analysis of 2D rat skulls shapes as well as 3D shapes derived from an imaging study on osteoarthritis. Particularly, we perform hypothesis test and estimate the mean trends. Y1 - 2022 U6 - https://doi.org/10.1007/s10851-022-01079-x VL - 64 IS - 4 SP - 395 EP - 407 ER - TY - JOUR A1 - Hanik, Martin A1 - Hege, Hans-Christian A1 - von Tycowicz, Christoph T1 - Bi-invariant Dissimilarity Measures for Sample Distributions in Lie Groups JF - SIAM Journal on Mathematics of Data Science N2 - Data sets sampled in Lie groups are widespread, and as with multivariate data, it is important for many applications to assess the differences between the sets in terms of their distributions. Indices for this task are usually derived by considering the Lie group as a Riemannian manifold. Then, however, compatibility with the group operation is guaranteed only if a bi-invariant metric exists, which is not the case for most non-compact and non-commutative groups. We show here that if one considers an affine connection structure instead, one obtains bi-invariant generalizations of well-known dissimilarity measures: a Hotelling $T^2$ statistic, Bhattacharyya distance and Hellinger distance. Each of the dissimilarity measures matches its multivariate counterpart for Euclidean data and is translation-invariant, so that biases, e.g., through an arbitrary choice of reference, are avoided. We further derive non-parametric two-sample tests that are bi-invariant and consistent. We demonstrate the potential of these dissimilarity measures by performing group tests on data of knee configurations and epidemiological shape data. Significant differences are revealed in both cases. Y1 - 2022 U6 - https://doi.org/10.1137/21M1410373 VL - 4 IS - 4 SP - 1223 EP - 1249 ER - TY - CHAP A1 - Amiranashvili, Tamaz A1 - Lüdke, David A1 - Li, Hongwei A1 - Menze, Bjoern A1 - Zachow, Stefan T1 - Learning Shape Reconstruction from Sparse Measurements with Neural Implicit Functions T2 - Medical Imaging with Deep Learning N2 - Reconstructing anatomical shapes from sparse or partial measurements relies on prior knowledge of shape variations that occur within a given population. Such shape priors are learned from example shapes, obtained by segmenting volumetric medical images. For existing models, the resolution of a learned shape prior is limited to the resolution of the training data. However, in clinical practice, volumetric images are often acquired with highly anisotropic voxel sizes, e.g. to reduce image acquisition time in MRI or radiation exposure in CT imaging. The missing shape information between the slices prohibits existing methods to learn a high-resolution shape prior. We introduce a method for high-resolution shape reconstruction from sparse measurements without relying on high-resolution ground truth for training. Our method is based on neural implicit shape representations and learns a continuous shape prior only from highly anisotropic segmentations. Furthermore, it is able to learn from shapes with a varying field of view and can reconstruct from various sparse input configurations. We demonstrate its effectiveness on two anatomical structures: vertebra and femur, and successfully reconstruct high-resolution shapes from sparse segmentations, using as few as three orthogonal slices. Y1 - 2022 ER - TY - JOUR A1 - Ehlers, Sarah A1 - Baum, Daniel A1 - Mühlethaler, Roland A1 - Hoch, Hannelore A1 - Bräunig, Peter T1 - Large abdominal mechanoreceptive sense organs in small plant-dwelling insects JF - Biology Letters N2 - The Hemiptera is the largest non-endopterygote insect order comprising approximately 98,000 recent species. All species of the suborders Cicadomorpha (leafhoppers, spittlebugs, treehoppers and cicadas) and Fulgoromorpha (planthoppers) feed by sucking sap from plant tissues and are thus often vectors for economically important phytopathogens. Except for the cicadas (Cicadomorpha: Cicadoidea: Cicadidae) which produce air-borne sounds, all species of the suborders Cicadomorpha and Fulgoromorpha communicate by vibrational (substrate-borne) signals. While the generation of these signals has been extensively investigated, the mechanisms of perception are poorly understood. This study provides a full description and 3D reconstruction of a large and complex array of six paired chordotonal organs in the first abdominal segments of the Rhododendron leafhopper Graphocephala fennahi (Cicadomorpha: Membracoidea: Cicadellidae). Further we were able to identify homologous organs in the closely related spittlebug Philaenus spumarius (Cicadomorpha: Cercopoidea: Aphrophoridae) and the planthopper Issus coleoptratus (Fulgoromorpha: Fulgoroidea: Issidae). The configuration is congruent with the abdominal chordotonal organs in cicadas, where one of them is an elaborate tympanal organ. This indicates that these organs, together with the tymbal organ constitute a synapomorphy of the Tymbalia (Hemiptera excl. Sternorrhyncha). Our results contribute to the understanding of the evolution from substrate-borne to airborne communication in insects. Y1 - 2022 U6 - https://doi.org/10.1098/rsbl.2022.0078 VL - 18 IS - 4 ER - TY - JOUR A1 - Eigen, Lennart A1 - Baum, Daniel A1 - Dean, Mason N. A1 - Werner, Daniel A1 - Wölfer, Jan A1 - Nyakatura, John A. T1 - Ontogeny of a tessellated surface: carapace growth of the longhorn cowfish Lactoria cornuta JF - Journal of Anatomy N2 - Biological armors derive their mechanical integrity in part from their geometric architectures, often involving tessellations: individual structural elements tiled together to form surface shells. The carapace of boxfish, for example, is comprised of mineralized polygonal plates, called scutes, arranged in a complex geometric pattern and nearly completely encasing the body. In contrast to artificial armors, the boxfish exoskeleton grows with the fish; the relationship between the tessellation and the gross structure of the armor is therefore critical to sustained protection throughout growth. To clarify whether or how the boxfish tessellation is maintained or altered with age, we quantify architectural aspects of the tessellated carapace of the longhorn cowfish Lactoria cornuta through ontogeny (across nearly an order of magnitude in standard length) and in a high-throughput fashion, using high-resolution microCT data and segmentation algorithms to characterize the hundreds of scutes that cover each individual. We show that carapace growth is canalized with little variability across individuals: rather than continually adding scutes to enlarge the carapace surface, the number of scutes is surprisingly constant, with scutes increasing in volume, thickness, and especially width with age. As cowfish and their scutes grow, scutes become comparatively thinner, with the scutes at the edges (weak points in a boxy architecture) being some of the thickest and most reinforced in younger animals and thinning most slowly across ontogeny. In contrast, smaller scutes with more variable curvature were found in the limited areas of more complex topology (e.g. around fin insertions, mouth, and anus). Measurements of Gaussian and mean curvature illustrate that cowfish are essentially tessellated boxes throughout life: predominantly zero curvature surfaces comprised of mostly flat scutes, and with scutes with sharp bends used sparingly to form box edges. Since growth of a curved, tiled surface with a fixed number of tiles would require tile restructuring to accommodate the surface’s changing radius of curvature, our results therefore illustrate a previously unappreciated advantage of the odd boxfish morphology: by having predominantly flat surfaces, it is the box-like body form that in fact permits a relatively straightforward growth system of this tessellated architecture (i.e. where material is added to scute edges). Our characterization of the ontogeny and maintenance of the carapace tessellation provides insights into the potentially conflicting mechanical, geometric and developmental constraints of this species, but also perspectives into natural strategies for constructing mutable tiled architectures. Y1 - 2022 U6 - https://doi.org/10.1111/joa.13692 VL - 241 IS - 3 SP - 565 EP - 580 PB - Wiley ER - TY - CHAP A1 - Paskin, Martha A1 - Dean, Mason A1 - Baum, Daniel A1 - von Tycowicz, Christoph T1 - A Kendall Shape Space Approach to 3D Shape Estimation from 2D Landmarks T2 - Computer Vision -- ECCV 2022 N2 - 3D shapes provide substantially more information than 2D images. However, the acquisition of 3D shapes is sometimes very difficult or even impossible in comparison with acquiring 2D images, making it necessary to derive the 3D shape from 2D images. Although this is, in general, a mathematically ill-posed problem, it might be solved by constraining the problem formulation using prior information. Here, we present a new approach based on Kendall’s shape space to reconstruct 3D shapes from single monocular 2D images. The work is motivated by an application to study the feeding behavior of the basking shark, an endangered species whose massive size and mobility render 3D shape data nearly impossible to obtain, hampering understanding of their feeding behaviors and ecology. 2D images of these animals in feeding position, however, are readily available. We compare our approach with state-of-the-art shape-based approaches both on human stick models and on shark head skeletons. Using a small set of training shapes, we show that the Kendall shape space approach is substantially more robust than previous methods and always results in plausible shapes. This is essential for the motivating application in which specimens are rare and therefore only few training shapes are available. Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-20086-1_21 SP - 363 EP - 379 PB - Springer Nature Switzerland ER - TY - JOUR A1 - Obermeier, Patrick E A1 - Heim, Albert A1 - Biere, Barbara A1 - Hage, Elias A1 - Alchikh, Maren A1 - Conrad, Tim A1 - Schweiger, Brunhilde A1 - Rath, Barbara A T1 - Linking digital surveillance and in-depth virology to study clinical patterns of viral respiratory infections in vulnerable patient populations JF - iScience N2 - To improve the identification and management of viral respiratory infections, we established a clinical and virologic surveillance program for pediatric patients fulfilling pre-defined case criteria of influenza-like illness and viral respiratory infections. The program resulted in a cohort comprising 6,073 patients (56% male, median age 1.6 years, range 0–18.8 years), where every patient was assessed with a validated disease severity score at the point-of-care using the ViVI ScoreApp. We used machine learning and agnostic feature selection to identify characteristic clinical patterns. We tested all patients for human adenoviruses, 571 (9%) were positive. Adenovirus infections were particularly common and mild in children ≥1 month of age but rare and potentially severe in neonates: with lower airway involvement, disseminated disease, and a 50% mortality rate (n = 2/4). In one fatal case, we discovered a novel virus … Y1 - 2022 U6 - https://doi.org/10.1016/j.isci.2022.104276 VL - 25 IS - 5 PB - Cell Press ER - TY - GEN A1 - Paskin, Martha A1 - Baum, Daniel A1 - Dean, Mason N. A1 - von Tycowicz, Christoph T1 - A Kendall Shape Space Approach to 3D Shape Estimation from 2D Landmarks -- Source Code and Data N2 - Source code and novel dataset of basking shark head skeletons facilitating the reproduction of the results presented in 'A Kendall Shape Space Approach to 3D Shape Estimation from 2D Landmarks' - ECCV 2022. Y1 - 2022 U6 - https://doi.org/10.12752/8730 ER - TY - JOUR A1 - Hajarolasvadi, Noushin A1 - Sunkara, Vikram A1 - Khavnekar, Sagar A1 - Beck, Florian A1 - Brandt, Robert A1 - Baum, Daniel T1 - Volumetric macromolecule identification in cryo-electron tomograms using capsule networks JF - BMC Bioinformatics N2 - Background: Despite recent advances in cellular cryo-electron tomography (CET), developing automated tools for macromolecule identification in submolecular resolution remains challenging due to the lack of annotated data and high structural complexities. To date, the extent of the deep learning methods constructed for this problem is limited to conventional Convolutional Neural Networks (CNNs). Identifying macromolecules of different types and sizes is a tedious and time-consuming task. In this paper, we employ a capsule-based architecture to automate the task of macro- molecule identification, that we refer to as 3D-UCaps. In particular, the architecture is composed of three components: feature extractor, capsule encoder, and CNN decoder. The feature extractor converts voxel intensities of input sub-tomograms to activities of local features. The encoder is a 3D Capsule Network (CapsNet) that takes local features to generate a low-dimensional representation of the input. Then, a 3D CNN decoder reconstructs the sub-tomograms from the given representation by upsampling. Results: We performed binary and multi-class localization and identification tasks on synthetic and experimental data. We observed that the 3D-UNet and the 3D-UCaps had an F1−score mostly above 60% and 70%, respectively, on the test data. In both network architectures, we observed degradation of at least 40% in the F1-score when identifying very small particles (PDB entry 3GL1) compared to a large particle (PDB entry 4D8Q). In the multi-class identification task of experimental data, 3D-UCaps had an F1-score of 91% on the test data in contrast to 64% of the 3D-UNet. The better F1-score of 3D-UCaps compared to 3D-UNet is obtained by a higher precision score. We speculate this to be due to the capsule network employed in the encoder. To study the effect of the CapsNet-based encoder architecture further, we performed an ablation study and perceived that the F1-score is boosted as network depth is increased which is in contrast to the previously reported results for the 3D-UNet. To present a reproducible work, source code, trained models, data as well as visualization results are made publicly available. Conclusion: Quantitative and qualitative results show that 3D-UCaps successfully perform various downstream tasks including identification and localization of macro- molecules and can at least compete with CNN architectures for this task. Given that the capsule layers extract both the existence probability and the orientation of the molecules, this architecture has the potential to lead to representations of the data that are better interpretable than those of 3D-UNet. Y1 - 2022 U6 - https://doi.org/10.1186/s12859-022-04901-w VL - 23 IS - 360 ER - TY - CHAP A1 - Harth, Philipp A1 - Vohra, Sumit A1 - Udvary, Daniel A1 - Oberlaender, Marcel A1 - Hege, Hans-Christian A1 - Baum, Daniel T1 - A Stratification Matrix Viewer for Analysis of Neural Network Data T2 - Eurographics Workshop on Visual Computing for Biology and Medicine (VCBM) N2 - The analysis of brain networks is central to neurobiological research. In this context the following tasks often arise: (1) understand the cellular composition of a reconstructed neural tissue volume to determine the nodes of the brain network; (2) quantify connectivity features statistically; and (3) compare these to predictions of mathematical models. We present a framework for interactive, visually supported accomplishment of these tasks. Its central component, the stratification matrix viewer, allows users to visualize the distribution of cellular and/or connectional properties of neurons at different levels of aggregation. We demonstrate its use in four case studies analyzing neural network data from the rat barrel cortex and human temporal cortex. Y1 - 2022 U6 - https://doi.org/10.2312/vcbm.20221194 CY - Vienna, Austria ER - TY - CHAP A1 - Prodanov, Dimiter A1 - Vohra, Sumit Kumar T1 - Active Segmentation: Differential Geometry meets Machine Learning T2 - Proceedings of the 23rd International Conference on Computer Systems and Technologies N2 - Image segmentation is an active area of research for more than 30 years. Traditional image segmentation algorithms are problem-specific and limited in scope. On the other hand, machine learning offers an alternative paradigm where predefined features are combined into different classifiers, providing pixel-level classification and segmentation. However, machine learning only can not address the question as to which features are appropriate for a certain classification problem. This paper presents a project supported in part by the International Neuroinformatics Coordination Facility through the Google Summer of code. The project resulted in an automated image segmentation and classification platform, called Active Segmentation for ImageJ (AS/IJ). The platform integrates a set of filters computing differential geometrical invariants and combines them with machine learning approaches. Y1 - 2022 U6 - https://doi.org/10.1145/3546118.3546154 SP - 1 EP - 6 ER - TY - JOUR A1 - Schmitt, Kira A1 - Titschack, Jürgen A1 - Baum, Daniel T1 - Polyp-Cavity Segmentation of Cold-Water Corals guided by Ambient Occlusion and Ambient Curvature JF - Eurographics Workshop on Visual Computing for Biology and Medicine (VCBM) N2 - The segmentation of cavities in three-dimensional images of arbitrary objects is a difficult problem since the cavities are usually connected to the outside of the object without any difference in image intensity. Hence, the information whether a voxel belongs to a cavity or the outside needs to be derived from the ambient space. If a voxel is enclosed by object material, it is very likely that this voxel belongs to a cavity. However, there are dense structures where a voxel might still belong to the outside even though it is surrounded to a large degree by the object. This is, for example, the case for coral colonies. Therefore, additional information needs to be considered to distinguish between those cases. In this paper, we introduce the notion of ambient curvature, present an efficient way to compute it, and use it to segment coral polyp cavities by integrating it into the ambient occlusion framework. Moreover, we combine the ambient curvature with other ambient information in a Gaussian mixture model, trained from a few user scribbles, resulting in a significantly improved cavity segmentation. We showcase the superiority of our approach using four coral colonies of very different morphological types. While in this paper we restrict ourselves to coral data, we believe that the concept of ambient curvature is also useful for other data. Furthermore, our approach is not restricted to curvature but can be easily extended to exploit any properties given on an object's surface, thereby adjusting it to specific applications. Y1 - 2022 U6 - https://doi.org/10.2312/vcbm.20221189 ER - TY - JOUR A1 - Udvary, Daniel A1 - Harth, Philipp A1 - Macke, Jakob H. A1 - Hege, Hans-Christian A1 - de Kock, Christiaan P. J. A1 - Sakmann, Bert A1 - Oberlaender, Marcel T1 - The Impact of Neuron Morphology on Cortical Network Architecture JF - Cell Reports N2 - The neurons in the cerebral cortex are not randomly interconnected. This specificity in wiring can result from synapse formation mechanisms that connect neurons depending on their electrical activity and genetically defined identity. Here, we report that the morphological properties of the neurons provide an additional prominent source by which wiring specificity emerges in cortical networks. This morphologically determined wiring specificity reflects similarities between the neurons’ axo-dendritic projections patterns, the packing density and cellular diversity of the neuropil. The higher these three factors are the more recurrent is the topology of the network. Conversely, the lower these factors are the more feedforward is the network’s topology. These principles predict the empirically observed occurrences of clusters of synapses, cell type-specific connectivity patterns, and nonrandom network motifs. Thus, we demonstrate that wiring specificity emerges in the cerebral cortex at subcellular, cellular and network scales from the specific morphological properties of its neuronal constituents. Y1 - 2022 U6 - https://doi.org/10.1016/j.celrep.2022.110677 VL - 39 IS - 2 ER - TY - GEN A1 - Nava-Yazdani, Esfandiar A1 - Hanik, Martin A1 - Ambellan, Felix A1 - von Tycowicz, Christoph T1 - On Gradient Formulas in an Algorithm for the Logarithm of the Sasaki Metric N2 - The Sasaki metric is the canonical metric on the tangent bundle TM of a Riemannian manifold M. It is highly useful for data analysis in TM (e.g., when one is interested in the statistics of a set of geodesics in M). To this end, computing the Riemannian logarithm is often necessary, and an iterative algorithm was proposed by Muralidharan and Fletcher. In this note, we derive approximation formulas of the energy gradients in their algorithm that we use with success. T3 - ZIB-Report - 22-12 Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-87174 SN - 1438-0064 ER - TY - CHAP A1 - Myers, Adele A1 - Utpala, Saiteja A1 - Talbar, Shubham A1 - Sanborn, Sophia A1 - Shewmake, Christian A1 - Donnat, Claire A1 - Mathe, Johan A1 - Lupo, Umberto A1 - Sonthalia, Rishi A1 - Cui, Xinyue A1 - Szwagier, Tom A1 - Pignet, Arthur A1 - Bergsson, Andri A1 - Hauberg, Søren A1 - Nielsen, Dmitriy A1 - Sommer, Stefan A1 - Klindt, David A1 - Hermansen, Erik A1 - Vaupel, Melvin A1 - Dunn, Benjamin A1 - Xiong, Jeffrey A1 - Aharony, Noga A1 - Pe’er, Itsik A1 - Ambellan, Felix A1 - Hanik, Martin A1 - Navayazdani, Esfandiar A1 - Tycowicz, Christoph von A1 - Miolane, Nina T1 - ICLR 2022 Challenge for Computational Geomerty & Topology: Design and Results T2 - Proceedings of Topology, Algebra, and Geometry in Learning Y1 - 2022 VL - 196 SP - 269 EP - 276 PB - PMLR ER - TY - CHAP A1 - Lüdke, David A1 - Amiranashvili, Tamaz A1 - Ambellan, Felix A1 - Ezhov, Ivan A1 - Menze, Bjoern A1 - Zachow, Stefan T1 - Landmark-free Statistical Shape Modeling via Neural Flow Deformations T2 - Medical Image Computing and Computer Assisted Intervention - MICCAI 2022 N2 - Statistical shape modeling aims at capturing shape variations of an anatomical structure that occur within a given population. Shape models are employed in many tasks, such as shape reconstruction and image segmentation, but also shape generation and classification. Existing shape priors either require dense correspondence between training examples or lack robustness and topological guarantees. We present FlowSSM, a novel shape modeling approach that learns shape variability without requiring dense correspondence between training instances. It relies on a hierarchy of continuous deformation flows, which are parametrized by a neural network. Our model outperforms state-of-the-art methods in providing an expressive and robust shape prior for distal femur and liver. We show that the emerging latent representation is discriminative by separating healthy from pathological shapes. Ultimately, we demonstrate its effectiveness on two shape reconstruction tasks from partial data. Our source code is publicly available (https://github.com/davecasp/flowssm). Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-16434-7_44 VL - 13432 PB - Springer, Cham ER - TY - GEN A1 - Sagnol, Guillaume A1 - Hege, Hans-Christian A1 - Weiser, Martin T1 - Using sparse kernels to design computer experiments with tunable precision N2 - Statistical methods to design computer experiments usually rely on a Gaussian process (GP) surrogate model, and typically aim at selecting design points (combinations of algorithmic and model parameters) that minimize the average prediction variance, or maximize the prediction accuracy for the hyperparameters of the GP surrogate. In many applications, experiments have a tunable precision, in the sense that one software parameter controls the tradeoff between accuracy and computing time (e.g., mesh size in FEM simulations or number of Monte-Carlo samples). We formulate the problem of allocating a budget of computing time over a finite set of candidate points for the goals mentioned above. This is a continuous optimization problem, which is moreover convex whenever the tradeoff function accuracy vs. computing time is concave. On the other hand, using non-concave weight functions can help to identify sparse designs. In addition, using sparse kernel approximations drastically reduce the cost per iteration of the multiplicative weights updates that can be used to solve this problem. T3 - ZIB-Report - 16-33 KW - Optimal design of computer experiments KW - Sparse kernels KW - Gaussian Process Y1 - 2016 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-59605 SN - 1438-0064 ER - TY - CHAP A1 - Schade, Johannes A1 - von Tycowicz, Christoph A1 - Hanik, Martin T1 - Bi-invariant Geodesic Regression with Data from the Osteoarthritis Initiative T2 - Information Processing in Medical Imaging N2 - Many phenomena are naturally characterized by measuring continuous transformations such as shape changes in medicine or articulated systems in robotics. Modeling the variability in such datasets requires performing statistics on Lie groups, that is, manifolds carrying an additional group structure. As the Lie group captures the symmetries in the data, it is essential from a theoretical and practical perspective to ask for statistical methods that respect these symmetries; this way they are insensitive to confounding effects, e.g., due to the choice of reference coordinate systems. In this work, we investigate geodesic regression---a generalization of linear regression originally derived for Riemannian manifolds. While Lie groups can be endowed with Riemannian metrics, these are generally incompatible with the group structure. We develop a non-metric estimator using an affine connection setting. It captures geodesic relationships respecting the symmetries given by left and right translations. For its computation, we propose an efficient fixed point algorithm requiring simple differential expressions that can be calculated through automatic differentiation. We perform experiments on a synthetic example and evaluate our method on an open-access, clinical dataset studying knee joint configurations under the progression of osteoarthritis. Y1 - 2025 U6 - https://doi.org/10.1007/978-3-031-96628-6_4 SP - 49 EP - 63 PB - Springer CY - Lecture Notes in Computer Science ER - TY - JOUR A1 - Brence, Blaž A1 - Brummer, Josephine A1 - Dercksen, Vincent J. A1 - Özel, Mehmet Neset A1 - Kulkarni, Abhishkek A1 - Wolterhoff, Neele A1 - Prohaska, Steffen A1 - Hiesinger, Peter Robin A1 - Baum, Daniel T1 - Semi-automatic Geometrical Reconstruction and Analysis of Filopodia Dynamics in 4D Two-Photon Microscopy Images JF - bioRxiv N2 - Background: Filopodia are thin and dynamic membrane protrusions that play a crucial role in cell migration, axon guidance, and other processes where cells explore and interact with their surroundings. Historically, filopodial dynamics have been studied in great detail in 2D in cultured cells, and more recently in 3D culture as well as living brains. However, there is a lack of efficient tools to trace and track filopodia in 4D images of complex brain cells. Results: To address this issue, we have developed a semi-automatic workflow for tracing filopodia in 3D images and tracking the traced filopodia over time. The workflow was developed based on high-resolution data of photoreceptor axon terminals in the in vivo context of normal Drosophila brain development, but devised to be applicable to filopodia in any system, including at different temporal and spatial scales. In contrast to the pre-existing methods, our workflow relies solely on the original intensity images without the requirement for segmentation or complex preprocessing. The workflow was realized in C++ within the Amira software system and consists of two main parts, dataset pre-processing, and geometrical filopodia reconstruction, where each of the two parts comprises multiple steps. In this paper, we provide an extensive workflow description and demonstrate its versatility for two different axo-dendritic morphologies, R7 and Dm8 cells. Finally, we provide an analysis of the time requirements for user input and data processing. Conclusion: To facilitate simple application within Amira or other frameworks, we share the source code, which is available athttps://github.com/zibamira/filopodia-tool. Y1 - 2025 U6 - https://doi.org/10.1101/2025.05.20.654789 ER - TY - JOUR A1 - Brence, Blaž A1 - Wandelt, Laura R. A1 - Walter, Sophie A1 - Sigrist, Stephan J. A1 - Petzoldt, Astrid G. A1 - Baum, Daniel T1 - Semi-automatic 3D-quantification of in-vivo synapse formation JF - ResearchSquare N2 - Background: Synapses, as specialised cell-cell contacts, allow for a faithful and controlled signal transmission between a neuron and a target cell. Presynapses, the sites of neurotransmitter release, form de novo throughout the development of an organism. Although this process is fundamental to the development and function of synaptic circuits, how developing neurons control number and distribution of individual synapses remains poorly understood. In-vivo imaging analysis of synapse formation at the neuromuscular junction of anaesthetised Drosophila third instar larvae allows for spatial and temporal resolution of the underlying molecular processes. However, high-throughput, comprehensive analysis are hampered by the manual and time-consuming imaging analysis methods applied hitherto. Here, we focus on the early presynaptic formation steps, that is, the presynaptic seeding, initiated by the formation of transient Liprin-a/SYD1 seeding sites, either stabilised or disintegrated over a time span of 30-90 min. Results: To investigate the dynamics of the Liprin-a/SYD1 seeding sites, we developed an automated analysis pipeline for 3D confocal images from in-vivo imaging at distinct time points to analyse fluorescently labelled presynaptic protein dynamics during early synapse formation. The workflow is realised in the data analysis software Amira, utilising the hierarchical watershed algorithm, and was designed for automatic processing with an option for manual proofreading. Compared to the previous 2D manual quantification, this automated approach provides a higher sensitivity in single Liprin-a seeding site detection in low-intensity areas and in regions of dense seeding sites.In addition, it substantially reduces the work time. To account for possible errors occurring in the automated processing, we implemented an additional proofreading step allowing for a manual correction of Liprin-a seeding site segmentation and assignment, thus greatly improving the analysis while only marginally increasing work time by 10% to a total work time reduction of 80% compared to the 2D manual analysis paradigm. Conclusion: The process of synaptogenesis underlies the general principles of locomotion, learning and memory formation. The developed fast and accurate semi-automated 3D workflow provides a substantial progress in the analysis of this molecular process and its application can be easily extended to other dynamic in-vivo research approaches across species. Y1 - 2025 U6 - https://doi.org/10.21203/rs.3.rs-6073150/v1 ER - TY - JOUR A1 - Brence, Blaž A1 - Brummer, Josephine A1 - Dercksen, Vincent J. A1 - Özel, Mehmet Neset A1 - Kulkarni, Abhishek A1 - Wolterhoff, Neele A1 - Prohaska, Steffen A1 - Hiesinger, Peter Robin A1 - Baum, Daniel T1 - Semi-automatic geometrical reconstruction and analysis of filopodia dynamics in 4D two-photon microscopy images JF - BMC Bioinformatics N2 - Background: Filopodia are thin and dynamic membrane protrusions that play a crucial role in cell migration, axon guidance, and other processes where cells explore and interact with their surroundings. Historically, filopodial dynamics have been studied in great detail in 2D in cultured cells, and more recently in 3D culture as well as living brains. However, there is a lack of efficient tools to trace and track filopodia in 4D images of complex brain cells. Results: To address this issue, we have developed a semi-automatic workflow for tracing filopodia in 3D images and tracking the traced filopodia over time. The workflow was developed based on high-resolution data of photoreceptor axon terminals in the in vivo context of normal Drosophila brain development, but devised to be applicable to filopodia in any system, including at different temporal and spatial scales. In contrast to the pre-existing methods, our workflow relies solely on the original intensity images without the requirement for segmentation or complex preprocessing. The workflow was realized in C++ within the Amira software system and consists of two main parts, dataset pre-processing, and geometrical filopodia reconstruction, where each of the two parts comprises multiple steps. In this paper, we provide an extensive workflow description and demonstrate its versatility for two different axo-dendritic morphologies, R7 and Dm8 cells. Finally, we provide an analysis of the time requirements for user input and data processing. Conclusion: To facilitate simple application within Amira or other frameworks, we share the source code, which is available at https://github.com/zibamira/filopodia-tool. Y1 - 2026 U6 - https://doi.org/10.1186/s12859-026-06385-4 VL - 27 ER - TY - JOUR A1 - Lelièvre, Tony A1 - Zhang, Wei T1 - Pathwise estimates for effective dynamics: the case of nonlinear vectorial reaction coordinates JF - Multiscale Modeling and Simulation N2 - Effective dynamics using conditional expectation was proposed in [F. Legoll and T. Lelièvre, Nonlinearity, 2010] to approximate the essential dynamics of high-dimensional diffusion processes along a given reaction coordinate. The approximation error of the effective dynamics when it is used to approximate the behavior of the original dynamics has been considered in recent years. As a continuation of the previous work [F. Legoll, T. Lelièvre, and S. Olla, Stoch. Process. Appl, 2017], in this paper we obtain pathwise estimates for effective dynamics when the reaction coordinate function is either nonlinear or vector-valued. Y1 - 2018 U6 - https://doi.org/10.1137/18M1186034 IS - 17 SP - 1019 EP - 1051 ER - TY - JOUR A1 - Zhang, Wei T1 - Some new results on relative entropy production, time reversal, and optimal control of time-inhomogeneous diffusion processes JF - Journal of Mathematical Physics N2 - This paper studies time-inhomogeneous nonequilibrium diffusion processes, including both Brownian dynamics and Langevin dynamics. We derive upper bounds of the relative entropy production of the time-inhomogeneous process with respect to the transient invariant probability measures. We also study the time reversal of the reverse process in Crooks' fluctuation theorem. We show that the time reversal of the reverse process coincides with the optimally controlled forward process that leads to zero variance importance sampling estimator based on Jarzynski's equality. Y1 - 2021 U6 - https://doi.org/10.1063/5.0038740 VL - 62 IS - 4 ER - TY - JOUR A1 - Zhang, Wei A1 - Klus, Stefan A1 - Conrad, Tim A1 - Schütte, Christof T1 - Learning chemical reaction networks from trajectory data JF - SIAM Journal on Applied Dynamical Systems (SIADS) N2 - We develop a data-driven method to learn chemical reaction networks from trajectory data. Modeling the reaction system as a continuous-time Markov chain and assuming the system is fully observed,our method learns the propensity functions of the system with predetermined basis functions by maximizing the likelihood function of the trajectory data under l^1 sparse regularization. We demonstrate our method with numerical examples using synthetic data and carry out an asymptotic analysis of the proposed learning procedure in the infinite-data limit. Y1 - 2019 U6 - https://doi.org/10.1137/19M1265880 VL - 18 IS - 4 SP - 2000 EP - 2046 ER - TY - CHAP A1 - Iravani, Sahar A1 - Conrad, Tim ED - Holzinger, A. ED - Kieseberg, P. ED - Tjoa, A. ED - Weippl, E. T1 - Deep Learning for Proteomics Data for Feature Selection and Classification T2 - Machine Learning and Knowledge Extraction. CD-MAKE 2019 Y1 - 2019 U6 - https://doi.org/10.1007/978-3-030-29726-8_19 VL - 11713 PB - Springer, Cham ER - TY - THES A1 - Iravani, Sahar T1 - Interpretable Deep Learning Approaches for Biomarker Detection from High-Dimensional Biomedical Data Y1 - 2022 ER - TY - JOUR A1 - Eigen, Lennart A1 - Ladenburger, Pius A1 - Brence, Blaž A1 - Shubitidze, Ani A1 - Baum, Daniel A1 - Hildebrandt, Thomas A1 - Brecht, Michael T1 - Elephant trunk tip musculature reflects species differences in grasping behavior JF - Communications Biology N2 - Elephants use their trunks, muscular hydrostats, to perform a plethora of tasks. Trunk tip morphology as well as grasping behavior differ between elephant species. While African savanna elephants (Loxodonta africana) use their dorsal and ventral finger for pinching movements, Asian elephants (Elephas maximus) prefer to wrap around objects with their one dorsal finger and ventral bulb trunk tip lip. Moreover, E. maximus can flip their ventral bulb backwards to clamp objects behind the trunk tip. Whether trunk tip musculature differs between elephant species and muscle architecture is reflected by preferred grasping behavior is, however, not clear. In this study, we performed dense muscle fascicle reconstruction of three L. africana and three E. maximus hemi-trunk tips using a combination of manual and automated segmentation of high-resolution microfocus tomography (microCT) scans. We distinguish three types of muscle fascicles: longitudinal (bending and shortening), radial (elongating) and transversal muscle fascicles (elongating). We found that trunk tips of L. africana consist to one third of longitudinal and two thirds radial/transversal muscle fascicles, likely aiding in their grasping behavior, while E. maximus trunk tips consist to two thirds of longitudinal and one third radial/transversal muscle fascicles, which is advantageous for their wrapping and backward clamping behavior. Y1 - 2025 U6 - https://doi.org/10.1038/s42003-025-08998-6 VL - 8 ER - TY - JOUR A1 - Zhang, Wei A1 - Hartmann, Carsten A1 - von Kleist, Max T1 - Optimal control of Markov jump processes: Asymptotic analysis, algorithms and applications to the modeling of chemical reaction systems JF - Communications in Mathematical Sciences N2 - Markov jump processes are widely used to model natural and engineered processes. In the context of biological or chemical applications one typically refers to the chemical master equation (CME), which models the evolution of the probability mass of any copy-number combination of the interacting particles. When many interacting particles (“species”) are considered, the complexity of the CME quickly increases, making direct numerical simulations impossible. This is even more problematic when one aims at controlling the Markov jump processes defined by the CME. In this work, we study both open loop and feedback optimal control problems of the Markov jump processes in the case that the controls can only be switched at fixed control stages. Based on Kurtz’s limit theorems, we prove the convergence of the respective control value functions of the underlying Markov decision problem as the copy numbers of the species go to infinity. In the case of the optimal control problem on a finite time-horizon, we propose a hybrid control policy algorithm to overcome the difficulties due to the curse of dimensionality when the copy number of the involved species is large. Two numerical examples demonstrate the suitability of both the analysis and the proposed algorithms. Y1 - 2018 U6 - https://doi.org/10.4310/CMS.2018.v16.n2.a1 SP - 293 EP - 331 ER - TY - JOUR A1 - Sharma, Upanshu A1 - Zhang, Wei T1 - Non-reversible sampling schemes on submanifolds JF - SIAM Journal on Numerical Analysis N2 - Calculating averages with respect to probability measures on submanifolds is often necessary in various application areas such as molecular dynamics, computational statistical mechanics and Bayesian statistics. In recent years, various numerical schemes have been proposed in the literature to study this problem based on appropriate reversible constrained stochastic dynamics. In this paper we present and analyse a non-reversible generalisation of the projection-based scheme developed by one of the authors [ESAIM: M2AN, 54 (2020), pp. 391-430]. This scheme consists of two steps - starting from a state on the submanifold, we first update the state using a non-reversible stochastic differential equation which takes the state away from the submanifold, and in the second step we project the state back onto the manifold using the long-time limit of a ordinary differential equation. We prove the consistency of this numerical scheme and provide quantitative error estimates for estimators based on finite-time running averages. Furthermore, we present theoretical analysis which shows that this scheme outperforms its reversible counterpart in terms of asymptotic variance. We demonstrate our findings on an illustrative test example. Y1 - 2020 U6 - https://doi.org/10.1137/20M1378752 VL - 59 IS - 6 SP - 2989 EP - 3031 ER - TY - JOUR A1 - Zhang, Wei T1 - Ergodic SDEs on submanifolds and related numerical sampling schemes JF - ESAIM: Mathematical Modelling and Numerical Analysis N2 - In many applications, it is often necessary to sample the mean value of certain quantity with respect to a probability measure $\mu$ on the level set of a smooth function ξ:R^d→R^k, 1≤k