TY - CHAP A1 - Hanik, Martin A1 - Hege, Hans-Christian A1 - von Tycowicz, Christoph T1 - A Nonlinear Hierarchical Model for Longitudinal Data on Manifolds T2 - 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI) N2 - Large longitudinal studies provide lots of valuable information, especially in medical applications. A problem which must be taken care of in order to utilize their full potential is that of correlation between intra-subject measurements taken at different times. For data in Euclidean space this can be done with hierarchical models, that is, models that consider intra-subject and between-subject variability in two different stages. Nevertheless, data from medical studies often takes values in nonlinear manifolds. Here, as a first step, geodesic hierarchical models have been developed that generalize the linear ansatz by assuming that time-induced intra-subject variations occur along a generalized straight line in the manifold. However, this is often not the case (e.g., periodic motion or processes with saturation). We propose a hierarchical model for manifold-valued data that extends this to include trends along higher-order curves, namely Bézier splines in the manifold. To this end, we present a principled way of comparing shape trends in terms of a functional-based Riemannian metric. Remarkably, this metric allows efficient, yet simple computations by virtue of a variational time discretization requiring only the solution of regression problems. We validate our model on longitudinal data from the osteoarthritis initiative, including classification of disease progression. Y1 - 2022 U6 - https://doi.org/10.1109/ISBI52829.2022.9761465 SP - 1 EP - 5 ER - TY - JOUR A1 - Nava-Yazdani, Esfandiar A1 - Hege, Hans-Christian A1 - von Tycowicz, Christoph T1 - A Hierarchical Geodesic Model for Longitudinal Analysis on Manifolds JF - Journal of Mathematical Imaging and Vision N2 - In many applications, geodesic hierarchical models are adequate for the study of temporal observations. We employ such a model derived for manifold-valued data to Kendall's shape space. In particular, instead of the Sasaki metric, we adapt a functional-based metric, which increases the computational efficiency and does not require the implementation of the curvature tensor. We propose the corresponding variational time discretization of geodesics and employ the approach for longitudinal analysis of 2D rat skulls shapes as well as 3D shapes derived from an imaging study on osteoarthritis. Particularly, we perform hypothesis test and estimate the mean trends. Y1 - 2022 U6 - https://doi.org/10.1007/s10851-022-01079-x VL - 64 IS - 4 SP - 395 EP - 407 ER - TY - CHAP A1 - Paskin, Martha A1 - Dean, Mason A1 - Baum, Daniel A1 - von Tycowicz, Christoph T1 - A Kendall Shape Space Approach to 3D Shape Estimation from 2D Landmarks T2 - Computer Vision -- ECCV 2022 N2 - 3D shapes provide substantially more information than 2D images. However, the acquisition of 3D shapes is sometimes very difficult or even impossible in comparison with acquiring 2D images, making it necessary to derive the 3D shape from 2D images. Although this is, in general, a mathematically ill-posed problem, it might be solved by constraining the problem formulation using prior information. Here, we present a new approach based on Kendall’s shape space to reconstruct 3D shapes from single monocular 2D images. The work is motivated by an application to study the feeding behavior of the basking shark, an endangered species whose massive size and mobility render 3D shape data nearly impossible to obtain, hampering understanding of their feeding behaviors and ecology. 2D images of these animals in feeding position, however, are readily available. We compare our approach with state-of-the-art shape-based approaches both on human stick models and on shark head skeletons. Using a small set of training shapes, we show that the Kendall shape space approach is substantially more robust than previous methods and always results in plausible shapes. This is essential for the motivating application in which specimens are rare and therefore only few training shapes are available. Y1 - 2022 U6 - https://doi.org/10.1007/978-3-031-20086-1_21 SP - 363 EP - 379 PB - Springer Nature Switzerland ER - TY - GEN A1 - Paskin, Martha A1 - Baum, Daniel A1 - Dean, Mason N. A1 - von Tycowicz, Christoph T1 - A Kendall Shape Space Approach to 3D Shape Estimation from 2D Landmarks -- Source Code and Data N2 - Source code and novel dataset of basking shark head skeletons facilitating the reproduction of the results presented in 'A Kendall Shape Space Approach to 3D Shape Estimation from 2D Landmarks' - ECCV 2022. Y1 - 2022 U6 - https://doi.org/10.12752/8730 ER - TY - JOUR A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - Rigid Motion Invariant Statistical Shape Modeling based on Discrete Fundamental Forms JF - Medical Image Analysis N2 - We present a novel approach for nonlinear statistical shape modeling that is invariant under Euclidean motion and thus alignment-free. By analyzing metric distortion and curvature of shapes as elements of Lie groups in a consistent Riemannian setting, we construct a framework that reliably handles large deformations. Due to the explicit character of Lie group operations, our non-Euclidean method is very efficient allowing for fast and numerically robust processing. This facilitates Riemannian analysis of large shape populations accessible through longitudinal and multi-site imaging studies providing increased statistical power. Additionally, as planar configurations form a submanifold in shape space, our representation allows for effective estimation of quasi-isometric surfaces flattenings. We evaluate the performance of our model w.r.t. shape-based classification of hippocampus and femur malformations due to Alzheimer's disease and osteoarthritis, respectively. In particular, we achieve state-of-the-art accuracies outperforming the standard Euclidean as well as a recent nonlinear approach especially in presence of sparse training data. To provide insight into the model's ability of capturing biological shape variability, we carry out an analysis of specificity and generalization ability. Y1 - 2021 U6 - https://doi.org/10.1016/j.media.2021.102178 VL - 73 ER - TY - CHAP A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - Geodesic B-Score for Improved Assessment of Knee Osteoarthritis T2 - Proc. Information Processing in Medical Imaging (IPMI) N2 - Three-dimensional medical imaging enables detailed understanding of osteoarthritis structural status. However, there remains a vast need for automatic, thus, reader-independent measures that provide reliable assessment of subject-specific clinical outcomes. To this end, we derive a consistent generalization of the recently proposed B-score to Riemannian shape spaces. We further present an algorithmic treatment yielding simple, yet efficient computations allowing for analysis of large shape populations with several thousand samples. Our intrinsic formulation exhibits improved discrimination ability over its Euclidean counterpart, which we demonstrate for predictive validity on assessing risks of total knee replacement. This result highlights the potential of the geodesic B-score to enable improved personalized assessment and stratification for interventions. Y1 - 2021 U6 - https://doi.org/10.1007/978-3-030-78191-0_14 SP - 177 EP - 188 ER - TY - GEN A1 - Ambellan, Felix A1 - Hanik, Martin A1 - von Tycowicz, Christoph T1 - Morphomatics: Geometric morphometrics in non-Euclidean shape spaces N2 - Morphomatics is an open-source Python library for (statistical) shape analysis developed within the geometric data analysis and processing research group at Zuse Institute Berlin. It contains prototype implementations of intrinsic manifold-based methods that are highly consistent and avoid the influence of unwanted effects such as bias due to arbitrary choices of coordinates. KW - shape analysis KW - geometric statistics KW - geometric morphometrics Y1 - 2021 U6 - https://doi.org/10.12752/8544 N1 - https://morphomatics.github.io/ ER - TY - JOUR A1 - Sipiran, Ivan A1 - Lazo, Patrick A1 - Lopez, Cristian A1 - Bagewadi, Nihar A1 - Bustos, Benjamin A1 - Dao, Hieu A1 - Gangisetty, Shankar A1 - Hanik, Martin A1 - Ho-Thi, Ngoc-Phuong A1 - Holenderski, Mike A1 - Jarnikov, Dmitri A1 - Labrada, Arniel A1 - Lengauer, Stefan A1 - Licandro, Roxane A1 - Nguyen, Dinh-Huan A1 - Nguyen-Ho, Thang-Long A1 - Pérez Rey, Luis A. A1 - Pham, Bang-Dang A1 - Pham, Minh-Khoi A1 - Preiner, Reinhold A1 - Schreck, Tobias A1 - Trinh, Quoc-Huy A1 - Tonnaer, Loek A1 - von Tycowicz, Christoph A1 - Vu-Le, The-Anh T1 - SHREC 2021: Retrieval of Cultural Heritage Objects JF - Computers and Graphics N2 - This paper presents the methods and results of the SHREC’21 contest on a dataset of cultural heritage (CH) objects. We present a dataset of 938 scanned models that have varied geometry and artistic styles. For the competition, we propose two challenges: the retrieval-by-shape challenge and the retrieval-by-culture challenge. The former aims at evaluating the ability of retrieval methods to discriminate cultural heritage objects by overall shape. The latter focuses on assessing the effectiveness of retrieving objects from the same culture. Both challenges constitute a suitable scenario to evaluate modern shape retrieval methods in a CH domain. Ten groups participated in the contest: thirty runs were submitted for the retrieval-by-shape task, and twenty-six runs were submitted for the retrieval-by-culture challenge. The results show a predominance of learning methods on image-based multi-view representations to characterize 3D objects. Nevertheless, the problem presented in our challenges is far from being solved. We also identify the potential paths for further improvements and give insights into the future directions of research. Y1 - 2021 U6 - https://doi.org/10.1016/j.cag.2021.07.010 VL - 100 SP - 1 EP - 20 ER - TY - JOUR A1 - Moewis, Philippe A1 - Kaiser, René A1 - Trepczynski, Adam A1 - von Tycowicz, Christoph A1 - Krahl, Leonie A1 - Ilg, Ansgar A1 - Holz, Johannes A1 - Duda, Georg T1 - Patient specific resurfacing implant knee surgery in subjects with early osteoarthritis results in medial pivot and lateral femoral rollback during flexion: A retrospective pilot study JF - Knee Surgery, Sports Traumatology, Arthroscopy N2 - Purpose. Metallic resurfacing implants have been developed for the treatment of early, focal, small, condylar and trochlear osteoarthritis (OA) lesions. They represent an option for patients who are either too young to fulfill the criteria for total knee arthroplasty (TKA) or too old for biological treatment. Although relevant clinical evidence has been collected for different resurfacing types, the in vivo post-operative knee kinematics remains unknown. The present study aims to measure and analyse the knee joint kinematics in subjects with patient-specific Episealer implants Methods. Retrospective study design. Fluoroscopic analyses during high flexion activities (unloaded flexion-extension and loaded lunge) were conducted at >12 months post-surgery in ten Episealer knees. The post-operative knee joint kinematics was compared to equally assessed kinematic from ten healthy knees, twenty G-Curve TKA knees and 10 J-Curve knees. Pre- and postoperative clinical data of the Episealer knees were collected using a visual analog scale (VAS), the EQ 5d Health Questionnaire and the Knee Injury and Osteoarthritis Outcome Score (KOOS). Results. During unloaded flexion-extension and loaded lunge, the medial condyle in the Episealer knees remained relative stationary, indicating a medial pivot, while the lateral condyle translated consistently towards posterior. Similarly, reduced movement of the medial condyle and posterior translation of the lateral condyle was also observed in the healthy knees, although to a lesser extent. In contrast, the kinematics of both TKA cohorts during unloaded flexion-extension showed a tendency towards anterior displacement in the medial compartment, which led to significant differences in comparison with the Episealer knees. In the lateral compartment, a certain degree of femoral rollback was noted in the G-Curve TKA cohort. Improved scores were observed in the Episealer subjects between the preoperative and 1-year postoperative follow-up. Conclusion. At 12 months postsurgery, a physiological-like knee kinematics was observed in the group of patient-specific reconstructed chondral/osteochondral lesions by means of a resurfacing Episealer implant strategy. Considering that these patients are physically active and do not fulfill the criteria for TKA, the group is hard to be compared to TKA patients which usually are less active and more challenging. Nevertheless, the comparison to either healthy knee kinematics as well as to TKA reconstructed knees with different implant designs showed a more physiological-like kinematics in the resurfacing implants that seems more appropriate for such a patient group. Despite positive results, careful clinical follow-up of treated patients is recommended for the long-term OA progression. Further investigations need to be encouraged not only in larger patient groups but also in a prospective manner to assess the pre- to postoperative kinematic changes. Y1 - 2021 U6 - https://doi.org/10.1007/s00167-021-06749-8 ER - TY - CHAP A1 - Hanik, Martin A1 - Hege, Hans-Christian A1 - von Tycowicz, Christoph T1 - Bi-invariant Two-Sample Tests in Lie Groups for Shape Analysis T2 - Shape in Medical Imaging N2 - We propose generalizations of the T²-statistics of Hotelling and the Bhattacharayya distance for data taking values in Lie groups. A key feature of the derived measures is that they are compatible with the group structure even for manifolds that do not admit any bi-invariant metric. This property, e.g., assures analysis that does not depend on the reference shape, thus, preventing bias due to arbitrary choices thereof. Furthermore, the generalizations agree with the common definitions for the special case of flat vector spaces guaranteeing consistency. Employing a permutation test setup, we further obtain nonparametric, two-sample testing procedures that themselves are bi-invariant and consistent. We validate our method in group tests revealing significant differences in hippocampal shape between individuals with mild cognitive impairment and normal controls. Y1 - 2020 U6 - https://doi.org/10.1007/978-3-030-61056-2_4 SP - 44 EP - 54 PB - Springer International Publishing CY - Cham ER - TY - CHAP A1 - Hanik, Martin A1 - Hege, Hans-Christian A1 - Hennemuth, Anja A1 - von Tycowicz, Christoph T1 - Nonlinear Regression on Manifolds for Shape Analysis using Intrinsic Bézier Splines T2 - Proc. Medical Image Computing and Computer Assisted Intervention (MICCAI) N2 - Intrinsic and parametric regression models are of high interest for the statistical analysis of manifold-valued data such as images and shapes. The standard linear ansatz has been generalized to geodesic regression on manifolds making it possible to analyze dependencies of random variables that spread along generalized straight lines. Nevertheless, in some scenarios, the evolution of the data cannot be modeled adequately by a geodesic. We present a framework for nonlinear regression on manifolds by considering Riemannian splines, whose segments are Bézier curves, as trajectories. Unlike variational formulations that require time-discretization, we take a constructive approach that provides efficient and exact evaluation by virtue of the generalized de Casteljau algorithm. We validate our method in experiments on the reconstruction of periodic motion of the mitral valve as well as the analysis of femoral shape changes during the course of osteoarthritis, endorsing Bézier spline regression as an effective and flexible tool for manifold-valued regression. Y1 - 2020 U6 - https://doi.org/10.1007/978-3-030-59719-1_60 SP - 617 EP - 626 PB - Springer International Publishing CY - Cham ER - TY - JOUR A1 - Nava-Yazdani, Esfandiar A1 - Hege, Hans-Christian A1 - Sullivan, T. J. A1 - von Tycowicz, Christoph T1 - Geodesic Analysis in Kendall's Shape Space with Epidemiological Applications JF - Journal of Mathematical Imaging and Vision N2 - We analytically determine Jacobi fields and parallel transports and compute geodesic regression in Kendall’s shape space. Using the derived expressions, we can fully leverage the geometry via Riemannian optimization and thereby reduce the computational expense by several orders of magnitude over common, nonlinear constrained approaches. The methodology is demonstrated by performing a longitudinal statistical analysis of epidemiological shape data. As an example application we have chosen 3D shapes of knee bones, reconstructed from image data of the Osteoarthritis Initiative (OAI). Comparing subject groups with incident and developing osteoarthritis versus normal controls, we find clear differences in the temporal development of femur shapes. This paves the way for early prediction of incident knee osteoarthritis, using geometry data alone. Y1 - 2020 U6 - https://doi.org/10.1007/s10851-020-00945-w VL - 62 IS - 4 SP - 549 EP - 559 ER - TY - CHAP A1 - von Tycowicz, Christoph T1 - Towards Shape-based Knee Osteoarthritis Classification using Graph Convolutional Networks T2 - 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI 2020) N2 - We present a transductive learning approach for morphometric osteophyte grading based on geometric deep learning. We formulate the grading task as semi-supervised node classification problem on a graph embedded in shape space. To account for the high-dimensionality and non-Euclidean structure of shape space we employ a combination of an intrinsic dimension reduction together with a graph convolutional neural network. We demonstrate the performance of our derived classifier in comparisons to an alternative extrinsic approach. Y1 - 2020 U6 - https://doi.org/10.1109/ISBI45749.2020.9098687 ER - TY - CHAP A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - An as-invariant-as-possible GL+(3)-based Statistical Shape Model T2 - Proc. 7th MICCAI workshop on Mathematical Foundations of Computational Anatomy (MFCA) N2 - We describe a novel nonlinear statistical shape model basedon differential coordinates viewed as elements of GL+(3). We adopt an as-invariant-as possible framework comprising a bi-invariant Lie group mean and a tangent principal component analysis based on a unique GL+(3)-left-invariant, O(3)-right-invariant metric. Contrary to earlier work that equips the coordinates with a specifically constructed group structure, our method employs the inherent geometric structure of the group-valued data and therefore features an improved statistical power in identifying shape differences. We demonstrate this in experiments on two anatomical datasets including comparison to the standard Euclidean as well as recent state-of-the-art nonlinear approaches to statistical shape modeling. Y1 - 2019 U6 - https://doi.org/10.1007/978-3-030-33226-6_23 VL - 11846 SP - 219 EP - 228 PB - Springer ER - TY - CHAP A1 - Nava-Yazdani, Esfandiar A1 - Hege, Hans-Christian A1 - von Tycowicz, Christoph T1 - A Geodesic Mixed Effects Model in Kendall's Shape Space T2 - Proc. 7th MICCAI workshop on Mathematical Foundations of Computational Anatomy (MFCA) N2 - In many applications, geodesic hierarchical models are adequate for the study of temporal observations. We employ such a model derived for manifold-valued data to Kendall's shape space. In particular, instead of the Sasaki metric, we adapt a functional-based metric, which increases the computational efficiency and does not require the implementation of the curvature tensor. We propose the corresponding variational time discretization of geodesics and apply the approach for the estimation of group trends and statistical testing of 3D shapes derived from an open access longitudinal imaging study on osteoarthritis. Y1 - 2019 U6 - https://doi.org/10.1007/978-3-030-33226-6_22 VL - 11846 SP - 209 EP - 218 ER - TY - CHAP A1 - Ambellan, Felix A1 - Zachow, Stefan A1 - von Tycowicz, Christoph T1 - A Surface-Theoretic Approach for Statistical Shape Modeling T2 - Proc. Medical Image Computing and Computer Assisted Intervention (MICCAI), Part IV N2 - We present a novel approach for nonlinear statistical shape modeling that is invariant under Euclidean motion and thus alignment-free. By analyzing metric distortion and curvature of shapes as elements of Lie groups in a consistent Riemannian setting, we construct a framework that reliably handles large deformations. Due to the explicit character of Lie group operations, our non-Euclidean method is very efficient allowing for fast and numerically robust processing. This facilitates Riemannian analysis of large shape populations accessible through longitudinal and multi-site imaging studies providing increased statistical power. We evaluate the performance of our model w.r.t. shape-based classification of pathological malformations of the human knee and show that it outperforms the standard Euclidean as well as a recent nonlinear approach especially in presence of sparse training data. To provide insight into the model’s ability of capturing natural biological shape variability, we carry out an analysis of specificity and generalization ability. Y1 - 2019 U6 - https://doi.org/10.1007/978-3-030-32251-9_3 VL - 11767 SP - 21 EP - 29 PB - Springer ER - TY - CHAP A1 - Ambellan, Felix A1 - Lamecker, Hans A1 - von Tycowicz, Christoph A1 - Zachow, Stefan ED - Rea, Paul M. T1 - Statistical Shape Models - Understanding and Mastering Variation in Anatomy T2 - Biomedical Visualisation N2 - In our chapter we are describing how to reconstruct three-dimensional anatomy from medical image data and how to build Statistical 3D Shape Models out of many such reconstructions yielding a new kind of anatomy that not only allows quantitative analysis of anatomical variation but also a visual exploration and educational visualization. Future digital anatomy atlases will not only show a static (average) anatomy but also its normal or pathological variation in three or even four dimensions, hence, illustrating growth and/or disease progression. Statistical Shape Models (SSMs) are geometric models that describe a collection of semantically similar objects in a very compact way. SSMs represent an average shape of many three-dimensional objects as well as their variation in shape. The creation of SSMs requires a correspondence mapping, which can be achieved e.g. by parameterization with a respective sampling. If a corresponding parameterization over all shapes can be established, variation between individual shape characteristics can be mathematically investigated. We will explain what Statistical Shape Models are and how they are constructed. Extensions of Statistical Shape Models will be motivated for articulated coupled structures. In addition to shape also the appearance of objects will be integrated into the concept. Appearance is a visual feature independent of shape that depends on observers or imaging techniques. Typical appearances are for instance the color and intensity of a visual surface of an object under particular lighting conditions, or measurements of material properties with computed tomography (CT) or magnetic resonance imaging (MRI). A combination of (articulated) statistical shape models with statistical models of appearance lead to articulated Statistical Shape and Appearance Models (a-SSAMs).After giving various examples of SSMs for human organs, skeletal structures, faces, and bodies, we will shortly describe clinical applications where such models have been successfully employed. Statistical Shape Models are the foundation for the analysis of anatomical cohort data, where characteristic shapes are correlated to demographic or epidemiologic data. SSMs consisting of several thousands of objects offer, in combination with statistical methods ormachine learning techniques, the possibility to identify characteristic clusters, thus being the foundation for advanced diagnostic disease scoring. Y1 - 2019 SN - 978-3-030-19384-3 SN - 978-3-030-19385-0 U6 - https://doi.org/10.1007/978-3-030-19385-0_5 VL - 3 IS - 1156 SP - 67 EP - 84 PB - Springer Nature Switzerland AG ET - 1 ER - TY - JOUR A1 - von Tycowicz, Christoph A1 - Ambellan, Felix A1 - Mukhopadhyay, Anirban A1 - Zachow, Stefan T1 - An Efficient Riemannian Statistical Shape Model using Differential Coordinates JF - Medical Image Analysis N2 - We propose a novel Riemannian framework for statistical analysis of shapes that is able to account for the nonlinearity in shape variation. By adopting a physical perspective, we introduce a differential representation that puts the local geometric variability into focus. We model these differential coordinates as elements of a Lie group thereby endowing our shape space with a non-Euclidean structure. A key advantage of our framework is that statistics in a manifold shape space becomes numerically tractable improving performance by several orders of magnitude over state-of-the-art. We show that our Riemannian model is well suited for the identification of intra-population variability as well as inter-population differences. In particular, we demonstrate the superiority of the proposed model in experiments on specificity and generalization ability. We further derive a statistical shape descriptor that outperforms the standard Euclidean approach in terms of shape-based classification of morphological disorders. Y1 - 2018 U6 - https://doi.org/10.1016/j.media.2017.09.004 VL - 43 IS - 1 SP - 1 EP - 9 ER -