TY - CHAP A1 - Grewe, Carl Martin A1 - Zachow, Stefan T1 - Fully Automated and Highly Accurate Dense Correspondence for Facial Surfaces T2 - Computer Vision – ECCV 2016 Workshops N2 - We present a novel framework for fully automated and highly accurate determination of facial landmarks and dense correspondence, e.g. a topologically identical mesh of arbitrary resolution, across the entire surface of 3D face models. For robustness and reliability of the proposed approach, we are combining 2D landmark detectors and 3D statistical shape priors with a variational matching method. Instead of matching faces in the spatial domain only, we employ image registration to align the 2D parametrization of the facial surface to a planar template we call the Unified Facial Parameter Domain (ufpd). This allows us to simultaneously match salient photometric and geometric facial features using robust image similarity measures while reasonably constraining geometric distortion in regions with less significant features. We demonstrate the accuracy of the dense correspondence established by our framework on the BU3DFE database with 2500 facial surfaces and show, that our framework outperforms current state-of-the-art methods with respect to the fully automated location of facial landmarks. Y1 - 2016 U6 - https://doi.org/10.1007/978-3-319-48881-3_38 VL - 9914 SP - 552 EP - 568 PB - Springer International Publishing ER - TY - CHAP A1 - Grewe, Carl Martin A1 - Schreiber, Lisa T1 - Digitale Bildarchive. Archivierung und Codierung der Gefühle T2 - +ultra gestaltung schafft wissen Y1 - 2016 SN - 978-3-86502-378-0 SP - 285 EP - 290 PB - Seemann Henschel ER - TY - CHAP A1 - Grewe, Carl Martin A1 - le Roux, Gabriel A1 - Pilz, Sven-Kristofer A1 - Zachow, Stefan T1 - Spotting the Details: The Various Facets of Facial Expressions T2 - IEEE International Conference on Automatic Face and Gesture Recognition Y1 - 2018 U6 - https://doi.org/10.1109/FG.2018.00049 SP - 286 EP - 293 ER - TY - JOUR A1 - Weiss, Selina A1 - Grewe, Carl Martin A1 - Olderbak, Sally A1 - Goecke, Benjamin A1 - Kaltwasser, Laura A1 - Hildebrandt, Andrea T1 - Symmetric or not? A holistic approach to the measurement of fluctuating asymmetry from facial photographs JF - Personality and Individual Differences Y1 - 2020 U6 - https://doi.org/https://doi.org/10.1016/j.paid.2020.110137 VL - 166 SP - 1 EP - 12 ER - TY - JOUR A1 - Weiss, Selina A1 - Grewe, Carl Martin A1 - Olderbak, Sally A1 - Goecke, Benjamin A1 - Kaltwasser, Laura A1 - Hildebrandt, Andrea T1 - Symmetric or not? A holistic approach to the measurement of fluctuating asymmetry from facial photographs JF - PsyArXiv Y1 - 2020 U6 - https://doi.org/10.31234/osf.io/s534t N1 - preprint of https://doi.org/10.1016/j.paid.2020.110137 ER - TY - GEN A1 - Grewe, Carl Martin A1 - Schreiber, Lisa ED - Doll, Nikola ED - Bredekamp, Horst ED - Schäffner, Wolfgang T1 - Digital Image Archive. The Archiving and Coding of Emotions T2 - +ultra. Knowledge & Gestaltung Y1 - 2017 SP - 281 EP - 286 PB - Seemann Henschel ER - TY - GEN A1 - Grewe, Carl Martin A1 - Zachow, Stefan ED - Doll, Nikola ED - Bredekamp, Horst ED - Schäffner, Wolfgang T1 - Face to Face-Interface T2 - +ultra. Knowledge & Gestaltung Y1 - 2017 SP - 320 EP - 321 PB - Seemann Henschel ER - TY - GEN A1 - Grewe, Carl Martin A1 - Le Roux, Gabriel A1 - Pilz, Sven-Kristofer A1 - Zachow, Stefan T1 - Spotting the Details: The Various Facets of Facial Expressions N2 - 3D Morphable Models (MM) are a popular tool for analysis and synthesis of facial expressions. They represent plausible variations in facial shape and appearance within a low-dimensional parameter space. Fitted to a face scan, the model's parameters compactly encode its expression patterns. This expression code can be used, for instance, as a feature in automatic facial expression recognition. For accurate classification, an MM that can adequately represent the various characteristic facets and variants of each expression is necessary. Currently available MMs are limited in the diversity of expression patterns. We present a novel high-quality Facial Expression Morphable Model built from a large-scale face database as a tool for expression analysis and synthesis. Establishment of accurate dense correspondence, up to finest skin features, enables a detailed statistical analysis of facial expressions. Various characteristic shape patterns are identified for each expression. The results of our analysis give rise to a new facial expression code. We demonstrate the advantages of such a code for the automatic recognition of expressions, and compare the accuracy of our classifier to state-of-the-art. T3 - ZIB-Report - 18-06 Y1 - 2018 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-67696 SN - 1438-0064 ER - TY - GEN A1 - Grewe, Carl Martin A1 - Lamecker, Hans A1 - Zachow, Stefan ED - Hermanussen, Michael T1 - Landmark-based Statistical Shape Analysis T2 - Auxology - Studying Human Growth and Development url Y1 - 2013 UR - http://www.schweizerbart.de/publications/detail/isbn/9783510652785 SP - 199 EP - 201 PB - Schweizerbart Verlag, Stuttgart ER - TY - GEN A1 - Grewe, Carl Martin A1 - Lamecker, Hans A1 - Zachow, Stefan T1 - Digital morphometry: The Potential of Statistical Shape Models T2 - Anthropologischer Anzeiger. Journal of Biological and Clinical Anthropology Y1 - 2011 SP - 506 EP - 506 ER - TY - GEN A1 - Wilson, David A1 - Bücher, Pia A1 - Grewe, Carl Martin A1 - Anglin, Carolyn A1 - Zachow, Stefan A1 - Michael, Dunbar T1 - Validation of Three Dimensional Models of the Distal Femur Created from Surgical Navigation Point Cloud Data T2 - 15th Annual Meeting of the International Society for Computer Assisted Orthopaedic Surgery (CAOS) Y1 - 2015 ER - TY - GEN A1 - Wilson, David A1 - Bücher, Pia A1 - Grewe, Carl Martin A1 - Mocanu, Valentin A1 - Anglin, Carolyn A1 - Zachow, Stefan A1 - Dunbar, Michael T1 - Validation of Three Dimensional Models of the Distal Femur Created from Surgical Navigation Data T2 - Orthopedic Research Society Annual Meeting Y1 - 2015 CY - Las Vegas, Nevada ER - TY - JOUR A1 - Wilson, David A1 - Anglin, Carolyn A1 - Ambellan, Felix A1 - Grewe, Carl Martin A1 - Tack, Alexander A1 - Lamecker, Hans A1 - Dunbar, Michael A1 - Zachow, Stefan T1 - Validation of three-dimensional models of the distal femur created from surgical navigation point cloud data for intraoperative and postoperative analysis of total knee arthroplasty JF - International Journal of Computer Assisted Radiology and Surgery N2 - Purpose: Despite the success of total knee arthroplasty there continues to be a significant proportion of patients who are dissatisfied. One explanation may be a shape mismatch between pre and post-operative distal femurs. The purpose of this study was to investigate a method to match a statistical shape model (SSM) to intra-operatively acquired point cloud data from a surgical navigation system, and to validate it against the pre-operative magnetic resonance imaging (MRI) data from the same patients. Methods: A total of 10 patients who underwent navigated total knee arthroplasty also had an MRI scan less than 2 months pre-operatively. The standard surgical protocol was followed which included partial digitization of the distal femur. Two different methods were employed to fit the SSM to the digitized point cloud data, based on (1) Iterative Closest Points (ICP) and (2) Gaussian Mixture Models (GMM). The available MRI data were manually segmented and the reconstructed three-dimensional surfaces used as ground truth against which the statistical shape model fit was compared. Results: For both approaches, the difference between the statistical shape model-generated femur and the surface generated from MRI segmentation averaged less than 1.7 mm, with maximum errors occurring in less clinically important areas. Conclusion: The results demonstrated good correspondence with the distal femoral morphology even in cases of sparse data sets. Application of this technique will allow for measurement of mismatch between pre and post-operative femurs retrospectively on any case done using the surgical navigation system and could be integrated into the surgical navigation unit to provide real-time feedback. Y1 - 2017 UR - https://link.springer.com/content/pdf/10.1007%2Fs11548-017-1630-5.pdf U6 - https://doi.org/10.1007/s11548-017-1630-5 VL - 12 IS - 12 SP - 2097 EP - 2105 PB - Springer ER - TY - JOUR A1 - Grewe, Carl Martin A1 - Schreiber, Lisa A1 - Zachow, Stefan T1 - Fast and Accurate Digital Morphometry of Facial Expressions JF - Facial Plastic Surgery Y1 - 2015 U6 - https://doi.org/10.1055/s-0035-1564720 VL - 31 IS - 05 SP - 431 EP - 438 PB - Thieme Medical Publishers CY - New York ER - TY - GEN A1 - Grewe, Carl Martin T1 - 3D Digital Morphology of Human Faces T2 - Anthropologie der Wahrnehmung. Marsilius-Sommerakademie Heidelberg, 14.-20. September Y1 - 2015 ER - TY - GEN A1 - Grewe, C. Martin A1 - Zachow, Stefan T1 - Release of the FexMM for the Open Virtual Mirror Framework N2 - THIS MODEL IS FOR NON-COMMERCIAL RESEARCH PURPOSES. ONLY MEMBERS OF UNIVERSITIES OR NON-COMMERCIAL RESEARCH INSTITUTES ARE ELIGIBLE TO APPLY. 1. Download, fill, and sign the form available from: https://media.githubusercontent.com/media/mgrewe/ovmf/main/data/fexmm_license_agreement.pdf 2. Send the signed form to: fexmm@zib.de NOTE: Use an official email address of your institution for the request. Y1 - 2021 U6 - https://doi.org/10.12752/8532 ER - TY - JOUR A1 - Grewe, Carl Martin A1 - Liu, Tuo A1 - Hildebrandt, Andrea A1 - Zachow, Stefan T1 - The Open Virtual Mirror Framework for Enfacement Illusions - Enhancing the Sense of Agency With Avatars That Imitate Facial Expressions JF - Behavior Research Methods Y1 - 2022 U6 - https://doi.org/10.3758/s13428-021-01761-9 PB - Springer ER - TY - THES A1 - Grewe, Martin T1 - An Extended 3D Morphable Face Model with Applications in Experimental Psychology N2 - Our faces and facial expressions are an important means of communication and social interaction. One goal of the behavioral sciences is to better understand how the features of the faces that we look at influence our behavior. These include static features like facial proportions or the shape and color of certain parts of a face which primarily constitute facial identity, as well as dynamic movements resulting from the activation of the mimic musculature. Experimental psychology provides an empirical approach to this endeavor. In experiments, participants are typically exposed to images or videos of realistic faces with specifically controlled features. By analysis of the reactions to such stimuli, conclusions can be drawn about the influence of facial features on the participants’ behavior. Psychologists today mostly generate face stimuli with the help of digital tools. Image editing with Photoshop is highly flexible, but also time-consuming and subjective. Using tools like Psychomorph or Fantamorph is easier and more objective, but does not allow specific control over facial features. In contrast, stimulus generation with 3D Morphable Face Models (3DMMs) offers a better balance between objectivity, ease of use, and flexibility. 3DMMs are statistical models which have been determined from 3D scans of real people’s faces and facial expressions. After these training scans have been brought into correspondence, methods like principal component analysis (PCA) can be used to determine the major modes of variation of facial shape and texture in the data. Such modes typically vary the overall facial proportions, expressions, or skin color. They can be individually controlled and flexibly combined to generate new faces and facial expressions. The plausibility of the generated faces can be ensured by having the mode combinations follow the multivariate distribution of the training data. 3DMMs have been mostly used by psychologists for the generation of stimulus images of faces with neutral expression. Static and dynamic stimuli of facial expressions are also of great interest, but generation with 3DMMs is less common. A problem is that the majority of current 3DMMs can only generate facial movements according to the six prototypic expressions of anger, disgust, fear, happiness, sadness, and surprise. More diverse or subtle expressions are often impossible. Among other reasons, this is due to the difficulty in establishing accurate correspondence in the training data. Further, the modes of most 3DMMs were created by means of PCA. These modes often lack interpretability, fail to generate facial details, and rarely provide psychologists a specific control over identity or expression features. Some 3DMMs also generate subtle artifacts that might lead to undesired effects during face perception. They are also less realistic than faces which were designed by artistic experts for recent computer games and animated movies. Last but not least, current 3DMMs have probably not yet been used for interactive experiments in virtual reality (VR) for technical reasons. Although they provide many advantages also beyond the generation of static or dynamic stimuli, the limitations of current 3DMMs have so far prevented a widespread usage in experimental psychology. The goal of this dissertation is to foster the creation and usage of 3DMMs in this context. To this end, we make three major contributions. First, we describe a matching method that establishes correspondence for 3D face scans with a very high accuracy. Unlike the most commonly used methods, it transforms the facial features into a 2D intermediate representation so that they can be aligned to a reference using image registration. We perform experiments with a large database of 3D scans of faces and facial expressions showing that our method outperforms previous approaches. Second, the 3D scans which were previously brought into correspondence are used for the creation of a 3DMM whose resolution is an order of magnitude higher than that of most existing models. We learn a variety of meaningful modes that, e.g., vary features only in specific regions of the face, or that are related to demographic factors such as ethnicity and age. Further, modes of local facial movements are established that can be flexibly combined into a large variety of expressions. We evaluate the quality of the newly created 3DMM in two experiments. Our results show its advantages over previous models, especially the higher degree of realism of dynamic stimuli of facial expressions which were created with our model. Third, we demonstrate that 3DMMs can not only be used for the generation of stimuli. We develop two experimental methods that are readily applicable in experimental psychology. Initially, we create 3D avatar faces with our 3DMM that are readily applicable in VR. They are used in a new open source framework for virtual mirror experiments on self-face perception. A study is conducted which demonstrates the advantages of the framework over previous methods. Furthermore, our 3DMM is used to create a method for improved control of facial asymmetry in existing stimulus photographs. We show that the method accounts for different dimensions of facial asymmetry and is less sensitive than previous approaches to extrinsic factors like the posture of the head. The different methods are evaluated in a study investigating the influence of facial asymmetry on ratings of attractiveness, femininity, and masculinity. The results indicate the benefits and validity of our method. KW - facial modeling KW - 3D morphable face model KW - facial analysis KW - experimental psychology Y1 - 2023 U6 - https://doi.org/10.14279/depositonce-18589 ER - TY - JOUR A1 - Grewe, Carl Martin A1 - Liu, Tuo A1 - Kahl, Christoph A1 - Andrea, Hildebrandt A1 - Zachow, Stefan T1 - Statistical Learning of Facial Expressions Improves Realism of Animated Avatar Faces JF - Frontiers in Virtual Reality Y1 - 2021 U6 - https://doi.org/10.3389/frvir.2021.619811 VL - 2 SP - 1 EP - 13 PB - Frontiers ER -