1. {3D} Morphable Face Models -- Past, Present and Future
- Author
-
Sami Romdhani, Michael Zollhoefer, William A. P. Smith, Volker Blanz, Adam Kortylewski, Thabo Beeler, Thomas Vetter, Florian Bernard, Christian Theobalt, Bernhard Egger, Ayush Tewari, Timo Bolkart, Stefanie Wuhrer, Massachusetts Institute of Technology (MIT), University of York [York, UK], Max Planck Institute for Informatics [Saarbrücken], Capture and Analysis of Shapes in Motion (MORPHEO), Inria Grenoble - Rhône-Alpes, Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Jean Kuntzmann (LJK), Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA)-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes (UGA)-Institut polytechnique de Grenoble - Grenoble Institute of Technology (Grenoble INP ), Université Grenoble Alpes (UGA), Stanford University, Disney Research, Johns Hopkins University (JHU), Idemia, Universität Siegen [Siegen], University of Basel (Unibas), This survey paper was initiated at the Dagstuhl Seminar 19102 on 3D Morphable Models [Egger et al. 2019] and contains ideas resulting from discussions at this seminar. This survey paper was partially funded by Early PostDoc Mobility Grant, Swiss National Science Foundation P2BSP2_178643, ERC Consolidator Grant 4DRepLy and the Max Planck Center for Visual Computing and Communications (MPC-VCC). We thank Barış Geçer for his help on the teaser figure, and Haiwen Feng for providing the FLAME texture space. We thank the anonymous reviewers whose comments have greatly improved this manuscript., Capture and Analysis of Shapes in Motion [2016-2019] (MORPHEO [2016-2019]), Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire Jean Kuntzmann [2016-2019] (LJK [2016-2019]), Institut polytechnique de Grenoble - Grenoble Institute of Technology [2007-2019] (Grenoble INP [2007-2019])-Institut National de Recherche en Informatique et en Automatique (Inria)-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019])-Institut polytechnique de Grenoble - Grenoble Institute of Technology [2007-2019] (Grenoble INP [2007-2019])-Centre National de la Recherche Scientifique (CNRS)-Université Grenoble Alpes [2016-2019] (UGA [2016-2019]), Stanford University [Stanford], and University of Siegen
- Subjects
FOS: Computer and information sciences ,Image formation ,Computer Science - Machine Learning ,Computer science ,Computer Vision and Pattern Recognition (cs.CV) ,Analysis-by-Synthesis ,Computer Science - Computer Vision and Pattern Recognition ,02 engineering and technology ,Statistical Modelling ,Machine Learning (cs.LG) ,Computer graphics ,Computer Science - Graphics ,0202 electrical engineering, electronic engineering, information engineering ,Computer Graphics ,Generative Models ,Graphics ,[INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV] ,020207 software engineering ,Computer Graphics and Computer-Aided Design ,Data science ,Graphics (cs.GR) ,[INFO.INFO-GR]Computer Science [cs]/Graphics [cs.GR] ,3D Computer Vision ,13. Climate action ,Face (geometry) ,020201 artificial intelligence & image processing - Abstract
In this paper, we provide a detailed survey of 3D Morphable Face Models over the 20 years since they were first proposed. The challenges in building and applying these models, namely capture, modeling, image formation, and image analysis, are still active research topics, and we review the state-of-the-art in each of these areas. We also look ahead, identifying unsolved challenges, proposing directions for future research and highlighting the broad range of current and future applications., ACM Transactions on Graphics (TOG)
- Full Text
- View/download PDF