3D Morphable Face Model for Face Animation
Authors:
- 24 January 2020
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Image and Graphics
- Vol. 20 (01)
Abstract
This paper employs a new technology for modeling textured 3D faces. 3D faces can either be generated automatically from one or more photographs, or modeled directly through an intuitive user interface. Users are assisted in two key problems of computer-aided face modeling. It presents two algorithms for 3D face modeling from an image sequence. The first method works by creating an initial estimate using multiframe structure from motion (SfM) reconstruction framework, which is refined by comparing against a generic face model. The comparison is carried out using an energy-function optimization strategy. Results of 3D reconstruction algorithm are presented. The second method presented reconstructs a face model by adapting a generic model to contours of a face over all the frames of an image sequence. The algorithm for pose estimation and 3D face reconstruction relies solely on contours and the system does not require knowledge of rendering parameters (e.g. light direction and intensity). Results relying on finding accurate point correspondences across frames is presented.Keywords
This publication has 20 references indexed in Scilit:
- Automatic landmark detection and 3D Face data extractionJournal of Computational Science, 2017
- Adaptive 3D Face Reconstruction from Unconstrained Photo Collections2016
- Three-dimensional (3D) facial recognition and predictionSignal, Image and Video Processing, 2016
- A Multiresolution 3D Morphable Face Model and Fitting Framework2016
- Pose-Invariant 3D Face Alignment2015
- Unconstrained 3D face reconstruction2015
- Robust 3D Morphable Model Fitting by Sparse SIFT Flow2014
- Online Dense Non-Rigid 3D Shape and Camera Motion Recovery2014
- Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling ApproachInternational Journal of Computer Vision, 2004
- Efficient, robust and accurate fitting of a 3D morphable model2003