Robust 3D Morphable Model Fitting by Sparse SIFT Flow
Authors:
- Xiangyu ZhuXZXiangyu Zhu
- Dong YiDYDong Yi
- Zhen LeiZLZhen Lei
- Stan Z. LiSLStan Z. Li
- 1 August 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10514651,p. 4044-4049
Abstract
3D Morph able Model (3DMM) has been widely used in face analysis for many years. The most challenging part of 3DMM is to find the correspondences between 3D points and 2D pixels. Existing methods only use key points, edges, specular highlights and image pixels to complete the task, which are not accurate or robust. This paper proposes a new algorithm called Sparse SIFT Flow (SSF) to improve the reconstruction accuracy. We mark a set of salient points to control the shape of facial components and use SSF to find their corresponding pixels on the input image. We also incorporate SSF into Multi-Features Framework to construct a robust 3DMM fitting algorithm. Compared with the state-of-the art, our approach significantly improves the fitting results in facial component area.Keywords
This publication has 12 references indexed in Scilit:
- SIFT Flow: Dense Correspondence across Scenes and Its ApplicationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2010
- A Linear Approach to Face Shape and Texture Recovery using a 3D Morphable Model2010
- A 3D Face Model for Pose and Illumination Invariant Face Recognition2009
- A 3-D assisted generative model for facial texture super-resolution2009
- Image-driven re-targeting and relighting of facial expressions2005
- Face recognition based on fitting a 3D morphable modelIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- Face identification across different poses and illuminations with a 3D morphable model2003
- Efficient, robust and accurate fitting of a 3D morphable model2003
- Optimum Fiducials Under Weak Perspective ProjectionInternational Journal of Computer Vision, 1999
- A morphable model for the synthesis of 3D faces1999