A SFM-based sparse to dense 3D face reconstruction method robust to feature tracking errors
Authors:
- 1 September 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15224880,p. 3617-3621
Abstract
In this paper, we present a new sparse to dense 3D face reconstruction method using monocular video sequences. Structure from motion (SFM) is an effective method to reconstruct sparse 3D facial shape; however, its performance degrades drastically when tracking errors caused by self-occlusion or image noise exist. To address the problem, we propose a reliable point selection method to automatically evaluate the reliability of corresponding points obtained by optical flow. The gray level cooccurrence matrix (GLCM) is applied to the texture-based correlation evaluation and those points whose correlation coefficients are lower than a threshold will be removed. Benefiting from the SFM's capacity of dealing with missing data, our method is more robust to tracking point correspondence errors and accordingly achieves a lower 3D reconstruction error compared with traditional SFM methods without correlation checking.Keywords
This publication has 7 references indexed in Scilit:
- A SfM-based 3D face reconstruction method robust to self-occlusion by using a shape conversion matrixPattern Recognition, 2011
- Computing Smooth Time Trajectories for Camera and Deformable Shape in Structure from Motion with OcclusionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- A 3D Face Model for Pose and Illumination Invariant Face Recognition2009
- A statistical method for robust 3D surface reconstruction from sparse data2004
- Face recognition based on fitting a 3D morphable modelIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- A morphable model for the synthesis of 3D faces1999
- Textural Features for Image ClassificationIEEE Transactions on Systems, Man, and Cybernetics, 1973