3D Face Hallucination from a Single Depth Frame
- 1 December 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1 (15506185) , 31-38
Abstract
We present an algorithm that takes a single frame of a person's face from a depth camera, e.g., Kinect, and produces a high-resolution 3D mesh of the input face. We leverage a dataset of 3D face meshes of 1204 distinct individuals ranging from age 3 to 40, captured in a neutral expression. We divide the input depth frame into semantically significant regions (eyes, nose, mouth, cheeks) and search the database for the best matching shape per region. We further combine the input depth frame with the matched database shapes into a single mesh that results in a high resolution shape of the input person. Our system is fully automatic and uses only depth data for matching, making it invariant to imaging conditions. We evaluate our results using ground truth shapes, as well as compare to state-of the-art shape estimation methods. We demonstrate the robustness of our local matching approach with high-quality reconstruction of faces that fall outside of the dataset span, e.g., Faces older than 40 years old, facial expressions, and different ethnicities.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Face Alignment by Explicit Shape RegressionInternational Journal of Computer Vision, 2013
- Online modeling for realtime facial animationACM Transactions on Graphics, 2013
- Random Forests for Real Time 3D Face AnalysisInternational Journal of Computer Vision, 2012
- Multiview face capture using polarized spherical gradient illuminationACM Transactions on Graphics, 2011
- Realtime performance-based facial animationACM Transactions on Graphics, 2011
- High resolution passive facial performance captureACM Transactions on Graphics, 2010
- Spacetime Faces: High-Resolution Capture for~Modeling and Animation2007
- Scene completion using millions of photographs2007
- Implicit fairing of irregular meshes using diffusion and curvature flow1999
- Generalized Procrustes AnalysisPsychometrika, 1975