3D Facial Landmark Detection under Large Yaw and Expression Variations
- 26 November 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 35 (7) , 1552-1564
Abstract
A 3D landmark detection method for 3D facial scans is presented and thoroughly evaluated. The main contribution of the presented method is the automatic and pose-invariant detection of landmarks on 3D facial scans under large yaw variations (that often result in missing facial data), and its robustness against large facial expressions. Three-dimensional information is exploited by using 3D local shape descriptors to extract candidate landmark points. The shape descriptors include the shape index, a continuous map of principal curvature values of a 3D object's surface, and spin images, local descriptors of the object's 3D point distribution. The candidate landmarks are identified and labeled by matching them with a Facial Landmark Model (FLM) of facial anatomical landmarks. The presented method is extensively evaluated against a variety of 3D facial databases and achieves state-of-the-art accuracy (4.5-6.3 mm mean landmark localization error), considerably outperforming previous methods, even when tested with the most challenging data.Keywords
This publication has 21 references indexed in Scilit:
- A Novel Genetic Algorithm for 3D Facial Landmark Localization2008
- Automatic 3D facial segmentation and landmark detection2007
- Automatic Facial Pose Determination of 3D Range Data for Face Model and Expression Identification2007
- Combining local features for robust nose location in 3D facial dataPattern Recognition Letters, 2006
- 3D face authentication by mutual coupled 3D and 2D feature extraction2006
- Modeling Facial Shape and Appearance2005
- Overview of the Face Recognition Grand Challenge2005
- COSMOS-A representation scheme for 3D free-form objectsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Surface shape and curvature scalesImage and Vision Computing, 1992
- A Combined Corner and Edge Detector1988