A Coarse-to-Fine Approach for 3D Facial Landmarking by Using Deep Feature Fusion
Open Access
Abstract
Facial landmarking locates the key facial feature points on facial data, which provides not only information on semantic facial structures, but also prior knowledge for other kinds of facial analysis. However, most of the existing works still focus on the 2D facial image which may suffer from lighting condition variations. In order to address this limitation, this paper presents a coarse-to-fine approach to accurately and automatically locate the facial landmarks by using deep feature fusion on 3D facial geometry data. Specifically, the 3D data is converted to 2D attribute maps firstly. Then, the global estimation network is trained to predict facial landmarks roughly by feeding the fused CNN (Convolutional Neural Network) features extracted from facial attribute maps. After that, input the local fused CNN features extracted from the local patch around each landmark estimated previously, and other local models are trained separately to refine the locations. Tested on the Bosphorus and BU-3DFE datasets, the experimental results demonstrated effectiveness and accuracy of the proposed method for locating facial landmarks. Compared with existed methods, our results have achieved state-of-the-art performance.Keywords
This publication has 41 references indexed in Scilit:
- 3-D Facial Landmark Localization With Asymmetry Patterns and Shape Regression from Incomplete Local FeaturesIEEE Transactions on Cybernetics, 2014
- Random Cascaded-Regression Copse for Robust Facial Landmark DetectionIEEE Signal Processing Letters, 2014
- Deep Convolutional Network Cascade for Facial Point Detection2013
- A Machine-Learning Approach to Keypoint Detection and Landmarking on 3D MeshesInternational Journal of Computer Vision, 2013
- Regression-based intensity estimation of facial action unitsImage and Vision Computing, 2012
- Combining local features for robust nose location in 3D facial dataPattern Recognition Letters, 2006
- 3D face detection using curvature analysisPattern Recognition, 2006
- Facial feature detection and face recognition from 2D and 3D imagesPattern Recognition Letters, 2002
- Active appearance modelsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Active Shape Models-Their Training and ApplicationComputer Vision and Image Understanding, 1995