3-D Face Alignment Using A Convolutional Point-Set Representation
- 1 October 2019
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biometrics, Behavior, and Identity Science
- Vol. 1 (4) , 264-277
Abstract
We present a robust method for estimating the facial pose and shape parameters with a Projected Normalized Coordinate Code (PNCC), a derived image where each pixel is annotated with its corresponding vertex position in a generic 3D model. The method relies on a Convolutional Point-set Representation (CPR), a carefully designed feature map that extracts useful information encoded in pairs or triplets of vertices of PNCC. To estimate the shape and pose parameters, different CPRs are designed to represent mutually independent pose and shape parameters. The CPRs are then fed into multiple convolutional networks (with recurrent layers) in a sequential manner based on the transformation order of weak-perspective projection model to predict the target parameters. Reprojection errors are sampled along a predicted direction and the parameters are updated based on the pattern of reprojection errors. This technique boosts the model’s capability to find a local minimum under challenging scenarios. It is also demonstrated that CPRs obtained from different sources can be merged and contribute to outperforming the current state-of-the-art solutions for 3D face alignment. Experiments indicate that the proposed CPRFA (CPR-based Face Alignment) significantly improves 3D alignment accuracy. Compared to 3DDFA, the proposed method reduces the normalized mean error on AFLW2000 and AFLW database by 25.3 20.2% respectively.Keywords
Funding Information
- U.S. Department of Homeland Security (2017-ST-BTI-0001-0201)
- University of Houston
This publication has 31 references indexed in Scilit:
- 3D-2D face recognition with pose and illumination normalizationComputer Vision and Image Understanding, 2017
- Large-Pose Face Alignment via CNN-Based Dense 3D Model Fitting2016
- A Key Volume Mining Deep Framework for Action Recognition2016
- Benchmarking 3D Pose Estimation for Face Recognition2014
- 300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge2013
- FaceWarehouse: A 3D Facial Expression Database for Visual ComputingIEEE Transactions on Visualization and Computer Graphics, 2013
- Online modeling for realtime facial animationACM Transactions on Graphics, 2013
- Annotated Facial Landmarks in the Wild: A large-scale, real-world database for facial landmark localization2011
- A morphable model for the synthesis of 3D faces1999
- Principal warps: thin-plate splines and the decomposition of deformationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1989