Towards Highly Accurate and Stable Face Alignment for High-Resolution Videos
Preprint
Abstract
In recent years, heatmap regression based models have shown their effectiveness in face alignment and pose estimation. However, Conventional Heatmap Regression (CHR) is not accurate nor stable when dealing with high-resolution facial videos, since it finds the maximum activated location in heatmaps which are generated from rounding coordinates, and thus leads to quantization errors when scaling back to the original high-resolution space. In this paper, we propose a Fractional Heatmap Regression (FHR) for high-resolution video-based face alignment. The proposed FHR can accurately estimate the fractional part according to the 2D Gaussian function by sampling three points in heatmaps. To further stabilize the landmarks among continuous video frames while maintaining the precise at the same time, we propose a novel stabilization loss that contains two terms to address time delay and non-smooth issues, respectively. Experiments on 300W, 300-VW and Talking Face datasets clearly demonstrate that the proposed method is more accurate and stable than the state-of-the-art models.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Adversarial Learning of Structure-Aware Fully Convolutional Networks for Landmark LocalizationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2019
- Two-Stream Transformer Networks for Video-Based Face AlignmentIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Learning Deep Representation for Face Alignment with Auxiliary AttributesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Displaced dynamic expression regression for real-time facial tracking and animationACM Transactions on Graphics, 2014
- Video-based face model fitting using Adaptive Active Appearance ModelImage and Vision Computing, 2010
- Convergence Properties of the Nelder--Mead Simplex Method in Low DimensionsSIAM Journal on Optimization, 1998