Accurate Facial Image Parsing at Real-Time Speed
- 1 September 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 28 (9) , 4659-4670
Abstract
In this paper, we propose a design scheme for deep learning networks in the face parsing task with promising accuracy and real-time inference speed. By analyzing the differences between the general image parsing task and face parsing task, we first revisit the structure of traditional FCN and make improvements to adapt to the unique properties of the face parsing task. Especially, the concept of Normalized Receptive Field is proposed to give more insights on designing the network. Then, a novel loss function called Statistical Contextual Loss is introduced, which integrates richer contextual information and regularizes features during training. For further model acceleration, we propose a semi-supervised distillation scheme that effectively transfers the learned knowledge to a lighter network. Extensive experiments on LFW and Helen dataset demonstrate the significant superiority of the new design scheme on both efficacy and efficiency.Keywords
Funding Information
- National Natural Science Foundation of China (U1536203)
- National Natural Science Foundation of China (61572493)
- National Natural Science Foundation of China (61876177)
- National Key Research and Development Program of China (2016QY01W0200)
- Major Scientific and Technological Project of Hubei Province (2018AAA068)
This publication has 26 references indexed in Scilit:
- Real-Time Facial Segmentation and Performance Capture from RGB Input2016
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification2015
- Conditional Random Fields as Recurrent Neural Networks2015
- Interlinked Convolutional Neural Networks for Face Parsing2015
- Augmenting CRFs with Boltzmann Machine Shape Priors for Image Labeling2013
- Exemplar-Based Face Parsing2013
- Interactive Facial Feature Localization2012
- An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Face Description with Local Binary Patterns: Application to Face RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- "GrabCut"ACM Transactions on Graphics, 2004