Nose, Eyes and Ears: Head Pose Estimation by Locating Facial Keypoints
Authors:
- 1 May 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1977-1981
Abstract
Monocular head pose estimation requires learning a model that computes the intrinsic Euler angles for pose (yaw, pitch, roll) from an input image of human face. Annotating ground truth head pose angles for images in the wild is difficult and requires ad-hoc fitting procedures (which provides only coarse and approximate annotations). This highlights the need for approaches which can train on data captured in controlled environment and generalize on the images in the wild (with varying appearance and illumination of the face). Most present day deep learning approaches which learn a regression function directly on the input images fail to do so. To this end, we propose to use a higher level representation to regress the head pose while using deep learning architectures. More specifically, we use the uncertainty maps in the form of 2D soft localization heatmap images over five facial key-points, namely left ear, right ear, left eye, right eye and nose, and pass them through an convolutional neural network to regress the head-pose. We show head pose estimation results on two challenging benchmarks BIWI and AFLW and our approach surpasses the state of the art on both the datasets.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- 3D head pose estimation with convolutional neural network trained on synthetic images2016
- Sparseness Meets Deepness: 3D Human Pose Estimation from Monocular Video2016
- Head pose estimation in the wild using approximate view manifolds2015
- Face Alignment Assisted by Head Pose Estimation2015
- Real Time Head Pose Estimation from Consumer Depth Cameras2011
- Learning a Person-Independent Representation for Precise 3D Pose Estimation2008
- A two-stage head pose estimation framework and evaluationPattern Recognition, 2008
- EM enhancement of 3D head pose estimated by point at infinityImage and Vision Computing, 2007
- Face pose discrimination using support vector machines (SVM)2002
- Perception of head orientationVision Research, 2000