Full-range Head Pose Geometric Data Augmentations
Preprint
Abstract
Many head pose estimation (HPE) methods promise the ability to create full-range datasets, theoretically allowing the estimation of the rotation and positioning of the head from various angles. However, these methods are only accurate within a range of head angles; exceeding this specific range led to significant inaccuracies. This is dominantly explained by unclear specificity of the coordinate systems and Euler Angles used in the foundational rotation matrix calculations. Here, we addressed these limitations by presenting (1) methods that accurately infer the correct coordinate system and Euler angles in the correct axis-sequence, (2) novel formulae for 2D geometric augmentations of the rotation matrices under the (SPECIFIC) coordinate system, (3) derivations for the correct drawing routines for rotation matrices and poses, and (4) mathematical experimentation and verification that allow proper pitch-yaw coverage for full-range head pose dataset generation. Performing our augmentation techniques to existing head pose estimation methods demonstrated a significant improvement to the model performance. Code will be released upon paper acceptance.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Toward Robust and Unconstrained Full Range of Rotation Head Pose EstimationIEEE Transactions on Image Processing, 2024
- Deep Learning for Head Pose Estimation: A SurveySN Computer Science, 2023
- RepVGG: Making VGG-style ConvNets Great Again2021
- A Vector-based Representation to Enhance Head Pose Estimation2021
- Panoptic Studio: A Massively Multiview System for Social Interaction CaptureIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Face Alignment in Full Pose Range: A 3D Total SolutionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Face Alignment Across Large Poses: A 3D Solution2016
- Random Forests for Real Time 3D Face AnalysisInternational Journal of Computer Vision, 2012
- Head Pose Estimation in Computer Vision: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Face recognition based on fitting a 3D morphable modelIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003