Privileged Attribution Constrained Deep Networks for Facial Expression Recognition
Preprint
Abstract
Facial Expression Recognition (FER) is crucial in many research domains because it enables machines to better understand human behaviours. FER methods face the problems of relatively small datasets and noisy data that don't allow classical networks to generalize well. To alleviate these issues, we guide the model to concentrate on specific facial areas like the eyes, the mouth or the eyebrows, which we argue are decisive to recognise facial expressions. We propose the Privileged Attribution Loss (PAL), a method that directs the attention of the model towards the most salient facial regions by encouraging its attribution maps to correspond to a heatmap formed by facial landmarks. Furthermore, we introduce several channel strategies that allow the model to have more degrees of freedom. The proposed method is independent of the backbone architecture and doesn't need additional semantic information at test time. Finally, experimental results show that the proposed PAL method outperforms current state-of-the-art methods on both RAF-DB and AffectNet.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Leveraging recent advances in deep learning for audio-Visual emotion recognitionPattern Recognition Letters, 2021
- Improving performance of deep learning models with axiomatic attribution priors and expected gradientsNature Machine Intelligence, 2021
- JÂA-Net: Joint Facial Action Unit Detection and Face Alignment Via Adaptive AttentionInternational Journal of Computer Vision, 2020
- Pyramid With Super Resolution for In-the-Wild Facial Expression RecognitionIEEE Access, 2020
- Tree-Gated Deep Mixture-of-Experts for Pose-Robust Face AlignmentIEEE Transactions on Biometrics, Behavior, and Identity Science, 2019
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based LocalizationInternational Journal of Computer Vision, 2019
- AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the WildIEEE Transactions on Affective Computing, 2017
- Confidence-Weighted Local Expression Predictions for Occlusion Handling in Expression Recognition and Action Unit DetectionInternational Journal of Computer Vision, 2017