Facial Expression Recognition with Enhanced Relation-Aware Attention and Cross-Feature Fusion transformer
Preprint
- 13 February 2024
- preprint
- Published by Springer Nature in Research Square
Abstract
Face expression recognition(FER) is an important research branch in the field of the computer vision neighborhood. Three prevalent problems in FER tasks that severely impact recognition rates are inter-class similarity, intra-class differences, and facial occlusion issues. Although there have been studies that address some of these issues, none of them can adequately address all three issues in a unified framework. In this paper, we propose a novel dual-branch structure of enhanced relation-aware attention and cross-feature fusion transformer network to comprehensively solve all three issues. Specifically, we design the Enhanced Relation-Aware Attention module to maximize the exploration of more local expression features. At the same time, the Transformer Perceptual Encoder module is adopted to establishing the contextual relationship between individual patches under global information. This greatly alleviates the inter-class similarity problem and the facial occlusion and facial pose transformation problems. On the basis of a dual branch structure, we extract facial image features using facial landmarks features to guide them and design Cross-Feature Fusion Transformer module to deeply cross-fuse two different semantic features. Experiments are performed and results show that our method can greatly alleviated intra-class difference problem with comparison of several traditional methods on three commonly used datasets.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Facial expression recognition based on multi-channel fusion and lightweight neural networkSoft Computing, 2023
- Inceptr: micro-expression recognition integrating inception-CBAM and vision transformerMultimedia Systems, 2023
- Facial expression recognition through multi-level features extraction and fusionSoft Computing, 2023
- Feature Aggregation and Refinement Network for 2D Anatomical Landmark DetectionJournal of Digital Imaging, 2022
- Deep Recurrent Regression with a Heatmap Coupling Module for Facial Landmarks DetectionCognitive Computation, 2022
- Responsive human-computer interaction model based on recognition of facial landmarks using machine learning algorithmsMultimedia Tools and Applications, 2022
- A convolution-transformer dual branch network for head-pose and occlusion facial expression recognitionThe Visual Computer, 2022
- A robust occlusion-adaptive attention-based deep network for facial landmark detectionApplied Intelligence, 2022
- Intelligent system for depression scale estimation with facial expressions and case study in industrial intelligenceInternational Journal of Intelligent Systems, 2021
- A high-discriminative facial recognition method based on shape and grey-level appearances using landmark-pointsThe Visual Computer, 2020