A Novel Attention Residual Network Expression Recognition Method
Authors:
Open Access
- 13 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 24609-24620
Abstract
Expressions serve as intuitive reflections of a person’s psychological state, making the extraction of effective features for accurate facial expression recognition a crucial research problem. However, when facial information is incomplete, the existing convolutional neural networks face some challenges in extracting features. To address this issue, this paper introduces a pyramidal convolutional attention residual network(PCARNet) based on the ResNet18. PCARNet combines the pyramidal convolution module and an improved convolutional attention mechanism to effectively extract expression features and achieve high-precision facial expression recognition. The proposed model utilizes pyramidal convolution to extract facial expression features at multiple scales, capturing both global and local information of the face. Grouped convolution is employed to reduce the computational complexity and the number of parameters. Additionally, to avoid the adverse effects of channel dimensionality reduction on the attention mechanism and enhance the capacity for information exchange across channels, the Share MLP module within the convolutional attention mechanismwas replaced by a one-dimensional convolution with adaptive kernel size. The improved convolutional attention mechanism assigns weights to the extracted multiscale features based on both channel and spatial dimensions, enhancing the representation of crucial facial features. Experimental results demonstrate the high recognition accuracy of the proposed method on public datasets such as Fer2013, RAF-DB, and CK+. The accuracies achieved are 73.725%, 87.516%, and 95.455%, respectively. Compared to other methods, the proposed approach shows improvements of at least 1.4%, 2.4%, and 0.25% on the respective datasets, confirming its high reliability and performance.Keywords
Funding Information
- Shanxi Patent Transformation Special Programs (202302009, 202302012)
- Basic Research Program (Free Exploration) of Shanxi Province (20210302123334)
- Taiyuan Normal University Achievement Transformation and Technology Transfer Base (2023P003)
This publication has 25 references indexed in Scilit:
- A novel approach for facial expression recognition based on Gabor filters and genetic algorithmEvolving Systems, 2021
- Attention mechanism-based CNN for facial expression recognitionNeurocomputing, 2020
- Multiple Attention Network for Facial Expression RecognitionIEEE Access, 2020
- Improved softmax loss for deep learning‐based face and expression recognitionCognitive Computation and Systems, 2019
- Extended deep neural network for facial emotion recognitionPattern Recognition Letters, 2019
- Fast facial expression recognition using local binary features and shallow neural networksThe Visual Computer, 2018
- Robust Facial Expression Recognition Based on Local Tri-directional Coding Pattern2018
- Emotion recognition from geometric facial features using self-organizing mapPattern Recognition, 2014
- Challenges in Representation Learning: A Report on Three Machine Learning Contests2013
- Principal component analysisChemometrics and Intelligent Laboratory Systems, 1987