CNN-Based Facial Expression Recognition with Simultaneous Consideration of Inter-Class and Intra-Class Variations
Open Access
Abstract
Facial expression recognition is crucial for understanding human emotions and nonverbal communication. With the growing prevalence of facial recognition technology and its various applications, accurate and efficient facial expression recognition has become a significant research area. However, most previous methods have focused on designing unique deep-learning architectures while overlooking the loss function. This study presents a new loss function that allows simultaneous consideration of inter- and intra-class variations to be applied to CNN architecture for facial expression recognition. More concretely, this loss function reduces the intra-class variations by minimizing the distances between the deep features and their corresponding class centers. It also increases the inter-class variations by maximizing the distances between deep features and their non-corresponding class centers, and the distances between different class centers. Numerical results from several benchmark facial expression databases, such as Cohn-Kanade Plus, Oulu-Casia, MMI, and FER2013, are provided to prove the capability of the proposed loss function compared with existing ones.Keywords
All Related Versions
Funding Information
- Korea Institute for Advancement of Technology (P0017011, 20012624, RS-2023-00232192)
- Korea Evaluation Institute of Industrial Technology (P0017011, 20012624, RS-2023-00232192)
- Korea Evaluation Institute of Industrial Technology (P0017011, 20012624, RS-2023-00232192)
This publication has 43 references indexed in Scilit:
- FaceNet: A unified embedding for face recognition and clustering2015
- Going deeper with convolutions2015
- Facial expression recognition based on geometric and optical flow features in colour image sequencesIET Computer Vision, 2012
- Facial expression recognition from near-infrared videosImage and Vision Computing, 2011
- An introduction to ROC analysisPattern Recognition Letters, 2006
- Rapid object detection using a boosted cascade of simple features2005
- Histograms of Oriented Gradients for Human Detection2005
- Confusion Matrix Visualization2004
- Bayesian face recognitionPattern Recognition, 2000
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951