Feature Selection on 2D and 3D Geometric Features to Improve Facial Expression Recognition
Open Access
Abstract
An essential aspect in the interaction between people and computers is the recognition of facial expressions. A key issue in this process is to select relevant features to classify facial expressions accurately. This study examines the selection of optimal geometric features to classify six basic facial expressions: happiness, sadness, surprise, fear, anger, and disgust. Inspired by the Facial Action Coding System (FACS) and the Moving Picture Experts Group 4th standard (MPEG-4), an initial set of 89 features was proposed. These features are normalized distances and angles in 2D and 3D computed from 22 facial landmarks. To select a minimum set of features with the maximum classification accuracy, two selection methods and four classifiers were tested. The first selection method, principal component analysis (PCA), obtained 39 features. The second selection method, a genetic algorithm (GA), obtained 47 features. The experiments ran on the Bosphorus and UIVBFED data sets with 86.62% and 93.92% median accuracy, respectively. Our main finding is that the reduced feature set obtained by the GA is the smallest in comparison with other methods of comparable accuracy. This has implications in reducing the time of recognition.Keywords
This publication has 31 references indexed in Scilit:
- Impact of the face registration techniques on facial expressions recognitionSignal Processing: Image Communication, 2018
- Multimodal 2D+3D Facial Expression Recognition With Deep Fusion Convolutional Neural NetworkIEEE Transactions on Multimedia, 2017
- Feature Selection Based on Structured Sparsity: A Comprehensive StudyIEEE Transactions on Neural Networks and Learning Systems, 2016
- Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related ApplicationsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- A Survey on Evolutionary Computation Approaches to Feature SelectionIEEE Transactions on Evolutionary Computation, 2015
- Adaptive 3D facial action intensity estimation and emotion recognitionExpert Systems with Applications, 2015
- A Study of Techniques for Facial Detection and Expression ClassificationInternational Journal of Computer Science & Engineering Survey, 2014
- Compound facial expressions of emotionProceedings of the National Academy of Sciences, 2014
- Regression-based intensity estimation of facial action unitsImage and Vision Computing, 2012
- Face and 2-D mesh animation in MPEG-4Signal Processing: Image Communication, 2000