FACS-Based Graph Features for Real-Time Micro-Expression Recognition
Open Access
- 30 November 2020
- journal article
- research article
- Published by MDPI AG in Journal of Imaging
- Vol. 6 (12) , 130
Abstract
Several studies on micro-expression recognition have contributed mainly to accuracy improvement. However, the computational complexity receives lesser attention comparatively and therefore increases the cost of micro-expression recognition for real-time application. In addition, majority of the existing approaches required at least two frames (i.e., onset and apex frames) to compute features of every sample. This paper puts forward new facial graph features based on 68-point landmarks using Facial Action Coding System (FACS). The proposed feature extraction technique (FACS-based graph features) utilizes facial landmark points to compute graph for different Action Units (AUs), where the measured distance and gradient of every segment within an AU graph is presented as feature. Moreover, the proposed technique processes ME recognition based on single input frame sample. Results indicate that the proposed FACS-baed graph features achieve up to 87.33% of recognition accuracy with F1-score of 0.87 using leave one subject out cross-validation on SAMM datasets. Besides, the proposed technique computes features at the speed of 2 ms per sample on Xeon Processor E5-2650 machine.Keywords
This publication has 34 references indexed in Scilit:
- Microexpression Identification and Categorization Using a Facial Dynamics MapIEEE Transactions on Affective Computing, 2017
- Integrating Geometric and Textural Features for Facial Emotion Classification Using SVM Frameworks2016
- SAMM: A Spontaneous Micro-Facial Movement DatasetIEEE Transactions on Affective Computing, 2016
- Spontaneous facial micro-expression analysis using Spatiotemporal Completed Local Quantized PatternsNeurocomputing, 2016
- Micro-Facial Movement Detection Using Individualised Baselines and Histogram-Based Descriptors2015
- Feature Representation for Facial Expression Recognition Based on FACS and LBPInternational Journal of Automation and Computing, 2014
- CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline EvaluationPLOS ONE, 2014
- A Spontaneous Micro-expression Database: Inducement, collection and baseline2013
- Comparison of 2D and 3D Local Binary Pattern in Lung Cancer DiagnosisInternational Journal of Advanced Computer Science and Applications, 2012
- Police lie detection accuracy: The effect of lie scenario.Law and Human Behavior, 2009