Micro-Expression Recognition with Expression-State Constrained Spatio-Temporal Feature Representations
Authors:
Open Access
- 1 October 2016
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 382-386
Abstract
Recognizing spontaneous micro-expression in video sequences is a challenging problem. In this paper, we propose a new method of small scale spatio-temporal feature learning. The proposed learning method consists of two parts. First, the spatial features of micro-expressions at different expression-states (i.e., onset, onset to apex transition, apex, apex to offset transition and offset) are encoded using convolutional neural networks (CNN). The expression-states are taken into account in the objective functions, to improve the expression class separability of the learned feature representation. Next, the learned spatial features with expression-state constraints are transferred to learn temporal features of micro-expression. The temporal feature learning encodes the temporal characteristics of the different states of the micro-expression using long short-term memory (LSTM) recurrent neural networks. Extensive and comprehensive experiments have been conducted on the publically available CASME II micro-expression dataset. The experimental results showed that the proposed method outperformed state-of-the-art micro-expression recognition methods in terms of recognition accuracy.Keywords
Funding Information
- National Research Foundation of Korea (2015R1A2A2A01005724)
This publication has 15 references indexed in Scilit:
- Spontaneous facial micro-expression analysis using Spatiotemporal Completed Local Quantized PatternsNeurocomputing, 2016
- Facial Micro-Expression Recognition Using Spatiotemporal Local Binary Pattern with Integral Projection2015
- Are subtle expressions too sparse to recognize?2015
- Efficient Spatio-Temporal Local Binary Patterns for Spontaneous Facial Micro-Expression RecognitionPLOS ONE, 2015
- LBP with Six Intersection Points: Reducing Redundant Information in LBP-TOP for Micro-expression Recognition2015
- CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline EvaluationPLOS ONE, 2014
- Feature Design for Offline Arabic Handwriting Recognition: Handcrafted vs Automated?2013
- How Fast are the Leaked Facial Expressions: The Duration of Micro-ExpressionsJournal of Nonverbal Behavior, 2013
- Face recognition by independent component analysisIEEE Transactions on Neural Networks, 2002
- 10.1162/153244303768966139Applied Physics Letters, 2000