AffectiveNet: Affective-Motion Feature Learning for Microexpression Recognition
- 10 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE MultiMedia
- Vol. 28 (1) , 17-27
Abstract
Micro-expressions are hard to spot due to fleeting and involuntary moments of facial muscles. Interpretation of micro emotions from video clips is a challenging task. In this paper, we propose affective-motion imaging that cumulates rapid and short-lived variational information of micro-expressions into a single response. Moreover, we have proposed an AffectiveNet: affective-motion feature learning network that can perceive subtle changes and learns the most discriminative dynamic features to describe the emotion classes. The AffectiveNet holds two blocks: MICRoFeat and MFL block. MICRoFeat block conserves the scale-invariant features, which allows the network to capture both coarse and tiny edge variations. While MFL block learns micro-level dynamic variations from two different intermediate convolutional layers. Effectiveness of the proposed network is tested over four datasets by using two experimental setups: person independent (PI) and cross dataset (CD) validation. The experimental results of the proposed network outperform the state-of-the-art approaches with a significant margin for MER approaches.Keywords
All Related Versions
Funding Information
- Anusandhan National Research Foundation (SERB/F/9507/2017)
This publication has 16 references indexed in Scilit:
- Fuzzy Histogram of Optical Flow Orientations for Micro-Expression RecognitionIEEE Transactions on Affective Computing, 2017
- Microexpression Identification and Categorization Using a Facial Dynamics MapIEEE Transactions on Affective Computing, 2017
- A main directional maximal difference analysis for spotting facial movements from long-term videosNeurocomputing, 2017
- CAS(ME): A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and RecognitionIEEE Transactions on Affective Computing, 2017
- Sparse tensor canonical correlation analysis for micro-expression recognitionNeurocomputing, 2016
- SAMM: A Spontaneous Micro-Facial Movement DatasetIEEE Transactions on Affective Computing, 2016
- Deep Residual Learning for Image Recognition2016
- Dynamic Image Networks for Action Recognition2016
- LBP with Six Intersection Points: Reducing Redundant Information in LBP-TOP for Micro-expression Recognition2015
- CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline EvaluationPLOS ONE, 2014