Partial Matching of Facial Expression Sequence Using Over-Complete Transition Dictionary for Emotion Recognition
Authors:
- 30 October 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 7 (4) , 389-408
Abstract
Facial dynamics contain useful information for facial expression recognition (FER). However, exploiting dynamics in FER is challenging. This is mainly due to a variety of expression transitions. For example, video sequences belonging to a same emotion class may have different characteristics in transition duration and/or transition type (e.g., onset versus offset). The temporal mismatches between query and training video sequences could degrade the FER. This paper proposes a new partial matching framework that aims to overcome the temporal mismatch of expression transition. During the training stage, we construct an over-complete transition dictionary where many possible partial expression transitions are contained. During the test stage, we extract a number of partial expression transitions from a query video sequence. Each partial expression transition is analyzed individually. This increases the possibility of matching a partial expression transition in the query video sequence against the partial expression transitions in the over-complete transition dictionary. To make a partial matching subject-independent and robust to the temporal mismatch, each partial expression transition is defined as facial shape displacement between a pair of face clusters. Experimental results show that the proposed method is robust to variations of transition duration and transition type in subject-independent recognition.Keywords
Funding Information
- ICT R&D Program
- MSIP/IITP (B0101-15-0525)
- Development of global multi-target tracking
This publication has 50 references indexed in Scilit:
- Beyond sparsity: The role of L1-optimizer in pattern classificationPattern Recognition, 2012
- Automatic Facial Expression Recognition Using Extended AR-LBP2012
- A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion InferenceIEEE Transactions on Multimedia, 2010
- Selecting hierarchical clustering cut points for web person-name disambiguation2009
- Local features based facial expression recognition with face registration errors2008
- A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous ExpressionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- A scalable supervised algorithm for dimensionality reduction on streaming data☆Information Sciences, 2006
- Web-Based Database for Facial Expression Analysis2005
- Independent comparative study of PCA, ICA, and LDA on the FERET data setInternational Journal of Imaging Systems and Technology, 2005
- Eigenfaces for RecognitionJournal of Cognitive Neuroscience, 1991