Capturing Complex Spatio-temporal Relations among Facial Muscles for Facial Expression Recognition
Authors:
- Ziheng WangZWZiheng Wang
- Shangfei WangSWShangfei Wang
- Qiang JiQJQiang Ji
- 1 June 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 3422-3429
Abstract
Spatial-temporal relations among facial muscles carry crucial information about facial expressions yet have not been thoroughly exploited. One contributing factor for this is the limited ability of the current dynamic models in capturing complex spatial and temporal relations. Existing dynamic models can only capture simple local temporal relations among sequential events, or lack the ability for incorporating uncertainties. To overcome these limitations and take full advantage of the spatio-temporal information, we propose to model the facial expression as a complex activity that consists of temporally overlapping or sequential primitive facial events. We further propose the Interval Temporal Bayesian Network to capture these complex temporal relations among primitive facial events for facial expression modeling and recognition. Experimental results on benchmark databases demonstrate the feasibility of the proposed approach in recognizing facial expressions based purely on spatio-temporal relations among facial muscles, as well as its advantage over the existing methods.Keywords
This publication has 11 references indexed in Scilit:
- Facial expression recognition with temporal modeling of shapes2011
- Fully Automatic Recognition of the Temporal Phases of Facial ActionsIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2011
- The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression2010
- Structure learning of Bayesian networks using constraints2009
- A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous ExpressionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Facial Action Recognition for Facial Expression Analysis From Static Face ImagesIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2004
- Facial expression recognition from video sequences: temporal and static modelingComputer Vision and Image Understanding, 2003
- Comprehensive database for facial expression analysis2002
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Maintaining knowledge about temporal intervalsCommunications of the ACM, 1983