Structure-Preserving Sparse Decomposition for Facial Expression Analysis
Authors:
- 17 June 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 23 (8) , 3590-3603
Abstract
Although facial expressions can be decomposed in terms of action units (AUs) as suggested by the facial action coding system, there have been only a few attempts that recognize expression using AUs and their composition rules. In this paper, we propose a dictionary-based approach for facial expression analysis by decomposing expressions in terms of AUs. First, we construct an AU-dictionary using domain experts' knowledge of AUs. To incorporate the high-level knowledge regarding expression decomposition and AUs, we then perform structure-preserving sparse coding by imposing two layers of grouping over AU-dictionary atoms as well as over the test image matrix columns. We use the computed sparse code matrix for each expressive face to perform expression decomposition and recognition. Since domain experts' knowledge may not always be available for constructing an AU-dictionary, we also propose a structure-preserving dictionary learning algorithm, which we use to learn a structured dictionary as well as divide expressive faces into several semantic regions. Experimental results on publicly available expression data sets demonstrate the effectiveness of the proposed approach for facial expression analysis.Keywords
Funding Information
- Army Research Office through the Multidisciplinary University Research Initiative Project (W911NF-09-1-0383)
This publication has 30 references indexed in Scilit:
- Multi-layer group sparse coding — For concurrent image classification and annotation2011
- Action unit detection using sparse appearance descriptors in space-time video volumes2011
- The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression2010
- Action unit detection with segment-based SVMs2010
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- The Group Lasso for Logistic RegressionJournal of the Royal Statistical Society Series B: Statistical Methodology, 2008
- Combined Support Vector Machines and Hidden Markov Models for Modeling Facial Action Temporal Dynamics2007
- Fully Automatic Facial Action Unit Detection and Temporal Analysis2006
- Web-Based Database for Facial Expression Analysis2005
- Applications of second-order cone programmingLinear Algebra and its Applications, 1998