A dynamic approach to the recognition of 3D facial expressions and their temporal models
Authors:
- 1 March 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 406-413
Abstract
In this paper we propose a method that exploits 3D motion-based features between frames of 3D facial geometry sequences for dynamic facial expression recognition. An expressive sequence is modeled to contain an onset followed by an apex and an offset. Feature selection methods are applied in order to extract features for each of the onset and offset segments of the expression. These features are then used to train a Hidden Markov Model in order to model the full temporal dynamics of the expression. The proposed fully automatic system was tested in a subset of the BU-4DFE database for the recognition of happiness, anger and surprise. Comparisons with a similar system based on the motion extracted from facial intensity images was also performed. The attained results suggest that the use of the 3D information does indeed improve the recognition accuracy when compared to the 2D data.Keywords
This publication has 28 references indexed in Scilit:
- Machine analysis of facial behaviour: naturalistic and dynamic behaviourPhilosophical Transactions of the Royal Society B: Biological Sciences, 2009
- Discriminant Graph Structures for Facial Expression RecognitionIEEE Transactions on Multimedia, 2008
- Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial ExpressionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector MachinesIEEE Transactions on Image Processing, 2006
- Dynamics of facial expression extracted automatically from videoImage and Vision Computing, 2006
- Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequencesIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2006
- Active and dynamic information fusion for facial expression understanding from image sequencesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- Automatic construction of 3-D statistical deformation models of the brain using nonrigid registrationIEEE Transactions on Medical Imaging, 2003
- Nonrigid registration using free-form deformations: application to breast MR imagesIEEE Transactions on Medical Imaging, 1999
- Iterative point matching for registration of free-form curves and surfacesInternational Journal of Computer Vision, 1994