Facial Expression Recognition in Videos Using Dynamic Kernels
- 30 July 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 29 (10577149) , 8316-8325
Abstract
Recognition of facial expressions across various actors, contexts, and recording conditions in real-world videos involves identifying local facial movements. Hence, it is important to discover the formation of expressions from local representations captured from different parts of the face. So in this paper, we propose a dynamic kernel-based representation for facial expressions that assimilates facial movements captured using local spatio-temporal representations in a large universal Gaussian mixture model (uGMM). These dynamic kernels are used to preserve local similarities while handling global context changes for the same expression by utilizing the statistics of uGMM. We demonstrate the efficacy of dynamic kernel representation using three different dynamic kernels, namely, explicit mapping based, probability-based, and matching-based, on three standard facial expression datasets, namely, MMI, AFEW, and BP4D. Our evaluations show that probability-based kernels are the most discriminative among the dynamic kernels. However, in terms of computational complexity, intermediate matching kernels are more efficient as compared to the other two representations.Keywords
This publication has 43 references indexed in Scilit:
- Automatic facial expression recognition using features of salient facial patchesIEEE Transactions on Affective Computing, 2014
- BP4D-Spontaneous: a high-resolution spontaneous 3D dynamic facial expression databaseImage and Vision Computing, 2014
- Gaussian mixture model based estimation of the neutral face shape for emotion recognitionDigital Signal Processing, 2014
- GMM-Based Intermediate Matching Kernel for Classification of Varying Length Patterns of Long Duration Speech Using Support Vector MachinesIEEE Transactions on Neural Networks and Learning Systems, 2013
- Dense Trajectories and Motion Boundary Descriptors for Action RecognitionInternational Journal of Computer Vision, 2013
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Coding, analysis, interpretation, and recognition of facial expressionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Who can catch a liar?American Psychologist, 1991
- For Distinguished Early Career Contribution to Psychophysiology: Award Address, 1988Psychophysiology, 1990
- The Symmetry of Emotional and Deliberate Facial ActionsPsychophysiology, 1981