Shape and Texture Aware Facial Expression Recognition Using Spatial Pyramid Zernike Moments and Law’s Textures Feature Set
Open Access
- 1 January 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 52509-52522
Abstract
Facial expression recognition (FER) requires better descriptors to represent the face patterns as the facial region changes due to the movement of the face muscles during an expression. In this paper, a method of concatenating spatial pyramid Zernike moments based shape features and Law’s texture features is proposed to uniquely capture the macro and micro details of each facial expression. The proposed method employs multilayer perceptron and radial basis function feed forward artificial neural networks for recognizing the facial expressions. The suitability of the features in recognizing the expressions is explored across the datasets independent of the subjects or persons. The experiments conducted on JAFFE and KDEF datasets demonstrate that the concatenated feature vectors are capable of representing the facial expressions with better accuracy and least errors. The radial basis function based classifier delivers a performance with an average recognition accuracy of 95.86% and 88.87% on the JAFFE and KDEF datasets respectively for subject dependent FER.Keywords
Funding Information
- Scientific Research Grant of Shantou University, China (NTF17016)
This publication has 55 references indexed in Scilit:
- Facial Expression Recognition based on Independent Component AnalysisJournal of Multimedia, 2013
- Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector MachinesSensors, 2013
- Classification of benign and malignant masses based on Zernike momentsComputers in Biology and Medicine, 2011
- Face recognition using Zernike and complex Zernike moment featuresPattern Recognition and Image Analysis, 2011
- Spatial Pyramid Matching2009
- A Survey of Face Recognition TechniquesJournal of Information Processing Systems, 2009
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Recognizing action units for facial expression analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Training feedforward networks with the Marquardt algorithmIEEE Transactions on Neural Networks, 1994
- Invariant image recognition by Zernike momentsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1990