Multi-Stream Deep Convolution Neural Network With Ensemble Learning for Facial Micro-Expression Recognition
Open Access
- 16 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 118474-118489
Abstract
Micro-expression recognition has gained much attention in research communities. Among its proposed solutions, deep learning approaches have shown promising results over the past few years. In this paper, we propose a multi-stream deep convolution neural network with ensemble classification for facial micro-expression recognition. The multi-stream network uses the deep features of a residual network, densely connected convolutional network, and visual geometry group. The features of these aforementioned architectures are extracted from their pooling layers and become very resource-intensive due to their high dimensions. The principal component analysis is applied to these features for their dimensionality reduction. Stacking, an ensemble classification technique, is performed on these deep features with three base learners (random tree, J48, random forest) and a meta learner (random forest). Experiments were performed using publicly available datasets, namely: CASME-II, CASME2, SMIC, and SAMM. The proposed approach (PA) is compared with twelve approaches. The results show that the PA outperformed the existing approaches in terms of accuracy and time efficiency.Keywords
This publication has 64 references indexed in Scilit:
- A Comparative Study of Ensemble Methods for Students' Performance ModelingInternational Journal of Computer Applications, 2014
- CASME II: An Improved Spontaneous Micro-Expression Database and the Baseline EvaluationPLOS ONE, 2014
- Comparison of Bagging, Boosting and Stacking Ensembles Applied to Real Estate Appraisal2010
- The Karolinska Directed Emotional Faces: A validation studyCognition and Emotion, 2008
- Is Combining Classifiers with Stacking Better than Selecting the Best One?Machine Learning, 2004
- Recognizing action units for facial expression analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- FEATURE-BASED FACIAL EXPRESSION RECOGNITION: SENSITIVITY ANALYSIS AND EXPERIMENTS WITH A MULTILAYER PERCEPTRONInternational Journal of Pattern Recognition and Artificial Intelligence, 1999
- Recognizing human facial expressions from long image sequences using optical flowIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- Human expression recognition from motion using a radial basis function network architectureIEEE Transactions on Neural Networks, 1996
- Stacked generalizationNeural Networks, 1992