Facial Emotion Recognition Using an Ensemble of Multi-Level Convolutional Neural Networks
- 17 October 2019
- journal article
- conference paper
- Published by World Scientific Pub Co Pte Ltd in International Journal of Pattern Recognition and Artificial Intelligence
- Vol. 33 (11)
Abstract
Emotion recognition plays an indispensable role in human–machine interaction system. The process includes finding interesting facial regions in images and classifying them into one of seven classes: angry, disgust, fear, happy, neutral, sad, and surprise. Although many breakthroughs have been made in image classification, especially in facial expression recognition, this research area is still challenging in terms of wild sampling environment. In this paper, we used multi-level features in a convolutional neural network for facial expression recognition. Based on our observations, we introduced various network connections to improve the classification task. By combining the proposed network connections, our method achieved competitive results compared to state-of-the-art methods on the FER2013 dataset.Keywords
Funding Information
- Basic Science Research Program through the National Research Foundation of Korea (NRF-2017R1A4A1015559)
This publication has 20 references indexed in Scilit:
- Hierarchical committee of deep convolutional neural networks for robust facial expression recognitionJournal on Multimodal User Interfaces, 2016
- Going deeper with convolutions2015
- Facial expression recognition using ${l}_{p}$ l p -norm MKL multiclass-SVMMachine Vision and Applications, 2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- Affectiva-MIT Facial Expression Dataset (AM-FED): Naturalistic and Spontaneous Facial Expressions Collected "In-the-Wild"2013
- Unsupervised learning of hierarchical representations with convolutional deep belief networksCommunications of the ACM, 2011
- Facial expression recognition based on Local Binary Patterns: A comprehensive studyImage and Vision Computing, 2009
- Recognizing action units for facial expression analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998