Facial Emotion Recognition in Verbal Communication Based on Deep Learning
Open Access
Abstract
Facial emotion recognition from facial images is considered a challenging task due to the unpredictable nature of human facial expressions. The current literature on emotion classification has achieved high performance over deep learning (DL)-based models. However, the issue of performance degradation occurs in these models due to the poor selection of layers in the convolutional neural network (CNN) model. To address this issue, we propose an efficient DL technique using a CNN model to classify emotions from facial images. The proposed algorithm is an improved network architecture of its kind developed to process aggregated expressions produced by the Viola–Jones (VJ) face detector. The internal architecture of the proposed model was finalised after performing a set of experiments to determine the optimal model. The results of this work were generated through subjective and objective performance. An analysis of the results presented herein establishes the reliability of each type of emotion, along with its intensity and classification. The proposed model is benchmarked against state-of-the-art techniques and evaluated on the FER-2013, CK+, and KDEF datasets. The utility of these findings lies in their application by law-enforcing bodies in smart cities.Keywords
This publication has 43 references indexed in Scilit:
- Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks2017
- A real-time robust facial expression recognition system using HOG features2016
- Facial Expression Recognition Using Decision Trees2016
- Automatic Facial Expression Recognition Using DCNNProcedia Computer Science, 2016
- Image based Static Facial Expression Recognition with Multiple Deep Network Learning2015
- Facial expression recognition using Support Vector Machines2015
- Early Facial Expression Recognition Using Hidden Markov Models2014
- Emotion Recognition and Its Applications2014
- Facial expression recognition based on Local Binary Patterns: A comprehensive studyImage and Vision Computing, 2009
- Robust Real-Time Face DetectionInternational Journal of Computer Vision, 2004