A Systematic Review of Facial Expression Detection Methods
Authors:
- Lyanh Vinicios Lopes PintoLPLyanh Vinicios Lopes Pinto
- Andre Vinicius Neves AlvesAAAndre Vinicius Neves Alves
- Alana Miranda MedeirosAMAlana Miranda Medeiros
- Saulo William da Silva CostaSCSaulo William da Silva Costa
- Yomara Pinheiro PiresYPYomara Pinheiro Pires
- Marcos Cesar da Rocha SeruffoMSMarcos Cesar da Rocha Seruffo
Open Access
- 16 June 2023
- journal article
- review article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 61881-61891
Abstract
Understanding emotions is one of the greatest capabilities of human beings, as it allows the understanding of facial expressions that facilitate the capture of important information about other individuals, which are used for the perception of mental or emotional states. Advances in Artificial Intelligence and Visual Computing, more specifically in Deep Learning with the advent of Artificial Neural Networks, have enhanced the ability of machines to infer human emotions through image analysis. This paper presents a Systematic Literature Review (SLR) with the purpose of researching, mapping and summarizing studies that address techniques or algorithms more efficiently. The convolutional neural network models analyzed in this review are based on deep learning with an emphasis on expression and microexpression recognition. The results suggest that database uses, with laboratory controlled images, combined with CNN’s such as VGG and ResNet, have excellent performances in their tests. For better understanding, we will detail and compare all the methods obtained in the review.Keywords
Funding Information
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior-Brasil (001)
- National Council of Technological and Scientific Development
- Federal University of Pará (UFPA) by the Pró-Reitoria de Pesquisa e Pós-Graduação (PROPESP/PAPQ 2023)
This publication has 46 references indexed in Scilit:
- How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-Analyses, and Meta-SynthesesAnnual Review of Psychology, 2019
- Visually Interpretable Representation Learning for Depression Recognition from Facial ImagesIEEE Transactions on Affective Computing, 2018
- Mixture Statistic Metric Learning for Robust Human Action and Expression RecognitionIEEE Transactions on Circuits and Systems for Video Technology, 2017
- Gaussian Process Domain Experts for Modeling of Facial AffectIEEE Transactions on Image Processing, 2017
- Recognizing emotions in text using ensemble of classifiersEngineering Applications of Artificial Intelligence, 2016
- Affective Computing and Sentiment AnalysisIEEE Intelligent Systems, 2016
- Working memory and second language learningInternational Journal of Applied Linguistics, 2012
- A novel fuzzy facial expression recognition system based on facial feature extraction from color face imagesEngineering Applications of Artificial Intelligence, 2012
- Toward Emotion Aware Computing: An Integrated Approach Using Multichannel Neurophysiological Recordings and Affective Visual StimuliIEEE Transactions on Information Technology in Biomedicine, 2010
- A user-independent real-time emotion recognition system for software agents in domestic environmentsEngineering Applications of Artificial Intelligence, 2007