Hybrid System for Emotion Recognition Based on Facial Expressions and Body Gesture Recognition
Authors:
- 30 September 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 135-140
Abstract
This paper considers a hybrid multimodal model for improvement of the human emotion recognition based on facial expression and body gesture recognition. The paper extends the author’s investigations related to the usage of pre-trained models of deep learning neural networks (DNN) for facial emotion recognition (FER) with addition of the emotions extracted from body language. In order to extract emotions from upper body gestures a second model of DNN was developed and trained with specific datasets. The information regarding recognized emotions obtained by both models is more accurate and can be used in education, medicine, psychology, product advertisement, marketing, human-machine interfaces, etc. In our case, it aims to personalize the lecture material of the students during their online training, taking into account their emotional state.Keywords
This publication has 6 references indexed in Scilit:
- Pre-trained Deep Learning Models for Facial Emotions Recognition2020
- Deep Facial Expression Recognition: A SurveyIEEE Transactions on Affective Computing, 2020
- Fusing Body Posture With Facial Expressions for Joint Recognition of Affect in Child–Robot InteractionIEEE Robotics and Automation Letters, 2019
- Facial Expression Recognition via Deep Learning2017
- Bodily Expression for Automatic Affect Recognition2015
- Core affect and the psychological construction of emotion.Psychological Review, 2003