Enhancing Facial Expression Recognition System in Online Learning Context Using Efficient Deep Learning Model
Open Access
- 18 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 121419-121433
Abstract
This paper presents an online educational platform that leverages facial expression recognition technology to monitor students’ progress within the classroom. Periodically, a camera captures images of students in the classroom, processes these images, and extracts facial data through detection methods. Subsequently, students’ learning statuses are assessed using expression recognition techniques. The developed approach then dynamically refines and enhances teaching strategies using the acquired learning status data. In the course of the experiment, we enhance facial expression recognition accuracy through the utilization of ResNet-50 for effective feature extraction. Additionally, by adjusting the residual down-sampling module, we bolster the correlation among input features, thus mitigating the loss of feature information. Simultaneously, a convolutional attention mechanism module is incorporated to reduce the influence of irrelevant areas within the feature map. The proposed method achieves an accuracy of 87.62% and 88.13 % on the RAF-DB and FER2013 expression datasets, respectively. In comparison with the original ResNet-50 network and the expression recognition outcomes found in existing literature, the suggested approach demonstrates enhanced accuracy and improved detection of students’ learning states and expression variations. Consequently, the application of facial expression recognition technology in online learning, along with the optimization of online teaching resources and strategies grounded in the results of recognition, holds tangible value for augmenting the quality of online learning experiences. We have benchmarked the proposed model against state-of-the-art techniques and conducted evaluations using the FER-2013, CK+, and KDEF datasets. The significance of these results lies in their potential application within educational institutions.Keywords
This publication has 40 references indexed in Scilit:
- Occlusion Aware Facial Expression Recognition Using CNN With Attention MechanismIEEE Transactions on Image Processing, 2018
- Micro-expression recognition based on 3D flow convolutional neural networkPattern Analysis and Applications, 2018
- Patch-Gated CNN for Occlusion-aware Facial Expression Recognition2018
- Multi-Channel Pose-Aware Convolution Neural Networks for Multi-View Facial Expression Recognition2018
- Facial emotion analysis using deep convolution neural network2017
- Deep Residual Learning for Image Recognition2016
- Dynamics of affective states during complex learningLearning and Instruction, 2012
- FILTWAM - A Framework for Online Affective Computing in Serious GamesProcedia Computer Science, 2012
- The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression2010
- Emotion Enhances Learning via Norepinephrine Regulation of AMPA-Receptor TraffickingCell, 2007