Enhancing emotion recognition model for a student engagement use case through transfer learning
Open Access
- 1 April 2025
- journal article
- Published by Institute of Advanced Engineering and Science in IAES International Journal of Artificial Intelligence (IJ-AI)
- Vol. 14 (2) , 1576-1586
Abstract
Distance education has been prevalent since the late 1800s, but its rapid expansion began in the late 1990s with the advent of the online technological revolution. Distance learning encompasses all forms of training conducted without the physical presence of learners or teachers. While this mode of education offers great flexibility and numerous advantages for both students and teachers, it also presents challenges such as reduced concentration and commitment from students, and difficulties in course supervision for teachers. This article aims to study student engagement on distance learning platforms by focusing on emotion detection. Leveraging various existing datasets, including the Facial Expression Recognition 2013 (FER2013), the Karolinska Directed Emotional Faces (KDEF), the extended Cohn-Kanade (CK+), and the Kyung Hee University Multimodal Facial Expression Database (KMU-FED), the proposed approach utilizes transfer learning. Specifically, it exploits the large number and diversity of images from datasets like FER2013, and the high-quality images from datasets like KDEF, CK+, and KMU-FED. The model can effectively learn and generalize emotional cues from varied sources by combining these datasets. This comprehensive method achieved a performance accuracy of 96.06%, demonstrating its potential to enhance understanding of student engagement in online learning environments.Keywords
This publication has 24 references indexed in Scilit:
- Facial emotion recognition based real-time learner engagement detection system in online learning context using deep learning modelsMultimedia Tools and Applications, 2022
- Student Engagement Detection Using Emotion Analysis, Eye Tracking and Head Movement with Machine Learning2022
- Facial recognition using Haar cascade and LBP classifiersGlobal Transitions Proceedings, 2021
- Estimation of Learners’ Engagement Using Face and Body Features by Transfer Learning2021
- A Survey on Human Face Expression Recognition TechniquesJournal of King Saud University Computer and Information Sciences, 2021
- Facial expression recognition via ResNet-50International Journal of Cognitive Computing in Engineering, 2021
- A new emotion–based affective model to detect student’s engagementJournal of King Saud University Computer and Information Sciences, 2021
- Recognition of facial expressions based on CNN featuresMultimedia Tools and Applications, 2020
- Online teaching-learning in higher education during lockdown period of COVID-19 pandemicInternational Journal of Educational Research Open, 2020
- Student Concentration Evaluation Index in an E-learning Context Using Facial Emotion Analysis2019