Emotion-Aware Course Personalization in Virtual Classrooms via Multi-Modal Fusion Learning Systems
Authors:
- 3 July 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
Emotion-aware course personalization in virtual classrooms aims to enhance the learning experience by dynamically adapting content based on students’ emotional and cognitive states. This approach leverages AI to create responsive and human-centric e-learning environments. Existing virtual learning systems often rely solely on cognitive metrics, such as quiz scores or activity logs, failing to consider emotional cues like confusion, frustration, or disengagement. As a result, learners experience reduced motivation, lower retention, and poor personalization. To address these challenges, we propose a novel Multi-Modal Deep Attention Fusion (MMDAF) framework that integrates data from facial expressions, voice tone, and textual interactions. By employing deep learning and attention mechanisms, MMDAF selectively weights and fuses inputs to more accurately detect learners’ emotions in real-time. The detected emotional states are used to personalize the learning path by modifying content delivery, pacing, or interactive support. For instance, confusion can trigger the use of simplified explanations or visual aids, while boredom may lead to the implementation of gamified modules. Experimental evaluations in simulated virtual classrooms of learner engagement, emotional satisfaction, and academic performance compared to traditional models.Keywords
This publication has 39 references indexed in Scilit:
- Evaluation and optimization of adaptive cruise control in autonomous vehicles using the car learning to act simulator: A performance evaluation under various weather conditionsSustainable Futures, 2025
- Multimodal emotion recognition based on a fusion of audiovisual information with temporal dynamicsMultimedia Tools and Applications, 2024
- Multi-modal fusion approaches for tourism: A comprehensive survey of data-sets, fusion techniques, recent architectures, and future directionsComputers and Electrical Engineering, 2024
- Fuzzy decision-making framework for explainable golden multi-machine learning models for real-time adversarial attack detection in Vehicular Ad-hoc NetworksInformation Fusion, 2023
- The determinants of Gen Z's metaverse adoption decisions in higher education: Integrating UTAUT2 with personal innovativeness in ITEducation and Information Technologies, 2023
- Perspectives of Online Education in Pakistan: Post-covid Scenario2023
- A novel dual-modal emotion recognition algorithm with fusing hybrid features of audio signal and speech contextComplex & Intelligent Systems, 2022
- Smart cities: Fusion-based intelligent traffic congestion control system for vehicular networks using machine learning techniquesEgyptian Informatics Journal, 2022
- Multi-head attention fusion networks for multi-modal speech emotion recognitionComputers & Industrial Engineering, 2022
- FedRD: Privacy-preserving adaptive Federated learning framework for intelligent hazardous Road Damage detection and warningFuture Generation Computer Systems, 2021