Detecting Student Engagement in an Online Learning Environment Using a Machine Learning Algorithm
Open Access
- 28 April 2025
- journal article
- research article
- Published by MDPI AG in Informatics
- Vol. 12 (2) , 44
Abstract
This paper examines online learner engagement, a complex concept encompassing several dimensions (behavioral, emotional, and cognitive) and recognized as a key indicator of learning effectiveness. Engagement involves participation, motivation, persistence, and reflection, facilitating content understanding. Predicting engagement, particularly behavioral engagement, encourages interaction and aids teachers in adjusting their methods. The aim is to develop a predictive model to classify learners based on their engagement, using indicators such as academic outcomes to identify signs of difficulty. This study demonstrates that engagement in quizzes and exams predicts engagement in lessons, promoting personalized learning. We utilized supervised machine learning algorithms to forecast engagement at three levels: quizzes, exams, and lessons, drawing from a Kaggle database. Quiz and exam scores were employed to create predictive models for lessons. The performance of the models was evaluated using classic metrics such as precision, recall, and F1-score. The Decision Tree model emerged as the best performer among those evaluated, achieving 97% and 98.49% accuracy in predicting quiz and exam engagement, respectively. The K-Nearest Neighbors (KNN) and Gradient Boosting models also showed commendable performance, albeit slightly less effective than the Decision Tree. The results indicate a strong correlation between engagement predictions across the three levels. This suggests that engagement in quizzes and exams, known as assessments, is a pertinent indicator of overall engagement. Active learners tend to perform better in these assessments. Early identification of at-risk learners allows for targeted interventions, optimizing their engagement.Keywords
This publication has 41 references indexed in Scilit:
- Profiling students’ learning engagement in MOOC discussions to identify learning achievement: An automated configurational approachComputers & Education, 2024
- Using an integrated probabilistic clustering approach to detect student engagement across asynchronous and synchronous online discussionsJournal of Computing in Higher Education, 2024
- Understanding college students’ continuous usage intention of asynchronous online courses through extended technology acceptance modelEducation and Information Technologies, 2023
- A proposed architectural learner model for a personalized learning environmentEducation and Information Technologies, 2022
- An overview and comparison of supervised data mining techniques for student exam performance predictionComputers & Education, 2020
- Virtual learning environment to predict withdrawal by leveraging deep learningInternational Journal of Intelligent Systems, 2019
- Learning Engagement and Persistence in Massive Open Online Courses (MOOCS)Computers & Education, 2018
- Exploring the potential of LMS log data as a proxy measure of student engagementJournal of Computing in Higher Education, 2017
- Support-vector networksMachine Learning, 1995
- The general causality orientations scale: Self-determination in personalityJournal of Research in Personality, 1985