Student Performance Prediction Using XGBoost Method from A Macro Perspective
Author:
- 1 January 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 453-459
Abstract
Student performance prediction has attracted more and more attention in the educational data mining field in recent years. An accurate and useful forecast on student performance can play a huge role in many aspects, such as solving student dropout, allocating teaching resources reasonably, and improving teaching methods. In this paper, we employed an XGBoost-based method to forecast student performance. Instead of using individual students as samples, we used a novel educational dataset structured from a macro perspective, which rarely appeared in existing research. We used data cleaning, feature selection, and feature creation to increase the model's generalizability and the accuracy of the predictions. The XGBoost model achieved the best results than five other classic machine learning models (i.e., Random Forest, Lasso, Elastic Net, Support Vector Machine, and Decision Tree). It achieved a significant improvement in the R2 score by 6.3% to 12.1% on different sub-datasets. Furthermore, through feature importance analysis, we have drawn some forward-looking and meaningful conclusions.Keywords
This publication has 18 references indexed in Scilit:
- Evaluating the effectiveness of educational data mining techniques for early prediction of students' academic failure in introductory programming coursesComputers in Human Behavior, 2017
- Student performance prediction using Support Vector Machine and K-Nearest Neighbor2017
- Models for early prediction of at-risk students in a course using standards-based gradingComputers & Education, 2016
- XGBoost2016
- Predicting MOOC Dropout over Weeks Using Machine Learning Methods2014
- Improving retention2013
- Use of machine learning techniques for educational proposes: a decision support system for forecasting students’ gradesArtificial Intelligence Review, 2011
- A comparative analysis of machine learning techniques for student retention managementDecision Support Systems, 2010
- Educational Data Mining: A Review of the State of the ArtIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2010
- Dropout prediction in e-learning courses through the combination of machine learning techniquesComputers & Education, 2009