A Study on Dropout Prediction for University Students Using Machine Learning
Top Cited Papers
Open Access
- 3 November 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (21) , 12004
Abstract
Student dropout is a serious issue in that it not only affects the individual students who drop out but also has negative impacts on the former university, family, and society together. To resolve this, various attempts have been made to predict student dropout using machine learning. This paper presents a model to predict student dropout at Sahmyook University using machine learning. Academic records collected from 20,050 students of the university were analyzed and used for learning. Various machine learning algorithms were used to implement the model, including Logistic Regression, Decision Tree, Random Forest, Support Vector Machine, Deep Neural Network, and LightGBM (Light Gradient Boosting Machine), and their performances were compared through experiments. We also discuss the influence of oversampling used to resolve data imbalance issues in the dropout data. For this purpose, various oversampling algorithms such as SMOTE, ADASYN, and Borderline-SMOTE were tested. Our experimental results showed that the proposed model implemented using LightGBM provided the best performance with an F1-score of 0.840, which is higher than the results of previous studies discussing the dropout prediction with the issue of class imbalance.Keywords
Funding Information
- Sahmyook University Research Fund
This publication has 26 references indexed in Scilit:
- Dropout Prediction in MOOCs: Using Deep Learning for Personalized InterventionJournal of Educational Computing Research, 2018
- XGBoost2016
- Deep learning in neural networks: An overviewNeural Networks, 2015
- An Intelligent System for Prediction of School Dropout Risk Group in Higher Education Classroom Based on Artificial Neural Networks2013
- Roughly balanced bagging for imbalanced dataStatistical Analysis and Data Mining: An ASA Data Science Journal, 2009
- Ridge regressionWIREs Computational Statistics, 2009
- Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning2005
- A study of the behavior of several methods for balancing machine learning training dataACM SIGKDD Explorations Newsletter, 2004
- Greedy function approximation: A gradient boosting machine.The Annals of Statistics, 2001
- Induction of decision treesMachine Learning, 1986