Improved students’ performance prediction for multi-class imbalanced problems using hybrid and ensemble approach in educational data mining
Authors:
- Hasniza HassanHHHasniza Hassan
- Nor Bahiah AhmadNANor Bahiah Ahmad
- Syahid AnuarSASyahid Anuar
Open Access
- 1 May 2020
- conference paper
- Published by IOP Publishing in Journal of Physics: Conference Series
- Vol. 1529 (5)
Abstract
Among the problems raised in the data mining area, the class imbalance is a well-known issue that always occurs. Many researchers studied this issue in several fields using three commonly used techniques: sampling, ensemble, or cost-sensitive learning. However, such studies are still new in education domains. This problem always related to the quality of data that gives the most impact to form an accurate prediction result. Many previous studies focus on binary imbalance classification problems instead of the multi-class imbalance problem in education data. This study used 4413 student instances of two datasets; students’ information system and e-learning from the Faculty of Engineering in a Malaysia university for First Semester 2017/2018. Three sampling categories utilized in this study are oversampling techniques, undersampling techniques, and hybrid techniques. The research empirically analyzes five types of ensemble classifiers and seven sampling techniques. The experimental results show a hybrid technique ROS with AdaBoost produces the most excellent performance compared to the other benchmark techniques. SMOTEENN technique with ensembles classifiers consistently produces high results. This technique has great potential in improving the students’ performance prediction model.Keywords
This publication has 18 references indexed in Scilit:
- Ensemble Learning for Estimating Individualized Treatment Effects in Student Success StudiesInternational Journal of Artificial Intelligence in Education, 2018
- Predicting Students’ GPA and Developing Intervention Strategies Based on Self-Regulatory Learning BehaviorsIEEE Access, 2017
- Evaluating the effectiveness of educational data mining techniques for early prediction of students' academic failure in introductory programming coursesComputers in Human Behavior, 2017
- Improving Performance Prediction on Education Data with Noise and Class ImbalanceIntelligent Automation and Soft Computing, 2017
- Big Data Analytics Services for Enhancing Business IntelligenceJournal of Computer Information Systems, 2016
- Mining Educational Data to Predict Student’s academic Performance using Ensemble MethodsInternational Journal of Database Theory and Application, 2016
- Students' LMS interaction patterns and their relationship with achievement: A case study in higher educationComputers & Education, 2016
- Improved student dropout prediction in Thai University using ensemble of mixed-type data clusteringsInternational Journal of Machine Learning and Cybernetics, 2015
- SMOTE for high-dimensional class-imbalanced dataBMC Bioinformatics, 2013
- 10 CHALLENGING PROBLEMS IN DATA MINING RESEARCHInternational Journal of Information Technology & Decision Making, 2006