Class Balancing Approaches to Improve for Software Defect Prediction Estimations: A Comparative Study
- 1 December 2024
- journal article
- research article
- Published by Pleiades Publishing Ltd in Programming and Computer Software
- Vol. 50 (8) , 621-647
Abstract
Addressing software defects is an ongoing challenge in software development, and effectively managing and resolving defects is vital for ensuring software reliability, which is in turn a crucial quality attribute of any software system. Software defect prediction supported by machine learning (ML) methods offers a promising approach to address the problem of software defects. However, one common challenge in ML-based software defect prediction is the issue of data imbalance. In this paper, we present an empirical study aimed at assessing the impact of various class balancing methods on the issue of class imbalance in software defect prediction. We conducted a set of experiments that involved nine distinct class balancing methods across seven different classifiers. We used datasets from the PROMISE repository, provided by the NASA software project. We also employed various metrics including AUC, Accuracy, Precision, Recall, and the F1 measure to gauge the effectiveness of the different class balancing methods. Furthermore, we applied hypothesis testing to determine any significant differences in metric results between datasets with balanced and unbalanced classes. Based on our findings, we conclude that balancing the classes in software defect prediction yields significant improvements in overall performance. Therefore, we strongly advocate for the inclusion of class balancing as a preprocessing step in this domain.Keywords
This publication has 62 references indexed in Scilit:
- Imbalanced Data Processing Model for Software Defect PredictionWireless Personal Communications, 2017
- Tackling class overlap and imbalance problems in software defect predictionSoftware Quality Journal, 2016
- Label propagation based semi-supervised learning for software defect predictionAutomated Software Engineering, 2016
- A transfer cost-sensitive boosting approach for cross-project defect predictionSoftware Quality Journal, 2015
- Training and assessing classification rules with imbalanced dataData Mining and Knowledge Discovery, 2012
- A systematic review of statistical power in software engineering experimentsInformation and Software Technology, 2006
- Stochastic gradient boostingComputational Statistics & Data Analysis, 2002
- Random ForestsMachine Learning, 2001
- CONNECTIONIST LEARNING PROCEDURES11This chapter appeared in Volume 40 of Artificial Intelligence in 1989, reprinted with permission of North-Holland Publishing. It is a revised version of Technical Report CMU-CS-87-115, which has the same title and was prepared in June 1987 while the author was at Carnegie Mellon University. The research was supported by contract N00014-86-K-00167 from the Office of Naval Research and by grant IST-8520359 from the National Science Foundation.1990
- Software reliability measurementJournal of Systems and Software, 1979