Software Defect Prediction Using Stacking Generalization of Optimized Tree-Based Ensembles
Open Access
- 30 April 2022
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 12 (9) , 4577
Abstract
Software defect prediction refers to the automatic identification of defective parts of software through machine learning techniques. Ensemble learning has exhibited excellent prediction outcomes in comparison with individual classifiers. However, most of the previous work utilized ensemble models in the context of software defect prediction with the default hyperparameter values, which are considered suboptimal. In this paper, we investigate the applicability of a stacking ensemble built with fine-tuned tree-based ensembles for defect prediction. We used grid search to optimize the hyperparameters of seven tree-based ensembles: random forest, extra trees, AdaBoost, gradient boosting, histogram-based gradient boosting, XGBoost and CatBoost. Then, a stacking ensemble was built utilizing the fine-tuned tree-based ensembles. The ensembles were evaluated using 21 publicly available defect datasets. Empirical results showed large impacts of hyperparameter optimization on extra trees and random forest ensembles. Moreover, our results demonstrated the superiority of the stacking ensemble over all fine-tuned tree-based ensembles.Keywords
This publication has 49 references indexed in Scilit:
- A survey of methodologies for the treatment of missing values within datasets: limitations and benefitsTheoretical Issues in Ergonomics Science, 2010
- Defect prediction from static code features: current results, limitations, new approachesAutomated Software Engineering, 2010
- Ensemble-based classifiersArtificial Intelligence Review, 2009
- On the relative value of cross-company and within-company data for defect predictionEmpirical Software Engineering, 2009
- Greedy function approximation: A gradient boosting machine.The Annals of Statistics, 2001
- Stacked generalizationNeural Networks, 1992
- A survey of decision tree classifier methodologyIEEE Transactions on Systems, Man, and Cybernetics, 1991
- The TAME project: towards improvement-oriented software environmentsIEEE Transactions on Software Engineering, 1988
- A Cluster Analysis Method for Grouping Means in the Analysis of Variance1974
- VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITYMonthly Weather Review, 1950