Building an Ensemble for Software Defect Prediction Based on Diversity Selection
Open Access
- 8 September 2016
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-10
Abstract
Background: Ensemble techniques have gained attention in various scientific fields. Defect prediction researchers have investigated many state-of-the-art ensemble models and concluded that in many cases these outperform standard single classifier techniques. Almost all previous work using ensemble techniques in defect prediction rely on the majority voting scheme for combining prediction outputs, and on the implicit diversity among single classifiers. Aim: Investigate whether defect prediction can be improved using an explicit diversity technique with stacking ensemble, given the fact that different classifiers identify different sets of defects. Method: We used classifiers from four different families and the weighted accuracy diversity (WAD) technique to exploit diversity amongst classifiers. To combine individual predictions, we used the stacking ensemble technique. We used state-of-the-art knowledge in software defect prediction to build our ensemble models, and tested their prediction abilities against 8 publicly available data sets. Conclusion: The results show performance improvement using stacking ensembles compared to other defect prediction models. Diversity amongst classifiers used for building ensembles is essential to achieving these performance improvements.Keywords
Funding Information
- Engineering and Physical Sciences Research Council (EP/L011751/1)
This publication has 32 references indexed in Scilit:
- Ensembles and locality: Insight on improving software effort estimationInformation and Software Technology, 2013
- An industrial case study of classifier ensembles for locating software defectsSoftware Quality Journal, 2011
- Taxonomy for characterizing ensemble methods in classification tasks: A review and annotated bibliographyComputational Statistics & Data Analysis, 2009
- Ensemble of neural networks with associative memory (ENNA) for estimating software development costsKnowledge-Based Systems, 2009
- A systematic review of software fault prediction studiesExpert Systems with Applications, 2009
- A Meta-Learning Method to Select the Kernel Width in Support Vector RegressionMachine Learning, 2004
- A critique of software defect prediction modelsIEEE Transactions on Software Engineering, 1999
- Stacked generalizationNeural Networks, 1992
- A critique of cyclomatic complexity as a software metricSoftware Engineering Journal, 1988
- Individual Comparisons by Ranking MethodsBiometrics Bulletin, 1945