Choosing software metrics for defect prediction: an investigation on feature selection techniques
Top Cited Papers
- 18 March 2011
- journal article
- research article
- Published by Wiley in Software: Practice and Experience
- Vol. 41 (5) , 579-606
Abstract
The selection of software metrics for building software quality prediction models is a search‐based software engineering problem. An exhaustive search for such metrics is usually not feasible due to limited project resources, especially if the number of available metrics is large. Defect prediction models are necessary in aiding project managers for better utilizing valuable project resources for software quality improvement. The efficacy and usefulness of a fault‐proneness prediction model is only as good as the quality of the software measurement data. This study focuses on the problem of attribute selection in the context of software quality estimation. A comparative investigation is presented for evaluating our proposed hybrid attribute selection approach, in which feature ranking is first used to reduce the search space, followed by a feature subset selection. A total of seven different feature ranking techniques are evaluated, while four different feature subset selection approaches are considered. The models are trained using five commonly used classification algorithms. The case study is based on software metrics and defect data collected from multiple releases of a large real‐world software system. The results demonstrate that while some feature ranking techniques performed similarly, the automatic hybrid search algorithm performed the best among the feature subset selection methods. Moreover, performances of the defect prediction models either improved or remained unchanged when over 85were eliminated. Copyright © 2011 John Wiley & Sons, Ltd.Keywords
This publication has 30 references indexed in Scilit:
- ATTRIBUTE SELECTION USING ROUGH SETS IN SOFTWARE QUALITY CLASSIFICATIONInternational Journal of Reliability, Quality and Safety Engineering, 2009
- An introduction to ROC analysisPattern Recognition Letters, 2006
- Finding the Right Data for Software Cost ModelingIEEE Software, 2005
- Consistency-based search in feature selectionArtificial Intelligence, 2003
- Benchmarking attribute selection techniques for discrete class data miningIEEE Transactions on Knowledge and Data Engineering, 2003
- 10.1162/153244303322753670Applied Physics Letters, 2000
- 10.1162/153244303322753616Applied Physics Letters, 2000
- Emerald: software metrics and models on the desktopIEEE Software, 1996
- Ridge Estimators in Logistic RegressionJournal of the Royal Statistical Society Series C: Applied Statistics, 1992
- Instance-based learning algorithmsMachine Learning, 1991