A Hybrid Approach to Coping with High Dimensionality and Class Imbalance for Software Defect Prediction
Authors:
- Kehan GaoKGKehan Gao
- Taghi M. KhoshgoftaarTKTaghi M. Khoshgoftaar
- Amri NapolitanoANAmri Napolitano
- 1 December 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 281-288
Abstract
High dimensionality and class imbalance are the two main problems affecting many software defect prediction. In this paper, we propose a new technique, named SelectRUSBoost, which is a form of ensemble learning that in-corporates data sampling to alleviate class imbalance and feature selection to resolve high dimensionality. To evaluate the effectiveness of the new technique, we apply it to a group of datasets in the context of software defect prediction. We employ two classification learners and six feature selection techniques. We compare the technique to the approach where feature selection and data sampling are used together, as well as the case where feature selection is used alone (no sampling used at all). The experimental results demonstrate that the SelectRUSBoost technique is more effective in improving classification performance compared to the other approaches.Keywords
This publication has 18 references indexed in Scilit:
- AN EMPIRICAL STUDY OF FEATURE RANKING TECHNIQUES FOR SOFTWARE QUALITY PREDICTIONInternational Journal of Software Engineering and Knowledge Engineering, 2012
- A COMPARATIVE STUDY OF FILTER-BASED AND WRAPPER-BASED FEATURE RANKING TECHNIQUES FOR SOFTWARE QUALITY MODELINGInternational Journal of Reliability, Quality and Safety Engineering, 2011
- A General Software Defect-Proneness Prediction FrameworkIEEE Transactions on Software Engineering, 2010
- RUSBoost: A Hybrid Approach to Alleviating Class ImbalanceIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2009
- New feature selection methods for qualification of the patients for cardiac pacemaker implantation2007
- Detecting Fault Modules Applying Feature Selection to Classifiers2007
- Feature selection in proteomic pattern data with support vector machines2005
- A selective sampling approach to active feature selectionArtificial Intelligence, 2004
- Emerald: software metrics and models on the desktopIEEE Software, 1996
- A Practical Approach to Feature Selection1992