Empirical Studies of a Two-Stage Data Preprocessing Approach for Software Fault Prediction
- 10 August 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Reliability
- Vol. 65 (1) , 38-53
Abstract
Software fault prediction is a valuable exercise in software quality assurance to best allocate limited testing resources. Classification is one of the effective methods for software fault prediction. The classification models are trained based on the datasets obtained by mining software historical repositories. However, the performance of the models depends on the quality of datasets. In this paper, we propose a novel two-stage data preprocessing approach which incorporates both feature selection and instance reduction. Specifically, in the feature selection stage, we first perform relevance analysis, and then propose a threshold-based clustering method, called novel threshold-based clustering algorithm, to conduct redundancy control. In the instance reduction stage, we apply random under-sampling to keep the balance between the faulty and non-faulty instances. In empirical studies, we chose datasets from real-world software projects, such as Eclipse and NASA. Then we compared our approach with some classical baseline methods, and further investigated the influencing factors in our approach. The final results demonstrate the effectiveness of our approach, and provide a guideline for achieving cost-effective data preprocessing when using our two-stage approach.Keywords
Funding Information
- National Basic Research Program of China (2009CB320705))
- National Natural Science Foundation of China (61373012, 61321491, 91218302, 61202006))
- the University Natural Science Research Project of Jiangsu Province (12KJB520014))
- The Open Project of State Key Laboratory for Novel Software Technology at Nanjing University (KFKT2012B29))
- Collaborative Innovation Center of Novel Software Technology and Industrialization
This publication has 57 references indexed in Scilit:
- Empirical studies on feature selection for software fault prediction2013
- A comparative study of iterative and non-iterative feature selection techniques for software defect predictionInformation Systems Frontiers, 2013
- AN EMPIRICAL STUDY OF FEATURE RANKING TECHNIQUES FOR SOFTWARE QUALITY PREDICTIONInternational Journal of Software Engineering and Knowledge Engineering, 2012
- Evaluating Stratification Alternatives to Improve Software Defect PredictionIEEE Transactions on Reliability, 2012
- A Systematic Literature Review on Fault Prediction Performance in Software EngineeringIEEE Transactions on Software Engineering, 2011
- A Fast Clustering-Based Feature Subset Selection Algorithm for High-Dimensional DataIEEE Transactions on Knowledge and Data Engineering, 2011
- RUSBoost: A Hybrid Approach to Alleviating Class ImbalanceIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 2009
- Detecting Fault Modules Applying Feature Selection to Classifiers2007
- A selective sampling approach to active feature selectionArtificial Intelligence, 2004
- On Issues of Instance SelectionData Mining and Knowledge Discovery, 2002