DATA MINING FOR PREDICTORS OF SOFTWARE QUALITY
Authors:
- 1 October 1999
- journal article
- research article
- Published by World Scientific Pub Co Pte Ltd in International Journal of Software Engineering and Knowledge Engineering
- Vol. 09 (05) , 547-563
Abstract
"Knowledge discovery in data bases" (KDD) for software engineering is a process for finding useful information in the large volumes of data that are a byproduct of software development, such as data bases for configuration management and for problem reporting. This paper presents guidelines for extracting innovative process metrics from these commonly available data bases. This paper also adapts the Classification And Regression Trees algorithm, CART, to the KDD process for software engineering data. To our knowledge, this algorithm has not been used previously for empirical software quality modeling. In particular, we present an innovative way to control the balance between misclassification rates. A KDD case study of a very large legacy telecommunications software system found that variables derived from source code, configuration management transactions, and problem reporting transactions can be useful predictors of software quality. The KDD process discovered that for this software development environment, out of forty software attributes, only a few of the predictor variables were significant. This resulted in a model that predicts whether modules are likely to have faults discovered by customers. Software developers need such predictions early in development to target software enhancement techniques to the modules that need improvement the most.Keywords
This publication has 16 references indexed in Scilit:
- A procedure for analyzing unbalanced datasetsIEEE Transactions on Software Engineering, 1998
- Statistical inference and data miningCommunications of the ACM, 1996
- A validation of object-oriented design metrics as quality indicatorsIEEE Transactions on Software Engineering, 1996
- Emerald: software metrics and models on the desktopIEEE Software, 1996
- Early quality prediction: a case study in telecommunicationsIEEE Software, 1996
- Software quality: the elusive target [special issues section]IEEE Software, 1996
- A neural network approach for early detection of program modules having high risk in the maintenance phaseJournal of Systems and Software, 1995
- A pattern recognition approach for software engineering data analysisIEEE Transactions on Software Engineering, 1992
- Estimating the Error Rate of a Prediction Rule: Improvement on Cross-ValidationJournal of the American Statistical Association, 1983
- Estimation of Error Rates in Discriminant AnalysisTechnometrics, 1968