Experiences and results from initiating field defect prediction and product test prioritization efforts at ABB Inc.
Authors:
Open Access
- 28 May 2006
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 413-422
Abstract
Quantitatively-based risk management can reduce the risks associated with field defects for both software producers and software consumers. In this paper, we report experiences and results from initiating risk-management activities at a large systems development organization. The initiated activities aim to improve product testing (system/integration testing), to improve maintenance resource allocation, and to plan for future process improvements. The experiences we report address practical issues not commonly addressed in research studies: how to select an appropriate modeling method for product testing prioritization and process improvement planning, how to evaluate accuracy of predictions across multiple releases in time, and how to conduct analysis with incomplete information. In addition, we report initial empirical results for two systems with 13 and 15 releases. We present prioritization of configurations to guide product testing, field defect predictions within the first year of deployment to aid maintenance resource allocation, and important predictors across both systems to guide process improvement planning. Our results and experiences are steps towards quantitatively-based risk management.Keywords
This publication has 15 references indexed in Scilit:
- Empirical evaluation of defect projection models for widely-deployed production software systemsACM SIGSOFT Software Engineering Notes, 2004
- Where the bugs areACM SIGSOFT Software Engineering Notes, 2004
- Body of knowledge for software quality measurementComputer, 2002
- Effects of Process Maturity on Quality, Cycle Time, and Effort in Software Product DevelopmentManagement Science, 2000
- Application of neural networks to software quality modeling of a very large telecommunications systemIEEE Transactions on Neural Networks, 1997
- Application of neural networks for predicting program faultsComputational Geosciences, 1995
- Estimating defects in commercial software during operational useIEEE Transactions on Reliability, 1993
- Predicting software errors, during development, using nonlinear regression models: a comparative studyIEEE Transactions on Reliability, 1992
- Predicting software development errors using software complexity metricsIEEE Journal on Selected Areas in Communications, 1990
- Learning from examples: generation and evaluation of decision trees for software resource analysisIEEE Transactions on Software Engineering, 1988