Quantitative modeling of software reviews in an industrial setting
Authors:
- M. LeszakMLM. Leszak
- D. StollDSD. Stoll
- K. El EmamKEK. El Emam
- 1 January 1999
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 312-322
Abstract
Technical reviews are a cost-effective method commonly used to detect software defects early. To exploit their full potential, it is necessary to collect measurement data to constantly monitor and improve the implemented review procedure. This paper postulates a model of the factors that affect the number of defects detected during a technical review, and tests the model empirically using data from a large software development organization. The data set comes from more than 300 specification, design, and code reviews that were performed at Lucent's Product Realization Center for Optical Networking (PRC-ON) in Nuernberg, Germany. Since development projects within PRC-ON usually spend between 12% and 18% of the total development effort on reviews, it is essential to understand the relationships among the factors that determine review success. One major finding of this study is that the number of detected defects is primarily determined by the preparation effort of reviewers rather than t he size of the reviewed artifact. In addition, the size of the reviewed artifact has only limited influence on review effort. Furthermore, we identified consistent ceiling effects in the relationship between size and effort with the number of defects detected. These results suggest that managers at PRC-ON must consider adequate preparation effort in their review planning to ensure high quality artifacts as well as a mature review processKeywords
This publication has 17 references indexed in Scilit:
- Does Every Inspection Really Need a Meeting?Empirical Software Engineering, 1998
- Understanding the sources of variation in software inspectionsACM Transactions on Software Engineering and Methodology, 1998
- An experiment to assess the cost-benefits of code inspections in large scale software developmentIEEE Transactions on Software Engineering, 1997
- Factors affecting design inspection effectiveness in software developmentInformation and Software Technology, 1997
- What makes inspections work?IEEE Software, 1997
- Statistical Models for Causal Analysis1993
- An analysis of defect densities found during software inspectionsJournal of Systems and Software, 1992
- Statistical quality control applied to code inspectionsIEEE Journal on Selected Areas in Communications, 1990
- Multiple Regression in Practice1985
- Design and code inspections to reduce errors in program developmentIBM Systems Journal, 1976