What Types of Defects Are Really Discovered in Code Reviews?
Authors:
Top Cited Papers
- 22 August 2008
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Software Engineering
- Vol. 35 (3) , 430-448
Abstract
Research on code reviews has often focused on defect counts instead of defect types, which offers an imperfect view of code review benefits. In this paper, we classified the defects of nine industrial (C/C++) and 23 student (Java) code reviews, detecting 388 and 371 defects, respectively. First, we discovered that 75 percent of defects found during the review do not affect the visible functionality of the software. Instead, these defects improved software evolvability by making it easier to understand and modify. Second, we created a defect classification consisting of functional and evolvability defects. The evolvability defect classification is based on the defect types found in this study, but, for the functional defects, we studied and compared existing functional defect classifications. The classification can be useful for assigning code review roles, creating checklists, assessing software evolvability, and building software engineering tools. We conclude that, in addition to functional defects, code reviews find many evolvability defects and, thus, offer additional benefits over execution-based quality assurance methods that cannot detect evolvability defects. We suggest that code reviews may be most valuable for software products with long life cycles as the value of discovering evolvability defects in them is greater than for short life cycle systems.Keywords
This publication has 50 references indexed in Scilit:
- Predicting maintenance performance using object-oriented design complexity metricsIEEE Transactions on Software Engineering, 2003
- A comprehensive evaluation of capture-recapture models for estimating software defect contentIEEE Transactions on Software Engineering, 2000
- An encompassing life cycle centric survey of software inspectionJournal of Systems and Software, 2000
- Comparing detection methods for software requirements inspections: a replicated experimentIEEE Transactions on Software Engineering, 1995
- Object-oriented metrics that predict maintainabilityJournal of Systems and Software, 1993
- In-process evaluation for software inspection and testIEEE Transactions on Software Engineering, 1993
- Debugging effort estimation using software metricsIEEE Transactions on Software Engineering, 1990
- Software restructuringProceedings of the IEEE, 1989
- Program readability: procedures versus commentsIEEE Transactions on Software Engineering, 1988
- A controlled experiment in program testing and code walkthroughs/inspectionsCommunications of the ACM, 1978