Leveraging disposable instrumentation to reduce coverage collection overhead
- 11 May 2006
- journal article
- Published by Wiley in Software Testing, Verification and Reliability
- Vol. 16 (4) , 267-288
Abstract
Testers use coverage data for test suite quality assessment, stopping criteria definition, and effort allocation. However, as the complexity of products and testing processes increases, the cost of coverage data collection may grow significantly, jeopardizing its potential application. To mitigate this problem this paper presents the concept of ‘disposable coverage instrumentation’—coverage instrumentation that is removed after its execution—through two techniques: local disposal, and collective disposal. A Java virtual machine was extended to support these techniques, and their potential is shown through two studies utilizing the Specjvm98 and Specjbb2000 benchmarks. The results indicate that the techniques can reduce coverage collection overhead by an order of magnitude over state‐of‐the‐art techniques. Copyright © 2006 John Wiley & Sons, Ltd.Keywords
This publication has 12 references indexed in Scilit:
- Profiling deployed software: assessing strategies and testing opportunitiesIEEE Transactions on Software Engineering, 2005
- Skoll: distributed continuous quality assurance2004
- Profiling Java applications using code hotswapping and dynamic call graph revelation2004
- A technique for dynamic updating of Java software2003
- Bug isolation via remote program sampling2003
- Efficient path profiling2002
- Gamma system2002
- Residual test coverage monitoring1999
- Optimally profiling and tracing programsACM Transactions on Programming Languages and Systems, 1994
- An applicable family of data flow testing criteriaIEEE Transactions on Software Engineering, 1988