A Flexible and Non-intrusive Approach for Computing Complex Structural Coverage Metrics
Authors:
- Michael W. WhalenMWMichael W. Whalen
- Suzette PersonSPSuzette Person
- Neha RungtaNRNeha Rungta
- Matt StaatsMSMatt Staats
- Daniela GrijincuDGDaniela Grijincu
- 1 May 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 506-516
Abstract
Software analysis tools and techniques often leverage structural code coverage information to reason about the dynamic behavior of software. Existing techniques instrument the code with the required structural obligations and then monitor the execution of the compiled code to report coverage. Instrumentation based approaches often incur considerable runtime overhead for complex structural coverage metrics such as Modified Condition/Decision (MC/DC). Code instrumentation, in general, has to be approached with great care to ensure it does not modify the behavior of the original code. Furthermore, instrumented code cannot be used in conjunction with other analyses that reason about the structure and semantics of the code under test. In this work, we introduce a non-intrusive preprocessing approach for computing structural coverage information. It uses a static partial evaluation of the decisions in the source code and a source-to-bytecode mapping to generate the information necessary to efficiently track structural coverage metrics during execution. Our technique is flexible; the results of the preprocessing can be used by a variety of coverage-driven software analysis tasks, including automated analyses that are not possible for instrumented code. Experimental results in the context of symbolic execution show the efficiency and flexibility of our non- intrusive approach for computing code coverage information.Keywords
This publication has 24 references indexed in Scilit:
- On the Danger of Coverage Directed Test Case Generation2012
- Test input generation for java containers using state matching2006
- A survey of coverage based testing tools2006
- Pin2005
- Efficient instrumentation for code coverage testingACM SIGSOFT Software Engineering Notes, 2002
- Visualization of test information to assist fault localization2002
- Prioritizing test cases for regression testing2000
- A safe, efficient regression test selection techniqueACM Transactions on Software Engineering and Methodology, 1997
- A methodology for controlling the size of a test suiteACM Transactions on Software Engineering and Methodology, 1993
- Test data adequacy measurementSoftware Engineering Journal, 1993