Tool-assisted unit test selection based on operational violations
Authors:
- Tao XieTXTao Xie
- D. NotkinDND. Notkin
- 23 January 2004
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 40-48
Abstract
Unit testing, a common step in software development, presents a challenge. When produced manually, unit test suites are often insufficient to identify defects. The main alternative is to use one of a variety of automatic unit test generation tools: these are able to produce and execute a large number of test inputs that extensively exercise the unit under test. However, without a priori specifications, developers need to manually verify the outputs of these test executions, which is generally impractical. To reduce this cost, unit test selection techniques may be used to help select a subset of automatically generated test inputs. Then developers can verify their outputs, equip them with test oracles, and put them into the existing test suite. In this paper, we present the operational violation approach for unit test selection, a black-box approach without requiring a priori specifications. The approach dynamically generates operational abstractions from executions of the existing unit test suite. Any automatically generated tests violating the operational abstractions are identified as candidates for selection. In addition, these operational abstractions can guide test generation tools to produce better tests. To experiment with this approach, we integrated the use of Daikon (a dynamic invariant detection tool) and Jtest (a commercial Java unit testing tool). An experiment is conducted to assess this approach.Keywords
This publication has 11 references indexed in Scilit:
- Finding failures by cluster analysis of execution profiles2005
- Improving test suites via operational abstraction2003
- Mining specifications2002
- Tracking down software bugs using automatic anomaly detection2002
- Automatic extraction of object-oriented component interfacesACM SIGSOFT Software Engineering Notes, 2002
- KoratACM SIGSOFT Software Engineering Notes, 2002
- Prioritizing test cases for regression testingIEEE Transactions on Software Engineering, 2001
- Static verification of dynamically detected program invariantsElectronic Notes in Theoretical Computer Science, 2001
- Dynamically discovering likely program invariants to support program evolutionIEEE Transactions on Software Engineering, 2001
- Residual test coverage monitoring1999