Using Dependency Structures for Prioritization of Functional Test Suites
Authors:
- 24 April 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Software Engineering
- Vol. 39 (2) , 258-275
Abstract
Test case prioritization is the process of ordering the execution of test cases to achieve a certain goal, such as increasing the rate of fault detection. Increasing the rate of fault detection can provide earlier feedback to system developers, improving fault fixing activity and, ultimately, software delivery. Many existing test case prioritization techniques consider that tests can be run in any order. However, due to functional dependencies that may exist between some test cases-that is, one test case must be executed before another-this is often not the case. In this paper, we present a family of test case prioritization techniques that use the dependency information from a test suite to prioritize that test suite. The nature of the techniques preserves the dependencies in the test ordering. The hypothesis of this work is that dependencies between tests are representative of interactions in the system under test, and executing complex interactions earlier is likely to increase the fault detection rate, compared to arbitrary test orderings. Empirical evaluations on six systems built toward industry use demonstrate that these techniques increase the rate of fault detection compared to the rates achieved by the untreated order, random orders, and test suites ordered using existing "coarse-grained” techniques based on function coverage.Keywords
This publication has 27 references indexed in Scilit:
- System testing for object‐oriented systems with test case prioritizationSoftware Testing, Verification and Reliability, 2009
- Factor oriented requirement coverage based system test case prioritization of new and regression test casesInformation and Software Technology, 2009
- Experiments with test case prioritization using relevant slicesJournal of Systems and Software, 2007
- Code-coverage guided prioritized test generationInformation and Software Technology, 2006
- Test case prioritization: a family of empirical studiesIEEE Transactions on Software Engineering, 2002
- Prioritizing test cases for regression testingIEEE Transactions on Software Engineering, 2001
- A framework for specification-based testingIEEE Transactions on Software Engineering, 1996
- Software complexity and its impact on software reliabilityIEEE Transactions on Software Engineering, 1988
- A Theorem on Boolean MatricesJournal of the ACM, 1962
- Criterion for the rejection of doubtful observationsThe Astronomical Journal, 1852