Automated System-Level Regression Test Prioritization in a Nutshell
Authors:
- 11 July 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Software
- Vol. 34 (4) , 30-37
Abstract
Westermo Research and Development has developed SuiteBuilder, an automated tool to determine an effective ordering of regression test cases. The ordering is based on factors such as fault detection success, the interval since the last execution, and code modifications. SuiteBuilder has enabled Westermo to overcome numerous regression-testing problems, including lack of time to run a complete regression suite, failure to detect bugs in a timely manner, and repeatedly omitted tests. In the tool's first two years of use, reordered test suites finished in the available time, most fault-detecting test cases were located in the first third of suites, no important test case was omitted, and the necessity for manual work on the suites decreased greatly.Keywords
This publication has 8 references indexed in Scilit:
- Experience Report: Automated System Level Regression Test Prioritization Using Multiple Factors2016
- Prioritizing Manual Test Cases in Traditional and Rapid Release Environments2015
- Techniques for improving regression testing in continuous integration development environments2014
- An empirical analysis of flaky tests2014
- Empirically revisiting the test independence assumption2014
- Regression testing minimization, selection and prioritization: a surveySoftware Testing, Verification and Reliability, 2012
- Improving Regression Testing Transparency and Efficiency with History-Based Prioritization -- An Industrial Case Study2011
- Prioritizing test cases for resource constraint environments using historical test case performance data2009