Some Seeds Are Strong: Seeding Strategies for Search-based Test Case Selection
Open Access
- 31 January 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Software Engineering and Methodology
- Vol. 32 (1) , 1-47
Abstract
The time it takes software systems to be tested is usually long. Search-based test selection has been a widely investigated technique to optimize the testing process. In this article, we propose a set of seeding strategies for the test case selection problem that generates the initial population of Pareto-based multi-objective algorithms, with the goals of (1) helping to find an overall better set of solutions and (2) enhancing the convergence of the algorithms. The seeding strategies were integrated with four state-of-the-art multi-objective search algorithms and applied into two contexts where regression-testing is paramount: (1) Simulation-based testing of Cyber-physical Systems and (2) Continuous Integration. For the first context, we evaluated our approach by using six fitness function combinations and six independent case studies, whereas in the second context, we derived a total of six fitness function combinations and employed four case studies. Our evaluation suggests that some of the proposed seeding strategies are indeed helpful for solving the multi-objective test case selection problem. Specifically, the proposed seeding strategies provided a higher convergence of the algorithms towards optimal solutions in 96% of the studied scenarios and an overall cost-effectiveness with a standard search budget in 85% of the studied scenarios.Keywords
Funding Information
- Department of Education, Universities and Research of the Basque Country
This publication has 54 references indexed in Scilit:
- Regression testing minimization, selection and prioritization: a surveySoftware Testing, Verification and Reliability, 2012
- Pairwise testing for software product lines: comparison of two approachesSoftware Quality Journal, 2011
- Automated analysis of feature models 20 years later: A literature reviewInformation Systems, 2010
- Using hybrid algorithm for Pareto efficient multi-objective test suite minimisationJournal of Systems and Software, 2010
- Adaptive Random Testing: The ART of test case diversityJournal of Systems and Software, 2010
- A systematic review on regression test selection techniquesInformation and Software Technology, 2010
- Mirror adaptive random testingInformation and Software Technology, 2004
- Search‐based software test data generation: a surveySoftware Testing, Verification and Reliability, 2004
- Software release planning: an evolutionary and iterative approachInformation and Software Technology, 2004
- A fast and elitist multiobjective genetic algorithm: NSGA-IIIEEE Transactions on Evolutionary Computation, 2002