Search‐based testing using constraint‐based mutation
Authors:
- 30 August 2013
- journal article
- research article
- Published by Wiley in Software Testing, Verification and Reliability
- Vol. 24 (6) , 472-495
Abstract
SUMMARY: Many modern automated test generators are based on either metaheuristic search techniques or use constraint solvers. Both approaches have their advantages, but they also have specific drawbacks: Search‐based methods may get stuck in local optima and degrade when the search landscape offers no guidance; constraint‐based approaches, on the other hand, can only handle certain domains efficiently. This paper describes a method that integrates both techniques and delivers the best of both worlds. On a high‐level view, the proposed method uses a genetic algorithm to generate tests, but the twist is that during evolution, a constraint solver is used to ensure that mutated offspring efficiently explores different control flow. Experiments on 20 case study programmes show that on average the combination improves branch coverage by 28% over search‐based techniques while reducing the number of tests by 55%, and improves coverage by 13% over constraint‐based techniques while reducing the number of tests by 73%. Copyright © 2013 John Wiley & Sons, Ltd.Keywords
This publication has 29 references indexed in Scilit:
- A Hitchhiker's guide to statistical tests for assessing randomized algorithms in software engineeringSoftware Testing, Verification and Reliability, 2012
- An empirical investigation into branch coverage for C programs using CUTE and AUSTINJournal of Systems and Software, 2010
- Pex–White Box Test Generation for .NET2008
- Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential ImpactEmpirical Software Engineering, 2005
- JCrasher: an automatic robustness tester for JavaSoftware: Practice and Experience, 2004
- Search‐based software test data generation: a surveySoftware Testing, Verification and Reliability, 2004
- Testability transformationIEEE Transactions on Software Engineering, 2004
- A Critique and Improvement of the CL Common Language Effect Size Statistics of McGraw and WongJournal of Educational and Behavioral Statistics, 2000
- Parameter control in evolutionary algorithmsIEEE Transactions on Evolutionary Computation, 1999
- Algorithm 322: F -distributionCommunications of the ACM, 1968