Causes and effects of fitness landscapes in unit test generation
Authors:
Open Access
- 25 June 2020
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1204-1212
Abstract
Search-based unit test generation applies evolutionary search to maximize code coverage. Although the performance of this approach is often good, sometimes it is not, and how the fitness landscape affects this performance is poorly understood. This paper presents a thorough analysis of 331 Java classes by (i) characterizing their fitness landscape using six established fitness landscape measures, (ii) analyzing the impact of these fitness landscape measures on the search, and (iii) investigating the underlying properties of the source code influencing these measures. Our results reveal that classical indicators for rugged fitness landscapes suggest well searchable problems in the case of unit test generation, but the fitness landscape for most problem instances is dominated by detrimental plateaus. A closer look at the underlying source code suggests that these plateaus are frequently caused by code in private methods, methods throwing exceptions, and boolean flags. This suggests that inter-procedural distance metrics and testability transformations could improve search-based test generation.Keywords
This publication has 24 references indexed in Scilit:
- Combining Multiple Coverage Criteria in Search-Based Unit Test Generation2015
- Random or Genetic Algorithm Search for Object-Oriented Test Suite Generation?2015
- Reformulating Branch Coverage as a Many-Objective Optimization Problem2015
- A Large-Scale Evaluation of Automated Unit Test Generation Using EvoSuiteACM Transactions on Software Engineering and Methodology, 2014
- A survey of techniques for characterising fitness landscapes and some possible ways forwardInformation Sciences, 2013
- EvoSuite2011
- On Parameter Tuning in Search Based Software Engineering2011
- Testability transformationIEEE Transactions on Software Engineering, 2004
- Fitness landscapes and difficulty in genetic programming2002
- Automated software test data generationIEEE Transactions on Software Engineering, 1990