Code Coverage of Adaptive Random Testing
- 1 March 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Reliability
- Vol. 62 (1) , 226-237
Abstract
Random testing is a basic software testing technique that can be used to assess the software reliability as well as to detect software failures. Adaptive random testing has been proposed to enhance the failure-detection capability of random testing. Previous studies have shown that adaptive random testing can use fewer test cases than random testing to detect the first software failure. In this paper, we evaluate and compare the performance of adaptive random testing and random testing from another perspective, that of code coverage. As shown in various investigations, a higher code coverage not only brings a higher failure-detection capability, but also improves the effectiveness of software reliability estimation. We conduct a series of experiments based on two categories of code coverage criteria: structure-based coverage, and fault-based coverage. Adaptive random testing can achieve higher code coverage than random testing with the same number of test cases. Our experimental results imply that, in addition to having a better failure-detection capability than random testing, adaptive random testing also delivers a higher effectiveness in assessing software reliability, and a higher confidence in the reliability of the software under test even when no failure is detected.Keywords
This publication has 38 references indexed in Scilit:
- Centroidal Voronoi Tessellations- A New Approach to Random TestingIEEE Transactions on Software Engineering, 2012
- Adaptive Random Testing: The ART of test case diversityJournal of Systems and Software, 2010
- ARTOO2008
- ON FAVOURABLE CONDITIONS FOR ADAPTIVE RANDOM TESTINGInternational Journal of Software Engineering and Knowledge Engineering, 2007
- Random testing of interrupt-driven software2005
- Automatic testing of graphical user interfaces2004
- Prioritizing test cases for regression testingIEEE Transactions on Software Engineering, 2001
- Proportional sampling strategy: a compendium and some insightsJournal of Systems and Software, 2001
- An empirical study of the reliability of UNIX utilitiesCommunications of the ACM, 1990
- The category-partition method for specifying and generating functional testsCommunications of the ACM, 1988