Identification of Failure Regions for Programs With Numeric Inputs
- 12 August 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 5 (4) , 651-667
Abstract
Failure region, where failure-causing inputs reside, has provided many insights to enhance testing effectiveness of many testing methods. Failure region may also provide some important information to support other processes such as software debugging. When a testing method detects a software failure, indicating that a failure-causing input is identified, the next important question is about how to identify the failure region based on this failure-causing input, i.e., Identification of Failure Regions (IFR). In this paper, we introduce a new IFR strategy, namely Search for Boundary (SB), to identify an approximate failure region of a numeric input domain. SB attempts to identify additional failure-causing inputs that are as close to the boundary of the failure region as possible. To support SB, we provide a basic procedure, and then propose two methods, namely Fixed-orientation Search for Boundary (FSB) and Diverse-orientation Search for Boundary (DSB). In addition, we implemented an automated experimentation platform to integrate these methods. In the experiments, we evaluated the proposed SB methods using a series of simulation studies and empirical studies with different types of failure regions. The results show that our methods can effectively identify a failure region, within the limited testing resources.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (61872167, 61502205, U1836116)
- China Postdoctoral Science Foundation (2019T120396)
- Postgraduate Research & Practice Innovation Program of Jiangsu Province (KYCX19_1614)
- Senior Personnel Scientific Research Foundation
- Jiangsu University (14JDG039)
- Young Backbone Teacher Cultivation Project of Jiangsu University
This publication has 29 references indexed in Scilit:
- Adaptive Partition TestingIEEE Transactions on Computers, 2018
- Automatic Software RepairACM Computing Surveys, 2018
- A Survey on Software Fault LocalizationIEEE Transactions on Software Engineering, 2016
- A Cost-Effective Random Testing Method for Programs with Non-Numeric InputsIEEE Transactions on Computers, 2016
- Enhancing mirror adaptive random testing through dynamic partitioningInformation and Software Technology, 2015
- Randomized Quasi-Random TestingIEEE Transactions on Computers, 2015
- Code Coverage of Adaptive Random TestingIEEE Transactions on Reliability, 2013
- Enhancing Performance of Random Testing through Markov Chain Monte Carlo MethodsIEEE Transactions on Computers, 2011
- Adaptive Random Testing: The ART of test case diversityJournal of Systems and Software, 2010
- An upper bound on software testing effectivenessACM Transactions on Software Engineering and Methodology, 2008