Improving Software Fault Localization by Combining Spectrum and Mutation
Open Access
- 21 September 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 172296-172307
Abstract
The performance of software fault localization techniques is critical to software debugging and the reliability of software. Spectrum-based fault localization (SBFL) and mutation-based fault localization (MBFL) are the two most popular fault localization methods. However, the accuracies of the two methods are still limited. For example, only 10.63% of faults can be detected by inspecting the top 3 suspicious elements reported by Ochiai, which is a famous SBFL technique. Unfortunately, programmers only examine the first few suspicious elements before losing patience. Since the information used in SBFL and MBFL are quite different and complementary, this paper proposes a novel approach by combining spectrum and mutation to improve the fault localization accuracy. First, the faulty program is evaluated by using SBFL, and the potential faulty statements are ranked according to their suspiciousness. Then, mutants of the program are generated and executed by MBFL. Finally, the statements that are ranked in the top tied n by SBFL are evaluated and reranked according to their mutation scores. Experiments are carried on the Defects4J benchmark and the results reveal that the accuracy of the proposed approach outperforms those of the SBFL and MBFL techniques. In terms of the faults located by inspecting the top 1 suspicious elements, the SMFL techniques detect at least 2.36 times more faults than two SBFL techniques (DStar and Ochiai) and detect at least 1.86 times more faults than two MBFL techniques (MUSE and Metallaxis).Keywords
Funding Information
- National Key Research and Development Program of China (2017YFB1400402)
- National Natural Science Foundation of China (61702041, 61601039)
- Qin Xin Talents Cultivation Program of Beijing Information Science Technology University (QXTCP C201906, QXTCP B201905)
This publication has 35 references indexed in Scilit:
- Defects4J: a database of existing faults to enable controlled testing studies for Java programs2014
- Combining mutation and fault localization for automated program debuggingJournal of Systems and Software, 2014
- Metallaxis‐FL: mutation‐based fault localizationSoftware Testing, Verification and Reliability, 2013
- A model for spectra-based software diagnosisACM Transactions on Software Engineering and Methodology, 2011
- Are automated debugging techniques actually helping programmers?2011
- A Crosstab-based Statistical Method for Effective Fault Localization2008
- Predicting Faults from Cached History29th International Conference on Software Engineering (ICSE'07), 2007
- Locating faults through automated predicate switching2006
- Scalable statistical bug isolationACM SIGPLAN Notices, 2005
- Locating causes of program failures2005