Precise Learn-to-Rank Fault Localization Using Dynamic and Static Features of Target Programs
Open Access
- 9 October 2019
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Software Engineering and Methodology
- Vol. 28 (4) , 1-34
Abstract
Finding the root cause of a bug requires a significant effort from developers. Automated fault localization techniques seek to reduce this cost by computing the suspiciousness scores (i.e., the likelihood of program entities being faulty). Existing techniques have been developed by utilizing input features of specific types for the computation of suspiciousness scores, such as program spectrum or mutation analysis results. This article presents a novel learn-to-rank fault localization technique called PRecise machINe-learning-based fault loCalization tEchnique (PRINCE). PRINCE uses genetic programming (GP) to combine multiple sets of localization input features that have been studied separately until now. For dynamic features, PRINCE encompasses both Spectrum Based Fault Localization (SBFL) and Mutation Based Fault Localization (MBFL) techniques. It also uses static features, such as dependency information and structural complexity of program entities. All such information is used by GP to train a ranking model for fault localization. The empirical evaluation on 65 real-world faults from CoREBench, 84 artificial faults from SIR, and 310 real-world faults from Defects4J shows that PRINCE outperforms the state-of-the-art SBFL, MBFL, and learn-to-rank techniques significantly. PRINCE localizes a fault after reviewing 2.4% of the executed statements on average (4.2 and 3.0 times more precise than the best of the compared SBFL and MBFL techniques, respectively). Also, PRINCE ranks 52.9% of the target faults within the top ten suspicious statements.Keywords
Funding Information
- National Research Foundation of Korea (NRF-2017M3C4A7068177, NRF-2017M3C4A7068179, NRF-2019R1A2B5B01069865, NRF-2017R1D1A1B03035851, NRF-2018R1A5A1059921)
This publication has 63 references indexed in Scilit:
- Metallaxis‐FL: mutation‐based fault localizationSoftware Testing, Verification and Reliability, 2013
- Software fault prediction metrics: A systematic literature reviewInformation and Software Technology, 2013
- A model for spectra-based software diagnosisACM Transactions on Software Engineering and Methodology, 2011
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- Candidate metrics for object-oriented software within a taxonomy frameworkJournal of Systems and Software, 1994
- A metrics suite for object oriented designIEEE Transactions on Software Engineering, 1994
- Expertise in debugging computer programs: A process analysisInternational Journal of Man-Machine Studies, 1985
- One-at-a-Time PlansJournal of the American Statistical Association, 1973
- Zoogeographical Studies on the Soleoid Fishes Found in Japan and its Neighhouring Regions-IINIPPON SUISAN GAKKAISHI, 1957
- Individual Comparisons by Ranking MethodsBiometrics Bulletin, 1945