Fault localization prioritization
Authors:
Open Access
- 30 July 2013
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Software Engineering and Methodology
- Vol. 22 (3) , 1-29
Abstract
Test case prioritization techniques seek to maximize early fault detection. Fault localization seeks to use test cases already executed to help find the fault location. There is a natural interplay between the two techniques; once a fault is detected, we often switch focus to fault fixing, for which localization may be a first step. In this article we introduce the Fault Localization Prioritization (FLP) problem, which combines prioritization and localization. We evaluate three techniques: a novel FLP technique based on information theory, FLINT (Fault Localization using INformation Theory), that we introduce in this article, a standard Test Case Prioritization (TCP) technique, and a “test similarity technique” used in previous work. Our evaluation uses five different releases of four software systems. The results indicate that FLP and TCP can statistically significantly reduce fault localization costs for 73% and 76% of cases, respectively, and that FLINT significantly outperforms similarity-based localization techniques in 52% of the cases considered in the study.Keywords
This publication has 22 references indexed in Scilit:
- Regression testing minimization, selection and prioritization: a surveySoftware Testing, Verification and Reliability, 2012
- Prioritizing tests for software fault diagnosisSoftware: Practice and Experience, 2011
- Studying software evolution using artefacts’ shared information contentScience of Computer Programming, 2010
- A Semiring-Based Trace Semantics for Processes with Applications to Information Leakage Analysis2010
- On similarity-awareness in testing-based fault localizationAutomated Software Engineering, 2008
- Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential ImpactEmpirical Software Engineering, 2005
- Scalable statistical bug isolation2005
- Locating causes of program failures2005
- Prioritizing test cases for regression testingIEEE Transactions on Software Engineering, 2001
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948