UniLoc: Unified Fault Localization of Continuous Integration Failures
Open Access
- 28 September 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Software Engineering and Methodology
- Vol. 32 (6) , 1-31
Abstract
Continuous integration (CI) practices encourage developers to frequently integrate code into a shared repository. Each integration is validated by automatic build and testing such that errors are revealed as early as possible. When CI failures or integration errors are reported, existing techniques are insufficient to automatically locate the root causes for two reasons. First, a CI failure may be triggered by faults in source code and/or build scripts, whereas current approaches consider only source code. Second, a tentative integration can fail because of build failures and/or test failures, whereas existing tools focus on test failures only. This article presents UniLoc, the first unified technique to localize faults in both source code and build scripts given a CI failure log, without assuming the failure’s location (source code or build scripts) and nature (a test failure or not). Adopting the information retrieval (IR) strategy, UniLoc locates buggy files by treating source code and build scripts as documents to search and by considering build logs as search queries. However, instead of naïvely applying an off-the-shelf IR technique to these software artifacts, for more accurate fault localization, UniLoc applies various domain-specific heuristics to optimize the search queries, search space, and ranking formulas. To evaluate UniLoc, we gathered 700 CI failure fixes in 72 open source projects that are built with Gradle. UniLoc could effectively locate bugs with the average mean reciprocal rank value as 0.49, mean average precision value as 0.36, and normalized discounted cumulative gain value as 0.54. UniLoc outperformed the state-of-the-art IR-based tool BLUiR and Locus. UniLoc has the potential to help developers diagnose root causes for CI failures more accurately and efficiently.Keywords
Funding Information
- National Science Foundation (CSPECC-1736209, CCF-1846467, CCF-2007718, CNS-2221843, CCF-1845446, CCF-2006278, CCF-2152819)
This publication has 37 references indexed in Scilit:
- Identifying and understanding header file hotspots in C/C++ build processesAutomated Software Engineering, 2015
- Test case purification for improving fault localization2014
- A Large-Scale Empirical Study of the Relationship between Build Technology and Build MaintenanceEmpirical Software Engineering, 2014
- Version history, similar report, and structure: putting them together for improved bug localization2014
- Automatic patch generation learned from human-written patches2013
- Are faults localizable?2012
- Where should the bugs be fixed? More accurate information retrieval-based bug localization based on bug reports2012
- The evolution of Java build systemsEmpirical Software Engineering, 2011
- Design recovery and maintenance of build systems2007 IEEE International Conference on Software Maintenance, 2007
- AnO(ND) difference algorithm and its variationsAlgorithmica, 1986