Lingxi: Repository-Level Issue Resolution Framework Enhanced by Procedural Knowledge Guided Scaling
Open Access
- 1 October 2026
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Software Engineering
- Vol. 3 (ISSTA) , 4096-4117
Abstract
Driven by the advancements of Large Language Models (LLMs), LLM-powered agents are making significant improvements in software engineering tasks, yet struggle with complex, repository-level issue resolution. Existing agent-based methods have two key limitations. First, they lack of procedural knowledge (i.e., how an issue is fixed step-by-step and rationales behind it) to learn and leverage for issue resolution. Second, they rely on massive computational power to blindly explore the solution space. To address those limitations, we propose Lingxi, an issue resolution framework that leverages procedural knowledge extracted from historical issue-fixing data to guide agents in solving repository-level issues. Lingxi first constructs this knowledge offline through a hierarchical abstraction mechanism, enabling agents to learn the how and why behind a fix, not just the final solution. During online application, it employs a knowledge-driven scaling method that leverages the procedural knowledge of similar issues to intelligently analyze the target issue from multiple perspectives, in sharp contrast to undirected, brute-force exploration.Lingxi successfully resolves 74.6% of bugs on the SWE-bench Verified benchmark in Pass@1 setting, outperforming five state-of-the-art techniques by a significant margin (5.4% to 14.9%). Our comprehensive ablation study confirmed that the success of Lingxi comes directly from its use of procedural knowledge. Without it, the performance gains from scaling alone is negligible. Our qualitative study further shows that the “design patterns & coding practices” is the most critical knowledge aspect, and that the roles of different knowledge aspects switch across different stages (i.e., analysis, planning, and fixing).Keywords
This publication has 47 references indexed in Scilit:
- Pathidea: Improving Information Retrieval-Based Bug Localization by Re-Constructing Execution Paths Using LogsIEEE Transactions on Software Engineering, 2021
- The Value of Software Documentation Quality2014
- Knowledge-based approaches in software documentation: A systematic literature reviewInformation and Software Technology, 2014
- Got issues? Who cares about it? A large scale investigation of issue trackers from GitHub2013
- Summarizing software artifacts2010
- Communication, collaboration, and bugs2010
- What makes a good bug report?2008
- What do large commits tell us?2008
- An Exploratory Study of How Developers Seek, Relate, and Collect Relevant Information during Software Maintenance TasksIEEE Transactions on Software Engineering, 2006
- An experimental evaluation of continuous testing during development2004