Automated Knowledge-Aware Test Reuse
Open Access
- 30 June 2026
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Software Engineering
- Vol. 3 (FSE) , 3138-3161
Abstract
The quality of foundational libraries is critical to the reliability of modern software ecosystems. However, developers often do not have enough time to test for various reasons. Recent studies show that 68% of deep learning libraries lack unit tests and their absence negatively impacts libraries' health. While automated test generation techniques have been proposed, they frequently produce invalid inputs or semantically inconsistent assertions due to missing domain knowledge. An alternative is cross-library test reuse, as many libraries in scientific computing and machine learning expose functionally similar APIs. Nevertheless, effective test reuse requires careful semantic alignment rather than naive "copy-and-paste", as subtle API mismatches and incomplete domain knowledge often yield invalid tests. To address these challenges, we present KATRER, a knowledge-aware framework for automated test reuse. KATRER models each library as a heterogeneous graph that integrates semantic and structural information and introduces a Test Fingerprint representation for tests, which captures code, docstrings, usage examples, pre-/post-conditions, and invoked APIs. This enables accurate API alignment and prevents invalid calls. KATRER further employs a collaborative LLM pipeline that verifies semantic compatibility, performs stepwise API substitution, and validates test correctness. We evaluated KATRER among five libraries in two domains, generating 13,191 sub-tests from 1,484 source tests, with 7,257 retained after filtering. KATRER improves both PassRate@1 and TFC@1 by 14.46%, while uncovering 22 previously unknown defects in CuPy and cuML, 8 of which have already been fixed. These results demonstrate that knowledge-aware test reuse substantially reduces manual adaptation effort and enhances the robustness of widely used libraries.Keywords
Funding Information
- National Key Research and Development Program of China (2024YFB4506400)
This publication has 46 references indexed in Scilit:
- The Seeds of the Future Sprout from History: Fuzzing for Unveiling Vulnerabilities in Prospective Deep-Learning Libraries2025
- An empirical study of automated unit test generation for PythonEmpirical Software Engineering, 2023
- Studying Test Annotation Maintenance in the Wild2021
- Automatic Unit Test Generation for Machine Learning Libraries: How Far Are We?2021
- Automated Unit Test Generation for Python2020
- Test Transfer Across Mobile Apps Through Semantic Mapping2019
- CodeKernel: A Graph Kernel Based Approach to the Selection of API Usage Examples2019
- Test Migration Between Mobile Apps with Similar Functionality2019
- Graph Embedding Based API Graph Search and RecommendationJournal of Computer Science and Technology, 2019
- Practitioners' Views on Good Software Testing Practices2019