Understanding and Identifying Technical Debt in the Co-Evolution of Production and Test Code
- 19 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Software Engineering
- Vol. 51 (5) , 1415-1436
Abstract
The co-evolution of production and test code (PT co-evolution) has received increasing attention in recent years. However, we found that existing work did not comprehensively study various PT co-evolution scenarios, such as the qualification and persistence of their effects on software. Inspired by technical debt (TD), we refer to TD generated during the co-evolution between production and test code as PT co-evolution technical debt (PTCoTD). To better understand PT co-evolution, we first conducted an exploratory study on its characteristics on 15 open-source projects, finding unbalanced PT co-evolution prevalent and summarizing five potential PT flaws. Then we proposed an approach to identify and quantify PTCoTDs of these flaw patterns, considering evolutionary and structural relationships. We also built prediction models to describe cost trajectories and rank all PTCoTDs to prioritize expensive ones. The evaluation on the 15 projects shows that our approach can identify PTCoTDs that deserve attention. The identified PTCoTDs account for about half of the project’s total maintenance costs, and the cost proportion of the expensive Top-5 is 1.8x more than the file proportion they contain. Almost all covered maintenance costs persist as PTCoTD in the future, with an average increase of 6.8% between the last two releases. Our approach also accurately predicts the costs of PTCoTD with an average prediction deviation of only 8.3%. Our study provides valuable insights into PT co-evolution scenarios and their effects, which can guide practices and inspire future work on software testing and maintenance.Keywords
Funding Information
- Natural Science Foundation of China (62272221)
This publication has 93 references indexed in Scilit:
- On Technical Debt in Software Testing - Observations from Industry2022
- Further investigation of the survivability of code technical debt itemsJournal of Software: Evolution and Process, 2022
- On the Temporality of Introducing Code Technical Debt2020
- Hearing the Voice of Software Practitioners on Causes, Effects, and Practices to Deal with Documentation Debt2020
- An Analysis of Automated Technical Debt Measurement2020
- TestDCat: Catalog of Test Debt Subtypes and Management Activities2019
- Using Model-Based Testing to Reduce Test Automation Technical Debt: An Industrial Experience Report2019
- Understanding Test Debt2016
- On the Interplay Between Software Testing and Evolution and its Effect on Program Comprehension2008
- The relationship between user query accuracy and lines of codeInternational Journal of Human-Computer Studies, 1999