Evaluating Time-Dependent Methods and Seasonal Effects in Code Technical Debt Prediction
Preprint
Abstract
Code Technical Debt prediction has become a popular research niche in recent software engineering literature. Technical Debt is an important metric in software projects as it measures professionals' effort to clean the code. Therefore, predicting its future behavior becomes a crucial task. However, no well-defined and consistent approach can completely capture the features that impact the evolution of Code Technical Debt. The goal of this study is to evaluate the impact of considering time-dependent techniques as well as seasonal effects in temporal data in the prediction performance within the context of Code Technical Debt. The study adopts existing, yet not extensively adopted, time-dependent prediction techniques and compares their prediction performance to commonly used Machine Learning models. Further, the study strengthens the evaluation of time-dependent methods by extending the analysis to capture the impact of seasonality in Code Technical Debt data. We trained 11 prediction models using the commit history of 31 open-source projects developed with Java. We predicted the future observations of the SQALE index to evaluate their predictive performance. Our study confirms the positive impact of considering time-dependent techniques. The adopted multivariate time series analysis model ARIMAX overcame the rest of the adopted models. Incorporating seasonal effects led to an enhancement in the predictive performance of the adopted time-dependent techniques. However, the impact of this effect was found to be relatively modest. The findings of this study corroborate our position in favor of implementing techniques that capture the existing time dependence within historical data of software metrics, specifically in the context of this study, namely, Code Technical Debt. This necessitates the utilization of techniques that can effectively address this evidence.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Forecasting technical debt evolution in software systems: an empirical studyFrontiers of Computer Science, 2022
- Technical Debt Forecasting Based on Deep Learning Techniques2021
- Technical debt forecasting: An empirical study on open-source repositoriesJournal of Systems and Software, 2020
- Some SonarQube issues have a significant but small effect on faults and changes. A large-scale empirical studyJournal of Systems and Software, 2020
- An empirical investigation on the relationship between design and architecture smellsEmpirical Software Engineering, 2020
- How developers engage with static analysis tools in different contextsEmpirical Software Engineering, 2019
- A comparison of random forest variable selection methods for classification prediction modelingExpert Systems with Applications, 2019
- Are architectural smells independent from code smells? An empirical studyJournal of Systems and Software, 2019
- On the diffuseness and the impact on maintainability of code smells: a large scale empirical investigationEmpirical Software Engineering, 2017
- Characteristic-Based Clustering for Time Series DataData Mining and Knowledge Discovery, 2006