TD-Suite: All Batteries Included Framework for Technical Debt Classification
Preprint
Abstract
Recognizing that technical debt is a persistent and significant challenge requiring sophisticated management tools, TD-Suite offers a comprehensive software framework specifically engineered to automate the complex task of its classification within software projects. It leverages the advanced natural language understanding of state-of-the-art transformer models to analyze textual artifacts, such as developer discussions in issue reports, where subtle indicators of debt often lie hidden. TD-Suite provides a seamless end-to-end pipeline, managing everything from initial data ingestion and rigorous preprocessing to model training, thorough evaluation, and final inference. This allows it to support both straightforward binary classification (debt or no debt) and more valuable, identifying specific categories like code, design, or documentation debt, thus enabling more targeted management strategies. To ensure the generated models are robust and perform reliably on real-world, often imbalanced, datasets, TD-Suite incorporates critical training methodologies: k-fold cross-validation assesses generalization capability, early stopping mechanisms prevent overfitting to the training data, and class weighting strategies effectively address skewed data distributions. Beyond core functionality, and acknowledging the growing importance of sustainability, the framework integrates tracking and reporting of carbon emissions associated with the computationally intensive model training process. It also features a user-friendly Gradio web interface in a Docker container setup, simplifying model interaction, evaluation, and inference.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- BEACon-TD: Classifying Technical Debt and its types across diverse software projects issues using transformersJournal of Systems and Software, 2025
- Automatic Detection and Analysis of Technical Debts in Peer-Review Documentation of R Packages2022
- The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluationBMC Genomics, 2020
- CodeBERT: A Pre-Trained Model for Programming and Natural Languages2020
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2019
- A Survey of Machine Learning for Big Code and NaturalnessACM Computing Surveys, 2018
- An empirical study on developer‐related factors characterizing fix‐inducing commitsJournal of Software: Evolution and Process, 2016
- A systematic mapping study on technical debt and its managementJournal of Systems and Software, 2015
- Sentiment analysis algorithms and applications: A surveyAin Shams Engineering Journal, 2014
- To Pay or Not to Pay Technical DebtIEEE Software, 2011