Bug numbers matter: An empirical study of effort‐aware defect prediction using class labels versus bug numbers
- 10 July 2024
- journal article
- research article
- Published by Wiley in Software: Practice and Experience
- Vol. 55 (1) , 49-78
Abstract
Previous research have utilized public software defect datasets such as NASA, RELINK, and SOFTLAB, which only contain class label information. Most effort‐aware defect prediction (EADP) studies are carried out around these datasets. However, EADP studies typically relying on predicted bug number (i.e., considering modules as effort) or density (i.e., considering lines of code as effort) for ranking software modules. To explore the impact of bug number information in constructing EADP models, we access the performance degradation of the best‐performing learning‐to‐rank methods when using class labels instead of bug numbers for training. The experimental results show that using class labels instead of bug numbers in building EADP models results in an decrease in the detected bugs when module is considering as effort. When effort is LOC, using class labels to construct EADP models can lead to a significant increase in the initial false alarms and a significant increase in the modules that need to be inspected. Therefore, we recommend not only the class labels but also the bug number information should be disclosed when publishing software defect datasets, in order to construct more accurate EADP models.Keywords
Funding Information
- National Natural Science Foundation of China (62202350, 61977021)
- Natural Science Foundation of Chongqing Municipality (cstc2021jcyj‐msxmX1115)
This publication has 77 references indexed in Scilit:
- IMDAC: A robust intelligent software defect prediction model via multi‐objective optimization and end‐to‐end hybrid deep learning networksSoftware: Practice and Experience, 2023
- Feature transfer learning by reinforcement learning for detecting software defectSoftware: Practice and Experience, 2022
- Just‐in‐time defect prediction for software hunksSoftware: Practice and Experience, 2021
- Software effort estimation accuracy prediction of machine learning techniques: A systematic performance evaluationSoftware: Practice and Experience, 2021
- Software fault prediction using Whale algorithm with genetics algorithmSoftware: Practice and Experience, 2020
- Predicting just‐in‐time software defects to reduce post‐release quality costs in the maritime industrySoftware: Practice and Experience, 2020
- Software fault prediction using particle swarm algorithm with genetic algorithm and support vector machine classifierSoftware: Practice and Experience, 2020
- Effort-Aware Tri-Training for Semi-supervised Just-in-Time Defect Prediction2019
- Testing and Code Review Based Effort-Aware Bug Prediction Model2016
- Ridge Regression in Prediction Problems: Automatic Choice of the Ridge ParameterGenetic Epidemiology, 2013