Using Ensembles for Class-Imbalance Problem to Predict Maintainability of Open Source Software
Authors:
- 6 March 2020
- journal article
- conference paper
- Published by World Scientific Pub Co Pte Ltd in International Journal of Reliability, Quality and Safety Engineering
- Vol. 27 (05)
Abstract
To facilitate software maintenance and save the maintenance cost, numerous machine learning (ML) techniques have been studied to predict the maintainability of software modules or classes. An abundant amount of effort has been put by the research community to develop software maintainability prediction (SMP) models by relating software metrics to the maintainability of modules or classes. When software classes demanding the high maintainability effort (HME) are less as compared to the low maintainability effort (LME) classes, the situation leads to imbalanced datasets for training the SMP models. The imbalanced class distribution in SMP datasets could be a dilemma for various ML techniques because, in the case of an imbalanced dataset, minority class instances are either misclassified by the ML techniques or get discarded as noise. The recent development in predictive modeling has ascertained that ensemble techniques can boost the performance of ML techniques by collating their predictions. Ensembles themselves do not solve the class-imbalance problem much. However, aggregation of ensemble techniques with the certain techniques to handle class-imbalance problem (e.g., data resampling) has led to several proposals in research. This paper evaluates the performance of ensembles for the class-imbalance in the domain of SMP. The ensembles for class-imbalance problem (ECIP) are the modification of ensembles which pre-process the imbalanced data using data resampling before the learning process. This study experimentally compares the performance of several ECIP using performance metrics Balance and g-Mean over eight Apache software datasets. The results of the study advocate that for imbalanced datasets, ECIP improves the performance of SMP models as compared to classic ensembles.Keywords
This publication has 51 references indexed in Scilit:
- Cost-sensitive boosting neural networks for software defect predictionExpert Systems with Applications, 2010
- Predicting object-oriented software maintainability using multivariate adaptive regression splinesJournal of Systems and Software, 2007
- An application of Bayesian network for predicting object-oriented software maintainabilityInformation and Software Technology, 2006
- Learning from imbalanced data sets with boosting and data generationACM SIGKDD Explorations Newsletter, 2004
- A study of the behavior of several methods for balancing machine learning training dataACM SIGKDD Explorations Newsletter, 2004
- EditorialACM SIGKDD Explorations Newsletter, 2004
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- A metrics suite for object oriented designIEEE Transactions on Software Engineering, 1994
- Object-oriented metrics that predict maintainabilityJournal of Systems and Software, 1993
- Some Practical Issues of Experimental Design and Data Analysis in Radiological ROC StudiesInvestigative Radiology, 1989