ME-SFP: A Mixture-of-Experts-Based Approach for Software Fault Prediction
- 27 July 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Reliability
- Vol. 73 (1) , 710-725
Abstract
In the last two decades, many machine-learning-based works have been presented to build software fault prediction (SFP) models. The assessment of all these works showed that none of the machine learning classifiers could be generalized as the best-performing classifier in all prediction contexts. However, these techniques showed complementary behavior among them, which suggests combining their learning for improved performance. Various ensemble models explored in SFP have a major concern with the static weights assigned to the base learners for combining their decisions. In this article, we present a Mixture-of-Experts (MoE)-based approach named ME-SFP that uses the experts generated using a learning technique and a Gaussian mixture model as a gating function and a data partition technique. For the experimentation using the presented approach, we have shown the use of decision trees (DTs) as well as multilayer perceptrons (MLPs) as experts. We call them ME-SFP[DT] and ME-SFP[MLP]. We conduct a set of experiments on 35 publicly available software project datasets (PROMISE, JIRA, AEEEM, and Eclipse datasets) for SFP and measure the performance of built fault prediction models by using different measures such as F1-score, precision, recall, area under ROC curve (AUC), probability of false alarm, Mathews correlation coefficient, and G-means. Additionally, we perform Friedman's test and the Wilcoxon signed-rank sum test between the presented models, ensemble methods, baseline method, and individual learning techniques (DT and MLP). Results showed that ME-SFP[DT] and ME-SFP[MLP] produced improved results compared to individual techniques and ensemble methods.Keywords
Funding Information
- SERB, Government of India
This publication has 44 references indexed in Scilit:
- Software defect prediction: do different classifiers find the same defects?Software Quality Journal, 2017
- Multiple kernel ensemble learning for software defect predictionAutomated Software Engineering, 2015
- Researcher Bias: The Use of Machine Learning in Software Defect PredictionIEEE Transactions on Software Engineering, 2014
- Multi-objective Cross-Project Defect Prediction2013
- Ensemble approaches for regressionACM Computing Surveys, 2012
- Twenty Years of Mixture of ExpertsIEEE Transactions on Neural Networks and Learning Systems, 2012
- Mixture of experts: a literature surveyArtificial Intelligence Review, 2012
- Evaluating defect prediction approaches: a benchmark and an extensive comparisonEmpirical Software Engineering, 2011
- Mixture of MLP-experts for trend forecasting of time series: A case study of the Tehran stock exchangeInternational Journal of Forecasting, 2011
- Hierarchical Mixtures of Experts and the EM AlgorithmNeural Computation, 1994