On the value of filter feature selection techniques in homogeneous ensembles effort estimation
- 30 March 2021
- journal article
- research article
- Published by Wiley in Journal of Software: Evolution and Process
- Vol. 33 (6) , e2343
Abstract
Software development effort estimation (SDEE) remains as the principal activity in software project management planning. Over the past four decades, several methods have been proposed to estimate the effort required to develop a software system, including more recently machine learning (ML) techniques. Because ML performance accuracy depends on the features that feed the ML technique, selecting the appropriate features in the preprocessing data step is important. This paper investigates three filter feature selection techniques to check the predictive capability of four single ML techniques:K‐nearest neighbor, support vector regression, multilayer perceptron, and decision trees and their homogeneous ensembles over six well‐known datasets. Furthermore, the single and ensembles techniques were optimized using the grid search optimization method. The results suggest that the three filter feature selection techniques investigated improve the reasonability and the accuracy performance of the four single techniques. Moreover, the homogeneous ensembles are statistically more accurate than the single techniques. Finally, adopting a random process (i.e., random subspace method) to select the inputs feature for ML technique is not always effective to generate an accurate homogeneous ensemble.Keywords
This publication has 76 references indexed in Scilit:
- Ensembles and locality: Insight on improving software effort estimationInformation and Software Technology, 2013
- A review of feature selection methods on synthetic dataKnowledge and Information Systems, 2012
- Using tabu search to configure support vector regression for effort estimationEmpirical Software Engineering, 2011
- The WEKA data mining softwareACM SIGKDD Explorations Newsletter, 2009
- The random subspace method for constructing decision forestsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- A comparison of software effort estimation techniques: Using function points with neural networks, case-based reasoning and regression modelsJournal of Systems and Software, 1997
- Estimating software project effort using analogiesIEEE Transactions on Software Engineering, 1997
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- Robust regression for developing software estimation modelsJournal of Systems and Software, 1994
- On a Test of Whether one of Two Random Variables is Stochastically Larger than the OtherThe Annals of Mathematical Statistics, 1947