An Empirical Analysis of Three-Stage Data-Preprocessing for Analogy-Based Software Effort Estimation on the ISBSG Data
Authors:
- Jianglin HuangJHJianglin Huang
- Yan-Fu LiYLYan-Fu Li
- Jacky Wai KeungJKJacky Wai Keung
- Yuen Tak YuYYYuen Tak Yu
- W.K. ChanWCW.K. Chan
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 442-449
Abstract
Analogy-based software effort estimation is a method to estimate the project cost of an unseen project based on analogies against previous projects sharing selected features. The validity of the selected features depends on many factors, and one of most crucial factors is the effectiveness of the data-preprocessing techniques applied to the datasets of the previous projects. In this paper, we report the first controlled experiment that studies the class of three-stage data-preprocessing techniques with stages of missing data imputation, data normalization, and feature selection for analogy-based effort estimation. We conducted our investigation on the ISBSG data. The experimental results show that three-stage data-preprocessing techniques have significant impacts on the resultant effort estimation accuracy. The results also indicate that the combined use of Z-Score normalization, kNN imputation and mutual information based feature weighting can be an effective choice for analogy-based effort estimation.Keywords
This publication has 44 references indexed in Scilit:
- Ensembles and locality: Insight on improving software effort estimationInformation and Software Technology, 2013
- Kernel methods for software effort estimationEmpirical Software Engineering, 2011
- Using tabu search to configure support vector regression for effort estimationEmpirical Software Engineering, 2011
- A replicated assessment and comparison of adaptation techniques for analogy-based effort estimationEmpirical Software Engineering, 2011
- A shift-invariant morphological system for software development cost estimationExpert Systems with Applications, 2011
- LSEbA: least squares regression and estimation by analogy in a semi-parametric model for software cost estimationEmpirical Software Engineering, 2010
- A study of mutual information based feature selection for case based reasoning in software cost estimationExpert Systems with Applications, 2009
- Optimization of analogy weights by genetic algorithm for software effort estimationInformation and Software Technology, 2006
- Categorical missing data imputation for software cost estimation by multinomial logistic regressionJournal of Systems and Software, 2006
- Software cost estimation with incomplete dataIEEE Transactions on Software Engineering, 2001