Response surface methodology to tune artificial neural network hyper‐parameters
- 10 August 2021
- journal article
- research article
- Published by Wiley in Expert Systems
- Vol. 38 (8) , e12792
Abstract
Artificial neural network is a machine learning algorithm that has been widely used in many application areas. The performance of the algorithm depends on the type of the problem, the size of the problem, and the architecture of the algorithm. One of the most important things that affect ANN's performance is the selection of hyper‐parameters, but there is not a specific rule to determine the hyper‐parameters of the algorithm. Although there is no single well‐known method in hyper‐parameter tuning, this issue has been discussed in many studies. In this study, a central composite design which is a successful response surface methodology technique that considers factor interactions is used for hyper‐parameter optimization. A categorical central composite design that has 39 experimental runs was used to predict accuracy and F‐score. The effect of ANN hyper‐parameters on selected performance indicators is investigated using two different size customer churn prediction data set, which is widely used in the literature. Using the desirability functions, multiple objectives are combined and the best hyper‐parameter levels are selected. As a result of verification tests, the accuracy values are 85.79% and 83.29% for the first and second data set, respectively. And, the F‐score values are 86.15% and 82.33% for the first and second data set, respectively. The results show the effectiveness of the adopted RSM technique.Keywords
This publication has 38 references indexed in Scilit:
- Lead and nickel biosorption with a fungal biomass isolated from metal mine drainage: Box–Behnken experimental designInternational Journal of Environmental Science and Technology, 2013
- A Survey on Churn Prediction Techniques in Communication SectorInternational Journal of Computer Applications, 2013
- A Neural Network based Approach for Predicting Customer Churn in Cellular Network ServicesInternational Journal of Computer Applications, 2011
- Parameter tuning for configuring and analyzing evolutionary algorithmsSwarm and Evolutionary Computation, 2011
- A Comparative Study of Neural Networks and Non-Parametric Regression Models for Trend and Seasonal Time SeriesTrends in Applied Sciences Research, 2009
- Response surface methodology (RSM) as a tool for optimization in analytical chemistryTalanta, 2008
- Design of Experiments for Performance Evaluation and Parameter Tuning of a Road Image Processing ChainEURASIP Journal on Advances in Signal Processing, 2006
- Strategies for preventing defection based on the mean time to defection and their implementations on a self-organizing mapExpert Systems, 2005
- Asymptotic Behaviors of Support Vector Machines with Gaussian KernelNeural Computation, 2003
- Neural networks for classification: a surveyIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2000