Concurrent Subspace Width Optimization Method for RBF Neural Network Modeling
Authors:
- 26 December 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 23 (2) , 247-259
Abstract
Radial basis function neural networks (RBFNNs) are widely used in nonlinear function approximation. One of the challenges in RBFNN modeling is determining how to effectively optimize width parameters to improve approximation accuracy. To solve this problem, a width optimization method, concurrent subspace width optimization (CSWO), is proposed based on a decomposition and coordination strategy. This method decomposes the large-scale width optimization problem into several subspace optimization (SSO) problems, each of which has a single optimization variable and smaller training and validation data sets so as to greatly simplify optimization complexity. These SSOs can be solved concurrently, thus computational time can be effectively reduced. With top-level system coordination, the optimization of SSOs can converge to a consistent optimum, which is equivalent to the optimum of the original width optimization problem. The proposed method is tested with four mathematical examples and one practical engineering approximation problem. The results demonstrate the efficiency and robustness of CSWO in optimizing width parameters over the traditional width optimization methods.Keywords
This publication has 24 references indexed in Scilit:
- Improving the generalization performance of RBF neural networks using a linear regression techniqueExpert Systems with Applications, 2009
- A gradient-based sequential radial basis function neural network modeling methodNeural Computing and Applications, 2009
- A review of genetic algorithms applied to training radial basis function networksNeural Computing and Applications, 2004
- Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximationIEEE Transactions on Neural Networks, 2003
- RBF neural network, basis functions and genetic algorithm2002
- Time-series forecasting using GA-tuned radial basis functionsInformation Sciences, 2001
- Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networksIEEE Transactions on Neural Networks, 1999
- Regularized orthogonal least squares algorithm for constructing radial basis function networksInternational Journal of Control, 1996
- Universal Approximation Using Radial-Basis-Function NetworksNeural Computation, 1991
- Fast Learning in Networks of Locally-Tuned Processing UnitsNeural Computation, 1989