Comparison of Artificial Neural Network Architecture in Solving Ordinary Differential Equations
Authors:
Open Access
- 15 December 2013
- journal article
- research article
- Published by Hindawi Limited in Advances in Artificial Neural Systems
- Vol. 2013, 1-12
Abstract
This paper investigates the solution of Ordinary Differential Equations (ODEs) with initial conditions using Regression Based Algorithm (RBA) and compares the results with arbitrary- and regression-based initial weights for different numbers of nodes in hidden layer. Here, we have used feed forward neural network and error back propagation method for minimizing the error function and for the modification of the parameters (weights and biases). Initial weights are taken as combination of random as well as by the proposed regression based model. We present the method for solving a variety of problems and the results are compared. Here, the number of nodes in hidden layer has been fixed according to the degree of polynomial in the regression fitting. For this, the input and output data are fitted first with various degree polynomials using regression analysis and the coefficients involved are taken as initial weights to start with the neural training. Fixing of the hidden nodes depends upon the degree of the polynomial. For the example problems, the analytical results have been compared with neural results with arbitrary and regression based weights with four, five, and six nodes in hidden layer and are found to be in good agreement.Keywords
Funding Information
- Department of Science and Technology, Government of India
This publication has 23 references indexed in Scilit:
- Unsupervised kernel least mean square algorithm for solving ordinary differential equationsNeurocomputing, 2011
- Comparison of generalization ability on solving differential equations using backpropagation and reformulated radial basis function networksNeurocomputing, 2009
- Numerical solution for high order differential equations using a hybrid neural network—Optimization methodApplied Mathematics and Computation, 2006
- Solving differential equations with unsupervised neural networksChemical Engineering and Processing - Process Intensification, 2003
- Multilayer neural networks for solving a class of partial differential equationsNeural Networks, 2000
- Neural-network methods for boundary value problems with irregular boundariesIEEE Transactions on Neural Networks, 2000
- Artificial neural networks for solving ordinary and partial differential equationsIEEE Transactions on Neural Networks, 1998
- Solution of nonlinear ordinary differential equations by feedforward neural networksMathematical and Computer Modelling, 1994
- The numerical solution of linear ordinary differential equations by feedforward neural networksMathematical and Computer Modelling, 1994
- Neural algorithm for solving differential equationsJournal of Computational Physics, 1990