Evaluation of Parameter Settings for Training Neural Networks Using Backpropagation Algorithms
Authors:
- 1 January 2022
- book chapter
- Published by IGI Global Scientific Publishing
- p. 202-226
Abstract
Artificial neural networks (ANN) are widely used for classification, and the training algorithm commonly used is the backpropagation (BP) algorithm. The major bottleneck faced in the backpropagation neural network training is in fixing the appropriate values for network parameters. The network parameters are initial weights, biases, activation function, number of hidden layers and the number of neurons per hidden layer, number of training epochs, learning rate, minimum error, and momentum term for the classification task. The objective of this work is to investigate the performance of 12 different BP algorithms with the impact of variations in network parameter values for the neural network training. The algorithms were evaluated with different training and testing samples taken from the three benchmark clinical datasets, namely, Pima Indian Diabetes (PID), Hepatitis, and Wisconsin Breast Cancer (WBC) dataset obtained from the University of California Irvine (UCI) machine learning repository.Keywords
This publication has 35 references indexed in Scilit:
- An improved backpropagation algorithm to avoid the local minima problemNeurocomputing, 2004
- A class +1 sigmoidal activation functions for FFANNsJournal of Economic Dynamics and Control, 2003
- A three-term backpropagation algorithmNeurocomputing, 2003
- Learning efficiency improvement of back-propagation algorithm by error saturation prevention methodNeurocomputing, 2001
- A weight initialization method for improving training speed in feedforward neural networkNeurocomputing, 2000
- Parameter estimation using artificial neural network and genetic algorithm for free‐product migration and recoveryWater Resources Research, 1998
- Efficient Backpropagation Learning Using Optimal Learning Rate and MomentumNeural Networks, 1997
- An Adaptive Momentum Back Propagation (AMBP)Neural Computing and Applications, 1995
- Learning representations by back-propagating errorsNature, 1986
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958