Effect of the Number of Hidden Layer Neurons on the Accuracy of the Back Propagation Neural Network
Open Access
- 29 December 2023
- journal article
- research article
- Published by Darcy & Roy Press Co. Ltd. in Highlights in Science, Engineering and Technology
- Vol. 74, 462-468
Abstract
Back propagation neural network (BPNN) is one of the most basic and commonly used models in machine learning. Hidden layers play a crucial function in maximizing the performance of neural networks, especially when solving complicated issues that demand strict adherence to accuracy and time complexity requirements. The only reliable ways at the moment are just experience and attempting each situation, as the process of determining the amount of Hidden Layer neurons is still unclear. To investigate this relationship, this article conducted extensive experiments involving designing and training the BPNN model with varying numbers of hidden layer neurons. Leverage benchmark data sets and quantify accuracy with appropriate error metrics. The analysis in this article focuses on understanding the impact of different neuron counts on network performance. Under specific assumptions, the findings show a relationship between the quantity of hidden layer neurons and BPNN accuracy. According to statistics of some recent neural network applications, it can be observed that if the number of neurons in the hidden layer is decreased, it will have an effect on the network's accuracy because complex problems with a small number of hidden layers may cause the network to be incorrectly trained; However, relative to the accuracy gain, the time complexity rises orders of magnitude as the number of hidden layer neurons exceeds the ideal amount.Keywords
This publication has 11 references indexed in Scilit:
- A back propagation neural network model for accurately predicting the removal efficiency of ammonia nitrogen in wastewater treatment plants using different biological processesWater Research, 2022
- Deep physical neural networks trained with backpropagationNature, 2022
- Reliability prediction-based improved dynamic weight particle swarm optimization and back propagation neural network in engineering systemsExpert Systems with Applications, 2021
- Effects of Hidden Layers on the Efficiency of Neural networks2020
- Modeling Height–Diameter Relationship for Poplar Plantations Using Combined-Optimization Multiple Hidden Layer Back Propagation Neural NetworkForests, 2020
- Fusion Deep Learning Based on Back Propagation Neural Network for Personalization2020
- Visual interpretability for deep learning: a surveyFrontiers of Information Technology & Electronic Engineering, 2018
- Novel weighting in single hidden layer feedforward neural networks for data classificationComputers & Mathematics with Applications, 2012
- Impact of Varying Neurons and Hidden Layers in Neural Network Architecture for a Time Frequency Application2006
- Learning capability and storage capacity of two-hidden-layer feedforward networksIEEE Transactions on Neural Networks, 2003