Improving the Generalization Abilities of Constructed Neural Networks with the Addition of Local Optimization Techniques
Open Access
- 6 October 2024
- journal article
- research article
- Published by MDPI AG in Algorithms
- Vol. 17 (10) , 446
Abstract
Constructed neural networks with the assistance of grammatical evolution have been widely used in a series of classification and data-fitting problems recently. Application areas of this innovative machine learning technique include solving differential equations, autism screening, and measuring motor function in Parkinson’s disease. Although this technique has given excellent results, in many cases, it is trapped in local minimum and cannot perform satisfactorily in many problems. For this purpose, it is considered necessary to find techniques to avoid local minima, and one technique is the periodic application of local minimization techniques that will adjust the parameters of the constructed artificial neural network while maintaining the already existing architecture created by grammatical evolution. The periodic application of local minimization techniques has shown a significant reduction in both classification and data-fitting problems found in the relevant literature.Keywords
Funding Information
- European Union (TAEDK-06195)
This publication has 82 references indexed in Scilit:
- Particle swarm grammatical evolution for energy demand estimationEnergy Science & Engineering, 2019
- Handbook of Grammatical Evolution2018
- Optimizing connection weights in neural networks using the whale optimization algorithmSoft Computing, 2016
- Evolving a Ms. PacMan Controller Using Grammatical Evolution2010
- Genetic Programming1999
- Genetic Programming1998
- Smoothing Methods in Statistics1996
- Modeling cognitive development on balance scale phenomenaMachine Learning, 1994
- A tolerant algorithm for linearly constrained optimization calculationsMathematical Programming, 1989
- On the limited memory BFGS method for large scale optimizationMathematical Programming, 1989