A Gradient-based Method for Differential Evolution Parameter Control by Smoothing
Open Access
- 14 July 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 423-426
Abstract
Differential evolution (DE) is one of the most studied algorithms in evolutionary computation. However, the parameters in DE need to be tuned carefully, which costs much computational resources. The reason is that the basic paradigm of DE (mutation, crossover, bound constraint and selection) contains non-differentiable operators. In this paper, we propose a DE paradigm called "smoDE" for the first time by smoothing the crossover operator and the bound constraint operator to make them differentiable with respect to the parameters. The experiments show that we can tune the parameters of smoDE by gradient descent with much fewer computational resources than commonly used tools such as the Bayesian optimization algorithm (BOA). Then we analyze the population diversity of smoDE theoretically and prove that smoDE can converge faster than DE. A simple experiment also validates that. We further propose the "ada-smoDE" by embedding a neural network in smoDE to output parameters of smoDE adaptively and test ada-smoDE on the CEC 2018 test suite. The results show that ada-smoDE can perform competitively on the whole test suite and significantly better than DE on some problems.Keywords
Funding Information
- National Natural Science Foundation of China (T2341003, 62076197)
- Key Research and Development Project of Shaanxi Province (2022GXLH-01-15)
- Sichuan Science and Technology Program (2022NSFSC1907)
This publication has 19 references indexed in Scilit:
- Controlling Sequential Hybrid Evolutionary Algorithm by Q-Learning [Research Frontier] [Research Frontier]IEEE Computational Intelligence Magazine, 2023
- Learning to Mutate for Differential Evolution2021
- Real-Parameter Unconstrained Optimization Based on Enhanced AGDE Algorithm2018
- Towards an Adaptive CMA-ES Configurator2018
- Improving the search performance of SHADE using linear population size reduction2014
- Sequential Model-Based Optimization for General Algorithm Configuration2011
- JADE: Adaptive Differential Evolution With Optional External ArchiveIEEE Transactions on Evolutionary Computation, 2009
- Natural Evolution Strategies2008
- A new optimizer using particle swarm theory2002
- Stochastic resonanceReviews of Modern Physics, 1998