An Optimized Continuous Dragonfly Algorithm Using Hill Climbing Local Search to Tackle the Low Exploitation Problem
Open Access
- 6 September 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 95030-95045
Abstract
Optimization problems are usually solved using heuristic algorithms such as swarm intelligence algorithms owing to their ability of providing near-optimal solutions in a feasible amount of time. An example of an optimization problem is the training of artificial neural networks to obtain the most optimal connection weights. Artificial Neural Network (ANN), being the most prominent machine learning algorithm, has a multitude of applications in a myriad of areas. Recently, the use of ANNs has risen exponentially owing to its effective ability of making conclusions based on certain inputs. This ability is primarily achieved during the training phase of the ANN, which is a vital process prior to being able to use the ANN. Gradient descent-based algorithms, which are usually used for the training process, often encounter the problem of local optima, thus being unable to obtain the optimal connection weights of the ANN. Metaheuristic algorithms, including swarm intelligence algorithms, have been found to be a better alternative to train ANNs. The Dragonfly Algorithm (DA) is a swarm intelligence algorithm that has been found to be more effective than multiple swarm intelligence algorithms. However, despite having a good performance, it still suffers from low exploitation. In this paper, we propose to further improve the performance of DA by using hill climbing as a local search technique so as to enhance its low exploitation. The optimized DA algorithm is then used for training artificial neural networks which are employed for classification problems. Based on the experimental results, the optimized DA algorithm has higher effectiveness than the original DA and some other swarm intelligence algorithms as the ANNs trained by the optimized DA have a lower root mean squared error and a higher classification accuracy.Keywords
Funding Information
- Sunway University Internal Grant Scheme (GRTIN-IGS-DCIS[S]-11-2022)
This publication has 46 references indexed in Scilit:
- Hybridizing cuckoo search algorithm with hill climbing for numerical optimization problems2017
- Metaheuristic design of feedforward neural networks: A review of two decades of researchEngineering Applications of Artificial Intelligence, 2017
- Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigmKnowledge-Based Systems, 2015
- Dragonfly algorithm: a new meta-heuristic optimization technique for solving single-objective, discrete, and multi-objective problemsNeural Computing and Applications, 2015
- University course timetabling using hybridized artificial bee colony with hill climbing optimizerJournal of Computational Science, 2014
- Grey Wolf OptimizerAdvances in Engineering Software, 2014
- An adaptive artificial bee colony and late-acceptance hill-climbing algorithm for examination timetablingJournal of Scheduling, 2013
- Particle Swarm Optimization and Hill Climbing for the bandwidth minimization problemApplied Intelligence, 2007
- Hill‐climbing Search2006
- Ant colony optimization with hill climbing for the bandwidth minimization problemApplied Soft Computing, 2005