Stalling in Space: Attractor Analysis for any Algorithm
Preprint
Abstract
Network-based representations of fitness landscapes have grown in popularity in the past decade; this is probably because of growing interest in explainability for optimisation algorithms. Local optima networks (LONs) have been especially dominant in the literature and capture an approximation of local optima and their connectivity in the landscape. However, thus far, LONs have been constructed according to a strict definition of what a local optimum is: the result of local search. Many evolutionary approaches do not include this, however. Popular algorithms such as CMA-ES have therefore never been subject to LON analysis. Search trajectory networks (STNs) offer a possible alternative: nodes can be any search space location. However, STNs are not typically modelled in such a way that models temporal stalls: that is, a region in the search space where an algorithm fails to find a better solution over a defined period of time. In this work, we approach this by systematically analysing a special case of STN which we name attractor networks. These offer a coarse-grained view of algorithm behaviour with a singular focus on stall locations. We construct attractor networks for CMA-ES, differential evolution, and random search for 24 noiseless black-box optimisation benchmark problems. The properties of attractor networks are systematically explored. They are also visualised and compared to traditional LONs and STN models. We find that attractor networks facilitate insights into algorithm behaviour which other models cannot, and we advocate for the consideration of attractor analysis even for algorithms which do not include local search.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- Scalable Local Optima Networks for Continuous Search Spaces2025
- New solutions to Cooke triplet problem via analysis of attraction basins2023
- Modular Differential Evolution2023
- Search trajectory networks: A tool for analysing and visualising the behaviour of metaheuristicsApplied Soft Computing, 2021
- Tuning as a means of assessing the benefits of new ideas in interplay with existing algorithmic modules2021
- COCO: a platform for comparing continuous optimizers in a black-box settingOptimization Methods and Software, 2020
- Iterated Maps on the Interval as Dynamical Systems2009
- A Restart CMA Evolution Strategy With Increasing Population Size2005
- Completely Derandomized Self-Adaptation in Evolution StrategiesEvolutionary Computation, 2001
- On the concept of attractorCommunications in Mathematical Physics, 1985