Towards Explainable Metaheuristics: Feature Mining of Search Trajectories through Principal Component Projection
Open Access
- 30 May 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Evolutionary Learning and Optimization
- Vol. 5 (2) , 1-30
Abstract
While population-based metaheuristics have proven useful for refining and improving explainable AI systems, they are seldom the focus of explanatory approaches themselves. This stems from their inherently stochastic, population-driven searches, which complicate the use of standard explainability techniques. In this article, we present a method to identify which decision variables have the greatest impact during an algorithm’s trajectory from random initialsation to convergence. We apply Principal Component Analysis to project each population onto a lower-dimensional space, then introduce two metrics—Mean Variable Contribution and Proportion of Aligned Variables—to identify the variables most responsible for guiding the search. Using four different population-based methods (Particle Swarm Optimisation, Genetic Algorithm, Differential Evolution, and Covariance Matrix Adaptation Evolution Strategy) on 24 BBOB benchmark functions in 10 dimensions, we find that these metrics highlight meaningful variable relationships and provide a window into each method’s search dynamics. By comparing the features extracted across algorithms and problems, we illustrate how certain variable subsets consistently drive major improvements in solution quality. In doing so, new evolutionary algorithm variants can be designed to take advantage of these influential variables, while also identifying underutilised variables that may benefit alternative search strategies.Keywords
Funding Information
- The National Subsea Centre, Robert Gordon University, The Data Lab, and BT Group PLC
This publication has 35 references indexed in Scilit:
- Trajectory-based Algorithm Selection with Warm-starting2022
- Search trajectory networks: A tool for analysing and visualising the behaviour of metaheuristicsApplied Soft Computing, 2021
- Population size in Particle Swarm OptimizationSwarm and Evolutionary Computation, 2020
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020
- Pymoo: Multi-Objective Optimization in PythonIEEE Access, 2020
- Differential evolution with adaptive mechanism of population size according to current population diversitySwarm and Evolutionary Computation, 2019
- Evolutionary Fuzzy Systems for Explainable Artificial Intelligence: Why, When, What for, and Where to?IEEE Computational Intelligence Magazine, 2019
- Surrogate-assisted evolutionary computation: Recent advances and future challengesSwarm and Evolutionary Computation, 2011
- Differential Evolution: A Survey of the State-of-the-ArtIEEE Transactions on Evolutionary Computation, 2010
- Rule extraction from trained neural networks using genetic algorithmsNonlinear Analysis, 1997