Analyzing Interpretable Visual Control Policy Search and Synthesis
Open Access
- 11 April 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Evolutionary Learning and Optimization
Abstract
Vision-based decision-making is relevant to many domains, including safety-critical ones where transparency matters as much as performance. Therefore, automating sequential decision making in such settings requires approaches that balance effectiveness with interpretability. While deep reinforcement learning techniques based on artificial neural networks have achieved strong performance, their black-box nature typically necessitates post hoc explainability analyses. To address this limitation, we propose an approach based on Graph-based Genetic Programming (GGP) that generates policies in the form of computer code, which is fully observable and inherently interpretable. To improve both performance and robustness, we expose GGP-based visual control policies to multiple representative conditions during optimization, mitigating convergence to strong local optima and fragility under changing conditions. Finally, to gain insights into the evolutionary search dynamics, we employ Search Trajectory Networks, an analytical and visualization tool for studying optimization behavior. Our results demonstrate that the resulting policies approach human-level performance and empirically confirm the presence of strong local optima acting as attractors during evolution, providing new insights into the behavior and potential limitations of interpretable evolutionary policy search approaches.Keywords
This publication has 43 references indexed in Scilit:
- Multimodal Adaptive Graph Evolution for Program Synthesis2024
- A survey on interpretable reinforcement learningMachine Learning, 2024
- GP for Continuous Control: Teacher or Learner? The Case of Simulated Modular Soft Robots2024
- Quality–diversity optimization of decision trees for interpretable reinforcement learningNeural Computing and Applications, 2023
- Evolving hierarchical memory-prediction machines in multi-task reinforcement learningGenetic Programming and Evolvable Machines, 2021
- Search trajectory networks: A tool for analysing and visualising the behaviour of metaheuristicsApplied Soft Computing, 2021
- Explanation in artificial intelligence: Insights from the social sciencesArtificial Intelligence, 2019
- Robotic surgeryBritish Journal of Surgery, 2015
- Visualizing and Understanding Convolutional Networks2014
- Cartesian Genetic Programming2000