Rolling Horizon Evolutionary Algorithms for General Video Game Playing
- 18 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Games
- Vol. 14 (2) , 232-242
Abstract
Game-playing evolutionary algorithms, specifically rolling horizon evolutionary algorithms (RHEA), have recently managed to beat the state of the art in win rate across many video games. However, the best results in a game are highly dependent on the specific configuration of modifications introduced over several papers, each adding additional parameters to the core algorithm. Furthermore, the best previously published parameters have been found from only a few human-picked combinations, as the possibility space has grown beyond exhaustive search. This article presents the state of the art in RHEA, combining all modifications described in the literature, as well as new ones. We then use a parameter optimizer, the $N$ -tuple bandit evolutionary algorithm, to find the best combination of parameters in 20 games from the general video game Artificial Intelligence (AI) framework. Furthermore, we analyze the algorithm’s parameters and some interesting combinations revealed through the optimization process. Finally, we find new state of the art solutions on several games by automatically exploring the large parameter space of RHEA.Keywords
All Related Versions
Funding Information
- EPSRC CDT (EP/L015846/1)
This publication has 28 references indexed in Scilit:
- Playing Multiaction Adversarial Games: Online Evolutionary Planning Versus Tree SearchIEEE Transactions on Games, 2017
- General video game rule generation2017
- General video game playing escapes the no free lunch theorem2017
- Rolling horizon evolution enhancements in general video game playing2017
- Population seeding techniques for Rolling Horizon Evolution in General Video Game Playing2017
- The N-Tuple bandit evolutionary algorithm for automatic game improvement2017
- Analysis of Vanilla Rolling Horizon Evolution Parameters in General Video Game Playing2017
- Investigating vanilla MCTS scaling on the GVG-AI game corpus2016
- General Video Game Level Generation2016
- Rolling horizon evolution versus tree search for navigation in single-player real-time games2013