The N-Tuple Bandit Evolutionary Algorithm for Automatic Game Improvement
Preprint
Abstract
This paper describes a new evolutionary algorithm that is especially well suited to AI-Assisted Game Design. The approach adopted in this paper is to use observations of AI agents playing the game to estimate the game's quality. Some of best agents for this purpose are General Video Game AI agents, since they can be deployed directly on a new game without game-specific tuning; these agents tend to be based on stochastic algorithms which give robust but noisy results and tend to be expensive to run. This motivates the main contribution of the paper: the development of the novel N-Tuple Bandit Evolutionary Algorithm, where a model is used to estimate the fitness of unsampled points and a bandit approach is used to balance exploration and exploitation of the search space. Initial results on optimising a Space Battle game variant suggest that the algorithm offers far more robust results than the Random Mutation Hill Climber and a Biased Mutation variant, which are themselves known to offer competitive performance across a range of problems. Subjective observations are also given by human players on the nature of the evolved games, which indicate a preference towards games generated by the N-Tuple algorithm.Keywords
All Related Versions
This publication has 4 references indexed in Scilit:
- Bandit-based Random Mutation Hill-Climbing2017
- Automated Maze Generation for Ms. Pac-Man Using Genetic AlgorithmsInternational Journal of Machine Learning and Computing, 2016
- Automated Map Generation for the Physical Traveling Salesman ProblemIEEE Transactions on Evolutionary Computation, 2013
- A Survey of Monte Carlo Tree Search MethodsIEEE Transactions on Computational Intelligence and AI in Games, 2012