The N-Tuple bandit evolutionary algorithm for automatic game improvement
Open Access
- 1 June 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2201-2208
Abstract
This paper describes a new evolutionary algorithm that is especially well suited to AI-Assisted Game Design. The approach adopted in this paper is to use observations of AI agents playing the game to estimate the game's quality. Some of best agents for this purpose are General Video Game AI agents, since they can be deployed directly on a new game without game-specific tuning; these agents tend to be based on stochastic algorithms which give robust but noisy results and tend to be expensive to run. This motivates the main contribution of the paper: the development of the novel N-Tuple Bandit Evolutionary Algorithm, where a model is used to estimate the fitness of unsampled points and a bandit approach is used to balance exploration and exploitation of the search space. Initial results on optimising a Space Battle game variant suggest that the algorithm offers far more robust results than the Random Mutation Hill Climber and a Biased Mutation variant, which are themselves known to offer competitive performance across a range of problems. Subjective observations are also given by human players on the nature of the evolved games, which indicate a preference towards games generated by the N-Tuple algorithm.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- General Video Game for 2 players: Framework and competition2016
- Automated Maze Generation for Ms. Pac-Man Using Genetic AlgorithmsInternational Journal of Machine Learning and Computing, 2016
- Towards generating arcade game rules with VGDL2015
- A First Step towards the Runtime Analysis of Evolutionary Algorithm Adjusted with Reinforcement Learning2013
- A Survey of Monte Carlo Tree Search MethodsIEEE Transactions on Computational Intelligence and AI in Games, 2012
- Search-Based Procedural Content Generation: A Taxonomy and SurveyIEEE Transactions on Computational Intelligence and AI in Games, 2011
- An experiment in automatic game design2008
- Towards Automated Game Design2007
- Towards Generation of Complex Game Worlds2006
- Representations for Genetic and Evolutionary Algorithms2006