How to Run a Successful Game-Based AI Competition
Author:
- 28 October 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Intelligence and AI in Games
- Vol. 8 (1) , 95-100
Abstract
Game-based competitions are commonly used within the Computational Intelligence (CI) and Artificial Intelligence (AI) in games community to benchmark algorithms and to attract new researchers. While many competitions have been organized based on different games, the success of these competitions is highly varied. This short paper is a self-help paper for competition organizers and aspiring competition organizers. After analyzing the fate of a number of recent competitions, some factors likely to contribute to the success or failure of a competition are laid out, and a set of concrete recommendations is offered. There is also a discussion of how to write up game-based AI competitions and what we can ultimately learn from them.Keywords
This publication has 20 references indexed in Scilit:
- A Survey of Real-Time Strategy Game AI Research and Competition in StarCraftIEEE Transactions on Computational Intelligence and AI in Games, 2013
- The Mario AI Championship 2009–2012AI Magazine, 2013
- A video game description language for model-based or interactive learning2013
- The 2010 Mario AI Championship: Level Generation TrackIEEE Transactions on Computational Intelligence and AI in Games, 2011
- The 2007 IEEE CEC simulated car racing competitionGenetic Programming and Evolvable Machines, 2008
- Ms Pac-Man competitionACM SIGEVOlution, 2007
- Checkers Is SolvedScience, 2007
- Temporal Difference Learning Versus Co-Evolution for Acquiring Othello Position Evaluation2006
- Cellz: a simple dynamic game for testing evolutionary algorithms2004
- ORTS: A Hack-Free RTS Game EnvironmentLecture Notes in Computer Science, 2003