Evolving Effective Microbehaviors in Real-Time Strategy Games
Open Access
- 22 March 2016
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Intelligence and AI in Games
- Vol. 8 (4) , 351-362
Abstract
We investigate heuristic search algorithms to generate high-quality micromanagement in combat scenarios for real-time strategy (RTS) games. Macro- and micromanagement are two key aspects of RTS games. While good macro helps a player collect more resources and build more units, good micro helps a player win skirmishes and battles against equal numbers and types of opponent units or win even when outnumbered. In this paper, we use influence maps and potential fields as a basis representation to evolve short-term positioning and movement tactics. Unit microbehaviors in combat are compactly encoded into 14 parameters. A genetic algorithm evolves good microbehaviors by manipulating these 14 parameters. We compared the performance of our evolved ECSLBot with two other state-of-the-art bots, UAlbertaBot and Nova, on several skirmish scenarios in a popular RTS game StarCraft. The results show that the ECSLBot tuned by genetic algorithms outperforms UAlbertaBot and Nova in kiting efficiency, target selection, and fleeing. Further experiments show that the parameter values evolved in one scenario work well in other scenarios and that we can switch between preevolved parameter sets to perform well in unseen scenarios containing more than one type of opponent unit. We believe our representation and approach applied to each unit type of interest can result in effective microperformance against melee and ranged opponents and provides a viable approach toward complete RTS bots.Keywords
Funding Information
- National Science Foundation (IIA-1301726)
- Office of Naval Research (N00014-12-1-0860, N00014-12-C-0522)
This publication has 18 references indexed in Scilit:
- Using CIGAR for finding effective group behaviors in RTS game2013
- Coevolving influence maps for spatial team tactics in a RTS game2010
- Towards Intelligent Team Composition and Maneuvering in Real-Time Strategy GamesIEEE Transactions on Computational Intelligence and AI in Games, 2010
- A data mining approach to strategy prediction2009
- Intelligent moving of groups in real-time strategy games2008
- Evolving neural NPCs with layered influence map in the real-time simulation game ‘Conqueror’2008
- Learning from Demonstration and Case-Based Planning for Real-Time Strategy Games2008
- Co-Evolving Influence Map Tree Based Strategy Game Players2007
- Combining Influence Maps and Cellular Automata for Reactive Game Agents2005
- The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination1991