An Uncertainty-Incorporated Approach to Predict the Winner in StarCraft II Using Neural Processes
Authors:
Open Access
- 25 July 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 101609-101619
Abstract
Real-time strategy (RTS) game is a kind of strategy game, in which the players compete for resources on 2D terrain by establishing the economy, training army, and guiding them into battle in real time. The winner prediction of the RTS games often involves studying a highly uncertain problem in an adversarial environment. In addition, the limit of the number of samples restricts on the application and performance of the prediction models. To obtain better winner prediction accuracy and maintain the prediction uncertainty under an adversarial environment, this paper proposes a neural network-based prediction method incorporated probability inference dealing with a small set of samples. This paper uses a dataset released based on SC2LE, a reinforcement learning environment released jointly by Blizzard Entertainment and DeepMind, and then employed the proposed neural processes model to build a winner prediction model. To verify, this paper implemented different features types' grouping and different game length grouping experiments for demonstrating better adaptability to such problems. Furthermore, this paper also implemented the SVM model experiments and compared the proposed method with the SVM model. Finally, when making predictions on a 1000 size testing data, the results show that the proposed prediction model achieves an accuracy of 0.811 at 200 and 0.821 at 1000 sizes of training sets, which is better than the SVM model with small training datasets.Keywords
Funding Information
- National Natural Science Foundation of China (14BTQ034)
This publication has 16 references indexed in Scilit:
- A Pattern Mining Approach to Study Strategy Balance in RTS GamesIEEE Transactions on Computational Intelligence and AI in Games, 2015
- Multiscale Bayesian Modeling for RTS Games: An Application to StarCraft AIIEEE Transactions on Computational Intelligence and AI in Games, 2015
- Building behavior trees from observations in real-time strategy games2015
- Testing reliability of replay-based imitation for StarCraft2015
- Reinforcement learning agents providing advice in complex video gamesConnection Science, 2014
- Combining Case-Based Reasoning and Reinforcement Learning for Unit Navigation in Real-Time Strategy Game AI2014
- The Bayesian method for causal discovery of latent-variable models from a mixture of experimental and observational dataComputational Statistics & Data Analysis, 2012
- A Bayesian model for opening prediction in RTS games with application to StarCraft2011
- Latent Variable Modelling: A Survey*Scandinavian Journal of Statistics, 2007
- Latent Variable Models and Factor AnalysisTechnometrics, 2001