Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic Review
Open Access
- 30 June 2023
- journal article
- review article
- Published by MDPI AG in Algorithms
- Vol. 16 (7) , 323
Abstract
Reinforcement Learning is one of the many machine learning paradigms. With no labelled data, it is concerned with balancing the exploration and exploitation of an environment with one or more agents present in it. Recently, many breakthroughs have been made in the creation of these agents for video game machine learning development, especially in first-person shooters with platforms such as ViZDoom, DeepMind Lab, and Unity’s ML-Agents. In this paper, we review the state-of-the-art of creation of Reinforcement Learning agents for use in multiplayer deathmatch first-person shooters. We selected various platforms, frameworks, and training architectures from various papers and examined each of them, analysing their uses. We compared each platform and training architecture, and then concluded whether machine learning agents can now face off against humans and whether they make for better gameplay than traditional Artificial Intelligence. In the end, we thought about future research and what researchers should keep in mind when exploring and testing this area.Keywords
Funding Information
- national funds (UIDB/05549/2020, UIDP/05549/2020, NORTE-01-0145-FEDER-000045)
- Norte Portugal Regional Operational Program (NORTE 2020) (UIDB/05549/2020, UIDP/05549/2020, NORTE-01-0145-FEDER-000045)
This publication has 29 references indexed in Scilit:
- A general reinforcement learning algorithm that masters chess, shogi, and Go through self-playScience, 2018
- ViZDoom Competitions: Playing Doom From PixelsIEEE Transactions on Games, 2018
- Evaluating Competition in Training of Deep Reinforcement Learning Agents in First-Person Shooter Games2018
- Learning Battles in ViZDoom via Deep Reinforcement Learning2018
- Encyclopedia of Machine Learning and Data Mining2017
- ViZDoom: A Doom-based AI research platform for visual reinforcement learning2016
- Mastering the game of Go with deep neural networks and tree searchNature, 2016
- Human-level control through deep reinforcement learningNature, 2015
- Reinforcement Learning in First Person Shooter GamesIEEE Transactions on Computational Intelligence and AI in Games, 2010
- Formal methodsACM Computing Surveys, 1996