Inspector: Pixel-Based Automated Game Testing via Exploration, Detection, and Investigation
Authors:
- 21 August 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 237-244
Abstract
Deep reinforcement learning (DRL) has attracted much attention in automated game testing. Early attempts rely on game internal information for game space exploration, thus requiring deep integration with games, which is inconvenient for practical applications. In this work, we propose using only screenshots/pixels as input for automated game testing and build a general game testing agent, Inspector, that can be easily applied to different games without deep integration with games. In addition to covering all game space for testing, our agent also tries to take human-like behaviors to interact with key objects in a game, since some bugs usually happen in player-object interactions. Inspector is based on purely pixel inputs and comprises three key modules: game space explorer, key object detector, and human-like object investigator. Game space explorer aims to explore the whole game space by using a curiosity-based reward function with pixel inputs. Key object detector aims to detect key objects in a game, based on a small number of labeled screenshots. Human-like object investigator aims to mimic human behaviors for investigating key objects via imitation learning. We conduct experiments on two popular video games: Shooter Game and Action RPG Game 1 . Experiment results demonstrate the effectiveness of Inspector in exploring game space, detecting key objects, and investigating objects. Moreover, Inspector successfully discovers two potential bugs in those two games. The demo video of Inspector is available at https://github.com/Inspector-GameTestinyInspector-GameTesting.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Automated Game Testing with ICARUS2017
- Feature Pyramid Networks for Object Detection2017
- Studying the urgent updates of popular games on the Steam platformEmpirical Software Engineering, 2016
- Critical Success Factors to Improve the Game Development Process from a Developer’s PerspectiveJournal of Computer Science and Technology, 2016
- Deep Residual Learning for Image Recognition2016
- An automated model based testing approach for platform games2015
- Automated Regression Testing within Video Game DevelopmentGSTF Journal on Computing (JoC), 2013
- A Survey of Monte Carlo Tree Search MethodsIEEE Transactions on Computational Intelligence and AI in Games, 2012
- Scenario-Based Approach for Blackbox Load Testing of Online Game Servers2010
- Efficient Training of Artificial Neural Networks for Autonomous NavigationNeural Computation, 1991