Framework for Scenario-Driven Black-Box Testing of NPC Behavior in Virtual Reality Games
Authors:
Open Access
- 22 August 2026
- journal article
- Published by Universitas Nusantara PGRI Kediri in INTENSIF: Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi
- Vol. 10 (2) , 196-211
Abstract
Background: Non-Playable Characters (NPCs) play an important role in the quality of interaction in Virtual Reality (VR) games. As NPC systems become more complex and multi-role, their behavior must be evaluated not only from a design perspective but also in terms of technical stability and interaction consistency. However, systematic methods for validating NPC behavior in VR games remain limited. Objective: This study proposes and implements a scenario-driven black-box testing framework for evaluating NPC behavior in VR games based on observable interaction outcomes. Methods: NPC behavior was evaluated using normal, boundary, and stress-based interaction scenarios. Four behavioral quality criteria were assessed: determinism, state integrity, role consistency, and recovery stability. Selected dimensions of the Game Experience Questionnaire (GEQ), namely Social Behaviour Activity and Post-game Module, were also evaluated. Results: Six test scenarios were evaluated. Four scenarios (66.7%) met all criteria, while two (33.3%) were categorized as partial due to minor delays in state transitions and temporary idle-state resets. No crashes, system failures, or fatal interaction breakdowns were observed. GEQ results indicated moderate-to-good social behavior involvement (mean = 3.3) and a comfortable post-game experience (mean = 3.5). Conclusion: The proposed framework provides a structured and reproducible approach for assessing NPC behavior in VR games without requiring access to internal implementation details. The findings highlight the importance of technical behavioral testing, as positive player experience does not necessarily indicate fully stable and consistent NPC behavior.Keywords
This publication has 36 references indexed in Scilit:
- Scenario Factory 2.0: Scenario-Based Testing of Automated Vehicles with CommonRoadAutomotive Innovation, 2025
- Automated Game Testing With Online Search Agent and Model Construction, a StudySoftware Testing, Verification and Reliability, 2025
- Non-player character decision-making in computer gamesArtificial Intelligence Review, 2023
- AI in Human-computer Gaming: Techniques, Challenges and OpportunitiesMachine Intelligence Research, 2023
- Definition, roles, and potential research issues of the metaverse in education: An artificial intelligence perspectiveComputers and Education: Artificial Intelligence, 2022
- The potential of immersive virtual reality to enhance learning: A meta-analysisEducational Research Review, 2022
- Social Presence: Conceptualization and MeasurementEducational Psychology Review, 2021
- Guidelines for Conducting Software Engineering Research2020
- A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agendaComputers & Education, 2020
- A review of immersive virtual reality serious games to enhance learning and trainingMultimedia Tools and Applications, 2019