User Experience With Dynamic Difficulty Adjustment Methods for an Affective Exergame: Comparative Laboratory-Based Study
Open Access
- 31 May 2021
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Serious Games
- Vol. 9 (2) , e25771
Abstract
Background: In affective exergames, game difficulty is dynamically adjusted to match the user’s physical and psychological state. Such an adjustment is commonly made based on a combination of performance measures (eg, in-game scores) and physiological measurements, which provide insight into the player’s psychological state. However, although many prototypes of affective games have been presented and many studies have shown that physiological measurements allow more accurate classification of the player’s psychological state than performance measures, few studies have examined whether dynamic difficulty adjustment (DDA) based on physiological measurements (which requires additional sensors) results in a better user experience than performance-based DDA or manual difficulty adjustment. Objective: This study aims to compare five DDA methods in an affective exergame: manual (player-controlled), random, performance-based, personality-performance–based, and physiology-personality-performance–based (all-data). Methods: A total of 50 participants (N=50) were divided into five groups, corresponding to the five DDA methods. They played an exergame version of Pong for 18 minutes, starting at a medium difficulty; every 2 minutes, two game difficulty parameters (ball speed and paddle size) were adjusted using the participant’s assigned DDA method. The DDA rules for the performance-based, personality-performance–based, and all-data groups were developed based on data from a previous open-loop study. Seven physiological responses were recorded throughout the sessions, and participants self-reported their preferred changes to difficulty every 2 minutes. After playing the game, participants reported their in-game experience using two questionnaires: the Intrinsic Motivation Inventory and the Flow Experience Measure. Results: Although the all-data method resulted in the most accurate changes to ball speed and paddle size (defined as the percentage match between DDA choice and participants’ preference), no significant differences between DDA methods were found on the Intrinsic Motivation Inventory and Flow Experience Measure. When the data from all four automated DDA methods were pooled together, the accuracy of changes in ball speed was significantly correlated with players’ enjoyment (r=0.38) and pressure (r=0.43). Conclusions: Although our study is limited by the use of a between-subjects design and may not generalize to other exergame designs, the results do not currently support the inclusion of physiological measurements in affective exergames, as they did not result in an improved user experience. As the accuracy of difficulty changes is correlated with user experience, the results support the development of more effective DDA methods. However, they show that the inclusion of physiological measurements does not guarantee a better user experience even if it yields promising results in offline cross-validation.Keywords
All Related Versions
This publication has 48 references indexed in Scilit:
- Hospitality employee knowledge-sharing behaviors in the relationship between goal orientations and service innovative behaviorInternational Journal of Hospitality Management, 2013
- A Review of Affective Design towards Video GamesProcedia - Social and Behavioral Sciences, 2012
- Bias, optimal linear estimation, and the differences between open-loop simulation and closed-loop performance of spiking-based brain–computer interface algorithmsNeural Networks, 2009
- Dynamic Difficulty Adjustment in Computer Games Through Real-Time Anxiety-Based Affective FeedbackInternational Journal of Human–Computer Interaction, 2009
- Flow in games (and everything else)Communications of the ACM, 2007
- Anxiety detecting robotic system – towards implicit human-robot collaborationRobotica, 2004
- A very brief measure of the Big-Five personality domainsJournal of Research in Personality, 2003
- On the Factorial and Construct Validity of the Intrinsic Motivation Inventory: Conceptual and Operational ConcernsResearch Quarterly for Exercise and Sport, 1997
- Heart rate variability: Standards of measurement, physiological interpretation, and clinical useEuropean Heart Journal, 1996
- Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS/BAS Scales.Journal of Personality and Social Psychology, 1994