The Relationship Between Game-Related Assessment and Traditional Measures of Cognitive Ability—A Meta-Analysis
Open Access
- 16 December 2024
- journal article
- research article
- Published by MDPI AG in Journal of Intelligence
- Vol. 12 (12) , 129
Abstract
Technological advances have introduced new methods for assessing psychological constructs, moving beyond traditional paper-pencil tests. Game-related assessments (GRAs) offer several advantages for research and practice, though questions about their construct validity persist. This meta-analysis investigated the relationship between indicators derived from computer-based games and traditional cognitive ability measures, examining whether measurement scope (single vs. multiple indicators) or measurement medium of cognitive ability (computer-based vs. paper-pencil) influences this relationship. We identified 52 eligible samples stemming from 44 papers, including data from over 6100 adult participants. The results from three-stage mixed-effects meta-analyses showed an overall observed correlation of r = 0.30 (p < 0.001; corrected r = 0.45) between GRA indicators and traditional cognitive ability measures with substantial heterogeneity in effect sizes. Stronger relationships were found when cognitive ability was measured by multiple indicators, but no differences emerged based on the measurement medium of cognitive ability. Furthermore, GRAs intended to assess cognitive ability did not show stronger relationships with traditional measures of cognitive ability than GRAs not specifically used to measure cognitive ability. Overall, our findings suggest that GRAs are related to traditional cognitive ability measures. However, the overall effect size raises questions about whether GRAs and traditional measures capture the same aspects of cognitive ability or if GRAs also measure other constructs beyond cognitive ability.Keywords
This publication has 82 references indexed in Scilit:
- Video game training does not enhance cognitive ability: A comprehensive meta-analytic investigation.Psychological Bulletin, 2018
- Individual differences and their measurement: A review of 100 years of research.Journal of Applied Psychology, 2017
- The effects of predictor method factors on selection outcomes: A modular approach to personnel selection procedures.Journal of Applied Psychology, 2017
- The Measurement of Intelligence in the XXI Century using Video GamesThe Spanish Journal of Psychology, 2016
- Gamification of Cognitive Assessment and Cognitive Training: A Systematic Review of Applications and EfficacyJMIR Serious Games, 2016
- Measuring Working Memory Is All Fun and GamesExperimental Psychology, 2014
- Selling points: What cognitive abilities are tapped by casual video games?Acta Psychologica, 2013
- The importance of distinguishing between constructs and methods when comparing predictors in personnel selection research and practice.Journal of Applied Psychology, 2008
- Academic Performance, Career Potential, Creativity, and Job Performance: Can One Construct Predict Them All?Journal of Personality and Social Psychology, 2004
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959