Do Applicant Reactions to Gamified Cognitive Ability Tests Differ Between High- Versus Low-Stakes Settings?
Open Access
- 7 March 2025
- journal article
- research article
- Published by MDPI AG in Journal of Intelligence
- Vol. 13 (3) , 33
Abstract
Although cognitive ability tests are among the best predictors of job and training performance, their acceptance among applicants is limited. However, with the current talent shortage, applicant reactions to assessments have become increasingly important. Gamification is a promising approach for improving reactions to cognitive ability tests. However, it remains unclear how findings from low-stakes studies of gamified assessments generalize to high-stakes settings. In this quasi-experimental study (N = 210), we compared reactions to a gamified cognitive test from a low-stakes simulated selection setting with experimental participants and from a high-stakes selection setting with real applicants. Test takers in both settings completed the same gamified cognitive ability test and then rated several applicant reactions variables. We found a clear effect of the test setting with real applicants showing more positive reactions to the gamified test concerning perceived fairness, test motivation, organizational attractiveness, behavioral intentions, organizational image, clarity of work activity, and enjoyment compared to participants in the low-stakes setting, whereas there were no differences for perceived job-relatedness and opportunity to perform. These findings highlight the influence of test setting on applicant reactions and underscore the importance of examining environmental factors for research on the effects of gamification in cognitive ability testing.Keywords
Funding Information
- Studienstifung des Deutschen Volkes
This publication has 40 references indexed in Scilit:
- Is Gamification a Suitable Means to Improve Applicant Reactions and Convey Information During an Online Test?Journal of Personnel Psychology, 2024
- Toward human-centered AI management: Methodological challenges and future directionsTechnovation, 2024
- Theory-driven game-based assessment of general cognitive ability: Design theory, measurement, prediction of performance, and test fairness.Journal of Applied Psychology, 2022
- The shifting boundaries of talent managementHuman Resource Management, 2021
- It Takes More Than a Good Camera: Which Factors Contribute to Differences Between Face-to-Face Interviews and Videoconference Interviews Regarding Performance Ratings and Interviewee Perceptions?Journal of Business and Psychology, 2020
- Is It Possible to Improve Test Takers’ Perceptions of Ability Tests by Providing an Explanation?Journal of Personnel Psychology, 2019
- Correlational effect size benchmarks.Journal of Applied Psychology, 2015
- A Meta-Analytic Study of General Mental Ability Validity for Different Occupations in the European Community.Journal of Applied Psychology, 2003
- The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings.Psychological Bulletin, 1998
- Applicant reactions to alternative selection proceduresJournal of Business and Psychology, 1993