Psychometric Evidence of Digital and Online Executive Function Tests: A Systematic Review
Preprint
- 12 January 2026
- preprint
- Published by Springer Nature in Research Square
Abstract
Objective This review maps psychometric evidence from the past decade on digital and online tools assessing executive functions (EF) in healthy adults. It focuses on six modern domains of validity: content, structure, external, response processes, consequences, and reliability. Methods Searches were conducted across PsycNet, PubMed, Embase, Web of Science, and the Virtual Health Library, guided by PRISMA. Core terms included executive functions, digital tools, healthy adults, and psychometric properties. Risk of bias was systematically evaluated. Results Thirty-one studies met inclusion criteria, encompassing 11,246 participants. Most tools assessed core EF domains—working memory, inhibition, and cognitive flexibility—through performance-based tasks or online questionnaires. Reliability was reported in 23 studies, though often via single indices. Content validity appeared in 26 studies but lacked methodological rigor. Structural and external validity were reported in 8 and 17 studies, respectively. Response process evidence (n = 22) and consequential validity (n = 31) were frequently cited but rarely examined in depth. No study addressed all six domains comprehensively. The risk of bias was low for administration but high for sampling. Applicability concerns included unrepresentative samples and weak construct alignment. Conclusion While the field is expanding, it lacks methodological depth. Despite growing interest in digital EF tools, essential domains—particularly structural modeling and consequence analysis—remain underdeveloped. This review underscores the need for comprehensive validation frameworks that integrate theoretical coherence, empirical rigor, and equity-based implementation.Keywords
All Related Versions
This publication has 48 references indexed in Scilit:
- Measurement invariance across countries of the Test of Memory Strategies (TMS): A contribution to the cross-national validity studyActa Psychologica, 2024
- Neuropsychological assessment2022
- Psychometric properties of the Spanish version of the Frontal Assessment Battery (FAB-E) and normative values in a representative adult population sampleNeurología (English Edition), 2022
- Virtual apartment stroop task: Comparison with computerized and traditional stroop tasksJournal of Neuroscience Methods, 2018
- Fifty Years of Prefrontal Cortex Research: Impact on AssessmentJournal of the International Neuropsychological Society, 2017
- Unity and diversity of executive functions: Individual differences as a window on cognitive structureCortex, 2017
- The Attention Network Test-Interaction (ANT-I): reliability and validity in healthy older adultsExperimental Brain Research, 2015
- Executive function: Reflection, iterative reprocessing, complexity, and the developing brainDevelopmental Review, 2015
- Reliability and Validity of Composite Scores from the NIH Toolbox Cognition Battery in AdultsJournal of the International Neuropsychological Society, 2014
- Psychological Testing on the Internet: New Problems, Old Issues.American Psychologist, 2004