A Systematic Meta-analysis of the Reliability and Validity of Subjective Cognitive Load Questionnaires in Experimental Multimedia Learning Research
Top Cited Papers
Open Access
- 20 May 2022
- journal article
- research article
- Published by Springer Nature in Educational Psychology Review
- Vol. 34 (4) , 2485-2541
Abstract
For more than three decades, cognitive load theory has been addressing learning from a cognitive perspective. Based on this instructional theory, design recommendations and principles have been derived to manage the load on working memory while learning. The increasing attention paid to cognitive load theory in educational science quickly culminated in the need to measure its types of cognitive load — intrinsic, extraneous, and germane cognitive load which additively contribute to the overall load. In this meta-analysis, four frequently used cognitive load questionnaires were examined concerning their reliability (internal consistency) and validity (construct validity and criterion validity). Results revealed that the internal consistency of the subjective cognitive load questionnaires can be considered satisfactory across all four questionnaires. Moreover, moderator analyses showed that reliability estimates of the cognitive load questionnaires did not differ between educational settings, domains of the instructional materials, presentation modes, or number of scale points. Correlations among the cognitive load types partially contradict theory-based assumptions, whereas correlations with learning-related variables support assumptions derived from cognitive load theory. In particular, results seem to support the three-factor model consisting of intrinsic cognitive load, extraneous cognitive load, and germane cognitive load. Results are discussed in relation to current trends in cognitive load theory and recommendations for the future use of cognitive load questionnaires in experimental research are suggested.Keywords
Funding Information
- Technische Universität Chemnitz
This publication has 208 references indexed in Scilit:
- From test validity to construct validity … and back?Medical Education, 2012
- Cognitive Load Theory: How Many Types of Load Does It Really Need?Educational Psychology Review, 2011
- Assessment of the Maximal Split-Half Coefficient to Estimate ReliabilityEducational and Psychological Measurement, 2010
- On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s AlphaPsychometrika, 2009
- A Re-Evaluation of Random-Effects Meta-AnalysisJournal of the Royal Statistical Society Series A: Statistics in Society, 2008
- Chapter 20 What are the differences between long-term, short-term, and working memory?2008
- Expertise Reversal Effect and Its Implications for Learner-Tailored InstructionEducational Psychology Review, 2007
- The content validity index: Are you sure you know what's being reported? critique and recommendationsResearch in Nursing & Health, 2006
- Inference by Eye: Confidence Intervals and How to Read Pictures of Data.American Psychologist, 2005
- Coefficient Alpha and the Internal Structure of TestsPsychometrika, 1951