Correcting automatically generated closed captions for online learning materials does not improve student learning outcomes (although students believe it does)
Open Access
- 13 May 2026
- journal article
- research article
- Published by Wiley in British Journal of Educational Technology
- Vol. 57 (6) , 1423-1439
Abstract
Lecture capture is ubiquitous in higher education. Lecture capture recordings are typically accompanied by automatically generated closed captions that are sometimes corrected by humans. Students self‐report that they benefit from captions, and particularly human‐corrected captions. However, multimedia learning research suggests that simultaneous spoken and written information impairs learning. Experimental tests of the pedagogic benefits of captions in authentic higher education learning contexts are sparse. Consequently, we block randomised 144 undergraduate psychology students to 12 sets of lecture capture recordings with uncorrected, corrected or no captions then assessed their understanding of these materials with 12 quizzes. Our pre‐registered analyses indicated that the differences between conditions were trivial ( M η 2 = 0.01; | M | δ = 0.12) and that the captioning conditions to which students were randomised did not influence their quiz performance. Follow‐up surveys re‐confirmed that students believe captions are beneficial for multiple reasons (eg, improved comprehension and focus; study efficiency; accessibility), and prefer corrected over uncorrected captions, even though they do not always notice the difference. As they do not impair learning, do meet accessibility requirements and are valued by students, automatically generated captions should be used routinely. However, correcting them may not reflect an optimal use of resources. Practitioner notes: What is already known about this topic: Closed captions are widely used by young people, who self‐report that they benefit from captions on lecture capture recordings. Multimedia learning research indicates that simultaneous spoken and written information can impair learning. Little is known about the pedagogic benefits of captions in authentic higher education learning contexts. Even less is known about the consequences of small but regular errors in automatically generated captions, despite the widespread use of such captions in higher education. What this paper adds: We randomised students to 12 sets of lecture capture recordings with uncorrected, corrected or no captions, then assessed their learning with 12 quizzes. The captioning manipulation did not influence quiz performance. Students self‐reported that captions are beneficial and preferred corrected over uncorrected captions, even though they did not always notice the difference. Implications for practice and/or policy: Captions help universities meet accessibility guidelines and are valued by students. Automatically generated captions should be used routinely. Manually correcting them may not reflect a good use of resources.Keywords
Funding Information
- University of Bristol
This publication has 12 references indexed in Scilit:
- Automatic Speech Recognition: A survey of deep learning techniques and approachesInternational Journal of Cognitive Computing in Engineering, 2025
- A cornerstone of adaptivity – A meta-analysis of the expertise reversal effectLearning and Instruction, 2025
- Students’ active cognitive engagement with instructional videos predicts STEM learningComputers & Education, 2024
- Comparing the Accuracy of ACE and WER Caption Metrics When Applied to Live Television Captioning2022
- Thematic Analysis2022
- A Primer on Bayesian Model-Averaged Meta-AnalysisAdvances in Methods and Practices in Psychological Science, 2021
- Evidence-based principles for how to design effective instructional videos.Journal of Applied Research in Memory and Cognition, 2021
- Multimedia Learning2020
- Reading spoken words: Orthographic effects in auditory primingCognition, 2007
- Phonological priming in spoken word recognition: Task effectsMemory & Cognition, 1989