The Effects of Captioning Errors, Background Noise, and Hearing Loss on Memory for Text-Captioned Speech
- 8 June 2022
- journal article
- research article
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 65 (6) , 2364-2390
Abstract
Purpose: Previous studies have suggested that the negative effects of acoustic challenge on speech memory can be attenuated with assistive text captions, particularly among older adults with hearing impairment. However, no studies have systematically examined the effects of text-captioning errors, which are common in automated speech recognition (ASR) systems. Method: In two experiments, we examined memory for text-captioned speech (with and without background noise) when captions had no errors (control) or had one of three common ASR errors: substitution, deletion, or insertion errors. Results: In both Experiment 1 (young adults with normal hearing) and Experiment 2 (older adults with varying hearing acuity), we observed similar additive effects of caption errors and background noise, such that increased background noise and the presence of captioning errors negatively impacted memory outcomes. Notably, the negative effects of captioning errors were largest among older adults with increased hearing thresholds, suggesting that older adults with hearing loss may show an increased reliance on text captions compared to adults with normal hearing. Conclusion: Our findings show that even a single-word error can be deleterious to memory for text-captioned speech, especially in older adults with hearing loss. Therefore, to produce the greatest benefit to memory, it is crucial that text captions are accurate.Keywords
This publication has 48 references indexed in Scilit:
- Random effects structure for confirmatory hypothesis testing: Keep it maximalJournal of Memory and Language, 2013
- Determining an appropriate cutting score for indication of impairment on the Montreal Cognitive AssessmentInternational Journal of Geriatric Psychiatry, 2012
- Learning to ignore distracters.Psychology and Aging, 2012
- The Benefits of Hearing Aids and Closed Captioning for Television Viewing by Older Adults with Hearing LossEar & Hearing, 2009
- The Influence of Age, Hearing, and Working Memory on the Speech Comprehension Benefit Derived from an Automatic Speech Recognition SystemEar & Hearing, 2009
- The Benefit Obtained from Visually Displayed Text from an Automatic Speech Recognizer During Listening to Speech Presented in NoiseEar & Hearing, 2008
- Working memory capacity for spoken sentences decreases with adult ageing: Recall of fewer but not smaller chunks in older adultsMemory, 2008
- Eye movements of young and older adults while reading with distraction.Psychology and Aging, 2006
- Hearing Loss in Older AdulthoodCurrent Directions in Psychological Science, 2005
- “Mini-mental state”Journal of Psychiatric Research, 1975