The impact of face coverings on audio-visual contributions to communication with conversational speech
Open Access
- 23 April 2024
- journal article
- research article
- Published by Springer Nature in Cognitive Research: Principles and Implications
- Vol. 9 (1) , 1-15
Abstract
The use of face coverings can make communication more difficult by removing access to visual cues as well as affecting the physical transmission of speech sounds. This study aimed to assess the independent and combined contributions of visual and auditory cues to impaired communication when using face coverings. In an online task, 150 participants rated videos of natural conversation along three dimensions: (1) how much they could follow, (2) how much effort was required, and (3) the clarity of the speech. Visual and audio variables were independently manipulated in each video, so that the same video could be presented with or without a superimposed surgical-style mask, accompanied by one of four audio conditions (either unfiltered audio, or audio-filtered to simulate the attenuation associated with a surgical mask, an FFP3 mask, or a visor). Hypotheses and analyses were pre-registered. Both the audio and visual variables had a statistically significant negative impact across all three dimensions. Whether or not talkers’ faces were visible made the largest contribution to participants’ ratings. The study identifies a degree of attenuation whose negative effects can be overcome by the restoration of visual cues. The significant effects observed in this nominally low-demand task (speech in quiet) highlight the importance of the visual and audio cues in everyday life and that their consideration should be included in future face mask designs.Keywords
Funding Information
- Engineering and Physical Sciences Research Council (EP/V051571/1)
- Manchester Biomedical Research Centre (NIHR203308)
This publication has 51 references indexed in Scilit:
- A Transparent Mask and Clear Speech Benefit Speech Intelligibility in Individuals With Hearing LossJournal of Speech, Language, and Hearing Research, 2023
- Effect of Wearing a Face Mask on Vocal Self-Perception during a PandemicJournal of Voice, 2022
- Effect of Face Mask on Voice Production During COVID-19 Pandemic: A Systematic ReviewJournal of Voice, 2021
- Impact of Face Masks on Speech Acoustics and Vocal Effort in Healthcare ProfessionalsThe Laryngoscope, 2021
- Intelligibility of face-masked speech depends on speaking style: Comparing casual, clear, and emotional speechCognition, 2021
- Influence of Protective Face Coverings on the Speech Recognition of Cochlear Implant PatientsThe Laryngoscope, 2021
- An evidence review of face masks against COVID-19Proceedings of the National Academy of Sciences, 2021
- Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: a systematic review and meta-analysisThe Lancet, 2020
- Selective Visual Masking in SpeechreadingJournal of Speech, Language, and Hearing Research, 1998
- Interaction of Audition and Vision in the Recognition of Oral Speech StimuliJournal of Speech and Hearing Research, 1969