Audiovisual identity perception from naturally‐varying stimuli is driven by visual information
Authors:
Open Access
- 6 September 2021
- journal article
- research article
- Published by Wiley in British Journal of Psychology
- Vol. 113 (1) , 248-263
Abstract
Identity perception often takes place in multimodal settings, where perceivers have access to both visual (face) and auditory (voice) information. Despite this, identity perception is usually studied in unimodal contexts, where face and voice identity perception are modelled independently from one another. In this study, we asked whether and how much auditory and visual information contribute to audiovisual identity perception from naturally‐varying stimuli. In a between‐subjects design, participants completed an identity sorting task with either dynamic video‐only, audio‐only or dynamic audiovisual stimuli. In this task, participants were asked to sort multiple, naturally‐varying stimuli from three different people by perceived identity. We found that identity perception was more accurate for video‐only and audiovisual stimuli compared with audio‐only stimuli. Interestingly, there was no difference in accuracy between video‐only and audiovisual stimuli. Auditory information nonetheless played a role alongside visual information as audiovisual identity judgements per stimulus could be predicted from both auditory and visual identity judgements, respectively. While the relationship was stronger for visual information and audiovisual information, auditory information still uniquely explained a significant portion of the variance in audiovisual identity judgements. Our findings thus align with previous theoretical and empirical work that proposes that, compared with faces, voices are an important but relatively less salient and a weaker cue to identity perception. We expand on this work to show that, at least in the context of this study, having access to voices in addition to faces does not result in better identity perception accuracy.Keywords
Funding Information
- Wellcome Trust (220448/Z/20/Z)
This publication has 40 references indexed in Scilit:
- A unified coding strategy for processing faces and voicesTrends in Cognitive Sciences, 2013
- Matching voice and face identity from static images.Journal of Experimental Psychology: Human Perception and Performance, 2013
- Interference in eyewitness and earwitness recognitionApplied Cognitive Psychology, 2011
- The role of audiovisual asynchrony in person recognitionQuarterly Journal of Experimental Psychology, 2010
- Hearing Facial IdentitiesQuarterly Journal of Experimental Psychology, 2007
- Seeing to hear better: evidence for early audio-visual interactions in speech identificationCognition, 2004
- Cross-Modal Source Information and Spoken Word Recognition.Journal of Experimental Psychology: Human Perception and Performance, 2004
- Why are familiar-only experiences more frequent for voices than for faces?The Quarterly Journal of Experimental Psychology Section A, 2000
- I Recognise you but I Can't Place you: An Investigation of Familiar-only Experiences during Tests of Voice and Face RecognitionThe Quarterly Journal of Experimental Psychology Section A, 1998
- Understanding face recognitionBritish Journal of Psychology, 1986