A reanalysis of McGurk data suggests that audiovisual fusion in speech perception is subject-dependent
- 1 March 2010
- journal article
- research article
- Published by Acoustical Society of America (ASA) in The Journal of the Acoustical Society of America
- Vol. 127 (3) , 1584-1594
Abstract
Audiovisual perception of conflicting stimuli displays a large level of intersubject variability, generally larger than pure auditory or visual data. However, it is not clear whether this actually reflects differences in integration per se or just the consequence of slight differences in unisensory perception. It is argued that the debate has been blurred by methodological problems in the analysis of experimental data, particularly when using the fuzzy-logical model of perception (FLMP) [Massaro, D. W. (1987). Speech Perception by Ear and Eye: A Paradigm for Psychological Inquiry (Laurence Erlbaum Associates, London)] shown to display overfitting abilities with McGurk stimuli [Schwartz, J. L. (2006). J. Acoust. Soc. Am. 120, 1795–1798]. A large corpus of McGurk data is reanalyzed, using a methodology based on (1) comparison of FLMP and a variant with subject-dependent weights of the auditory and visual inputs in the fusion process, weighted FLMP (WFLMP); (2) use of a Bayesian selection model criterion instead of a root mean square error fit in model assessment; and (3) systematic exploration of the number of useful parameters in the models to compare, attempting to discard poorly explicative parameters. It is shown that WFLMP performs significantly better than FLMP, suggesting that audiovisual fusion is indeed subject-dependent, some subjects being more “auditory,” and others more “visual.” Intersubject variability has important consequences for theoretical understanding of the fusion process, and re-education of hearing impaired people.Keywords
This publication has 38 references indexed in Scilit:
- Improvement in speech-reading ability by auditory training: Evidence from gender differences in normally hearing, deaf and cochlear implanted subjectsNeuropsychologia, 2009
- Causal Inference in Multisensory PerceptionPLOS ONE, 2007
- Evidence that cochlear-implanted deaf patients are better multisensory integratorsProceedings of the National Academy of Sciences, 2007
- When a good fit can be badTrends in Cognitive Sciences, 2002
- Humans integrate visual and haptic information in a statistically optimal fashionNature, 2002
- Comparing models for audiovisual fusion in a noisy-vowel recognition taskIEEE Transactions on Speech and Audio Processing, 1999
- Assessing multivariate nonnormality using univariate distributionsBiometrika, 1999
- Applying Occam’s razor in modeling cognition: A Bayesian approachPsychonomic Bulletin & Review, 1997
- Bayes FactorsJournal of the American Statistical Association, 1995
- Hearing lips and seeing voicesNature, 1976