Audiovisual Events in Sensory Memory
Authors:
- 1 January 2007
- journal article
- Published by Hogrefe Publishing Group in Journal of Psychophysiology
- Vol. 21 (3-4) , 231-238
Abstract
The functional properties of the auditory sensory memory have been extensively studied using the mismatch negativity (MMN) component of the auditory event-related potential (ERP) and its magnetic counterpart recorded using magneto-encephalography (MEG). It has been found that distinct auditory features (such as frequency or intensity) are encoded separately in sensory memory. Nevertheless, the conjunction of these features (auditory “gestalts”) can also be encoded in auditory sensory memory. Here we investigated how auditory and visual features of bimodal events are represented in sensory memory by recording audiovisual MMNs in two different audiovisual oddball paradigms. The results of a first ERP experiment showed that the sensory memory representations of auditory and visual features of audiovisual events lie within the temporal and occipital cortex, respectively, yet with possible interactions between the processing of the unimodal features. In a subsequent MEG experiment, we found some evidence that audiovisual feature conjunctions could also be represented in sensory memory. These results, thus, extend to the audiovisual domain a number of properties of sensory memory already established within the auditory system.Keywords
This publication has 36 references indexed in Scilit:
- Visual Mismatch NegativityJournal of Psychophysiology, 2007
- Bimodal speech: early suppressive visual effects in human auditory cortexEuropean Journal of Neuroscience, 2004
- Generalization of the generation of an MMN by illusory McGurk percepts: voiceless consonantsClinical Neurophysiology, 2004
- Illusory sound shifts induced by the ventriloquist illusion evoke the mismatch negativityNeuroscience Letters, 2004
- Distraction effects in vision: behavioral and event-related potential indicesNeuroReport, 2004
- Detection of visual changeNeuroReport, 2003
- Memory‐based detection of task‐irrelevant visual changesPsychophysiology, 2002
- Electrophysiology of spatial scene analysis: the mismatch negativity (MMN) is sensitive to the ventriloquism illusionClinical Neurophysiology, 2002
- Storage of feature conjunction in transient auditor memoryPsychophysiology, 1997
- Hearing lips and seeing voicesNature, 1976