EEG mismatch responses in a multimodal roving stimulus paradigm provide evidence for probabilistic inference across audition, somatosensation, and vision
Authors:
Open Access
- 17 April 2023
- journal article
- research article
- Published by Wiley in Human Brain Mapping
- Vol. 44 (9) , 3644-3668
Abstract
The human brain is constantly subjected to a multimodal stream of probabilistic sensory inputs. Electroencephalography (EEG) signatures, such as the mismatch negativity (MMN) and the P3, can give valuable insight into neuronal probabilistic inference. Although reported for different modalities, mismatch responses have largely been studied in isolation, with a strong focus on the auditory MMN. To investigate the extent to which early and late mismatch responses across modalities represent comparable signatures of uni‐ and cross‐modal probabilistic inference in the hierarchically structured cortex, we recorded EEG from 32 participants undergoing a novel tri‐modal roving stimulus paradigm. The employed sequences consisted of high and low intensity stimuli in the auditory, somatosensory and visual modalities and were governed by unimodal transition probabilities and cross‐modal conditional dependencies. We found modality specific signatures of MMN (~100–200 ms) in all three modalities, which were source localized to the respective sensory cortices and shared right lateralized prefrontal sources. Additionally, we identified a cross‐modal signature of mismatch processing in the P3a time range (~300–350 ms), for which a common network with frontal dominance was found. Across modalities, the mismatch responses showed highly comparable parametric effects of stimulus train length, which were driven by standard and deviant response modulations in opposite directions. Strikingly, P3a responses across modalities were increased for mispredicted stimuli with low cross‐modal conditional probability, suggesting sensitivity to multimodal (global) predictive sequence properties. Finally, model comparisons indicated that the observed single trial dynamics were best captured by Bayesian learning models tracking unimodal stimulus transitions as well as cross‐modal conditional dependencies.Keywords
All Related Versions
Funding Information
- Berlin School of Mind and Brain
- Deutscher Akademischer Austauschdienst
This publication has 164 references indexed in Scilit:
- Of bits and wows: A Bayesian theory of surprise with applications to attentionNeural Networks, 2010
- Bayesian model selection for group studiesNeuroImage, 2009
- Bayesian surprise attracts human attentionVision Research, 2009
- The mismatch negativity: A review of underlying mechanismsClinical Neurophysiology, 2009
- Neural signature of the conscious processing of auditory regularitiesProceedings of the National Academy of Sciences, 2009
- The functional anatomy of the MMN: A DCM study of the roving paradigmNeuroImage, 2008
- Tri-modal integration of visual, tactile and auditory signals for the perception of sequences of eventsBrain Research Bulletin, 2008
- Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and JudgmentsNeuron, 2008
- The mismatch negativity (MMN) in basic research of central auditory processing: A reviewClinical Neurophysiology, 2007
- Updating P300: An integrative theory of P3a and P3bClinical Neurophysiology, 2007