Differential modulation of the neurocomputational signature of early and late mismatch responses to spoken words by awareness and task relevance
Preprint
Abstract
Mismatch responses (MMRs), including the mismatch negativity (MMN) and the P3, are a hallmark of the brain’s capacity to detect unexpected events. They are discussed to be generated by two main processes: adaptation and prediction error (PE). However, MMR research on underlying mechanisms has mostly relied on simple, non-linguistic stimuli such as tones, and it remains unknown how awareness and attentional conditions affect MMRs to auditory verbal stimuli, that, unlike tones, carry lexical-semantic meaning. Here, we conducted a preregistered EEG study that disentangled influences of awareness, general task-relevance of word stimuli, and specific target-relevance of word oddballs on the MMN and P3. In addition, single-trial neurocomputational models were applied to uncover the underlying generative models of the MMRs. Results show that word-related MMN and P3 were only elicited when words were task-relevant, and the P3 increased with target-relevance. Crucially, no word-related MMN emerged under inattention, in contrast to the pre-attentive MMN typically reported for tonal deviants. Neurocomputational modeling revealed that the early part of the task-relevant MMN reflects adaptation processes. PE processes generated later parts of the MMN under task-relevance, and the entire MMN under target-relevance, as well as the P3 independent of relevance conditions. This suggests that the same temporal generation pattern of adaptation and PE underlie mismatch responses to both words and tones, but that, unlike tonal MMRs, eliciting MMRs to words requires the allocation of attention. This attentional dependency may reflect the additional lexical-semantic and multi-level representational demands that spoken words impose on the auditory system.Keywords
This publication has 118 references indexed in Scilit:
- EEG mismatch responses in a multimodal roving stimulus paradigm provide evidence for probabilistic inference across audition, somatosensation, and visionHuman Brain Mapping, 2023
- Visual mismatch negativity to masked stimuli presented at very brief presentation ratesExperimental Brain Research, 2016
- Stimulus-specific adaptation and deviance detection in the auditory system: experiments and modelsBiological Cybernetics, 2014
- The Five Myths of MMN: Redefining How to Use MMN in Basic and Clinical ResearchBrain Topography, 2013
- Sensory and cognitive mechanisms of change detection in the context of speechBrain Structure and Function, 2008
- Active attention modulates passive attention-related neural responses to sudden somatosensory input against a silent backgroundExperimental Brain Research, 2006
- Memory Traces for Words as Revealed by the Mismatch NegativityNeuroImage, 2001
- On the computational architecture of the neocortexBiological Cybernetics, 1992
- Functional parallelism in spoken word-recognitionCognition, 1987
- Early selective-attention effect on evoked potential reinterpretedActa Psychologica, 1978