Linda Drijvers
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Linda Drijvers has a total of 72 co-authors. Here are the top co-authors by number of shared publications:
Asli Özyürek
Donders Institute for Brain, Cognition, and Behaviour, Radboud University
7 shared publicationsJudith Holler
Donders Institute for Brain, Cognition, and Behaviour, Radboud University
7 shared publications- Judith Holler
Max Planck Institute for Psycholinguistics
6 shared publications - Noor Seijdel
Department of Psychology, University of Amsterdam
6 shared publications Sara Mazzini
6 shared publications- Ole Jensen
University of Birmingham
5 shared publications
Latest Publications
- Open Access
- 25 September 2026
- Published by Taylor & Francis in Discourse Processes
- p. 1-15
Seeing hand gestures’ early beginnings improves predictions of upcoming utterance meaning
Most language use occurs in face-to-face conversation, which involves rapid turn-taking (typical response times around 0–200 ms; Heldner & Edlund, 2010; Stivers et al., 2009). This speed is remarka...
- 25 September 2026
- Published by Taylor & Francis in Discourse Processes
- p. 1-15
Open AccessSeeing hand gestures’ early beginnings improves predictions of upcoming utterance meaning
Most language use occurs in face-to-face conversation, which involves rapid turn-taking (typical response times around 0–200 ms; Heldner & Edlund, 2010; Stivers et al., 2009). This speed is remarka...
- Open Access
- 30 August 2026
- Published by Center for Open Science in PsyArXiv
Dynamic coordination of speech and gesture in the brain
Face-to-face communication relies on the continuous integration of auditory signals, such as speech, and visual signals, such as co-speech gestures. Rather than serving as an add-on to spoken language, gestural information has been shown to actively shape how the brain constructs meaning. A central question is how the brain achieves integrating gestures with speech. This is not a trivial problem, as auditory and visual signals are often noisy, temporally misaligned, variable in length, and ambiguous, yet interlocutors still seem to understand each other effortlessly. This chapter will review evidence from neuroimaging (e.g., fMRI, MEG, (dual-)EEG, fNIRS) and brain stimulation (e.g., TMS, tDCS, tACS) methods, both from a within- and a between-brain perspective. Together, these methods have begun to outline a distributed and flexible brain network that supports the integration of speech and gestures. We will discuss how these brain networks coordinate the integration of speech and gestures, and how speech-gesture integration unfolds over time, in both clear and adverse listening conditions.
- 30 August 2026
- Published by Center for Open Science in PsyArXiv
Open AccessDynamic coordination of speech and gesture in the brain
Face-to-face communication relies on the continuous integration of auditory signals, such as speech, and visual signals, such as co-speech gestures. Rather than serving as an add-on to spoken language, gestural information has been shown to actively shape how the brain constructs meaning. A central question is how the brain achieves integrating gestures with speech. This is not a trivial problem, as auditory and visual signals are often noisy, temporally misaligned, variable in length, and ambiguous, yet interlocutors still seem to understand each other effortlessly. This chapter will review evidence from neuroimaging (e.g., fMRI, MEG, (dual-)EEG, fNIRS) and brain stimulation (e.g., TMS, tDCS, tACS) methods, both from a within- and a between-brain perspective. Together, these methods have begun to outline a distributed and flexible brain network that supports the integration of speech and gestures. We will discuss how these brain networks coordinate the integration of speech and gestures, and how speech-gesture integration unfolds over time, in both clear and adverse listening conditions.
- Open Access
Speech clarity shapes auditory attention and visual-signal coupling during multimodal sentence comprehension
Face-to-face communication requires listeners to attend, integrate, and weigh multiple communicative signals, including auditory speech, mouth movements, and co-speech gestures. The contribution of these signals may depend on the reliability of auditory input and the informativeness of the available signals. We utilized rapid invisible frequency tagging (RIFT) with EEG to examine how participants attend to and integrate these different signals in clear and adverse listening conditions. Participants watched videos of an actress producing clear or noise-vocoded sentences. Auditory speech was amplitude-modulated at 58Hz, while the luminance of the gesture and mouth regions was frequency-tagged at 63Hz and 65Hz. Degraded speech elicited stronger responses at the auditory tagged frequency, suggesting increased attentional gain to the auditory signal when listening was challenging. In contrast, clear speech elicited stronger responses at the gesture tagged frequency and a stronger 2Hz intermodulation response (65-63Hz), reflecting enhanced nonlinear coupling between mouth movements and gestures. Finally, in degraded speech, the informativeness of mouth movement, but not gesture, was associated with intermodulation strength, suggesting that the informativeness of mouth movements plays a greater role in multisensory interaction when listening is challenging. Our findings demonstrate that both signal reliability and informativeness shape multisensory integration during spoken language comprehension.
Open AccessSpeech clarity shapes auditory attention and visual-signal coupling during multimodal sentence comprehension
Face-to-face communication requires listeners to attend, integrate, and weigh multiple communicative signals, including auditory speech, mouth movements, and co-speech gestures. The contribution of these signals may depend on the reliability of auditory input and the informativeness of the available signals. We utilized rapid invisible frequency tagging (RIFT) with EEG to examine how participants attend to and integrate these different signals in clear and adverse listening conditions. Participants watched videos of an actress producing clear or noise-vocoded sentences. Auditory speech was amplitude-modulated at 58Hz, while the luminance of the gesture and mouth regions was frequency-tagged at 63Hz and 65Hz. Degraded speech elicited stronger responses at the auditory tagged frequency, suggesting increased attentional gain to the auditory signal when listening was challenging. In contrast, clear speech elicited stronger responses at the gesture tagged frequency and a stronger 2Hz intermodulation response (65-63Hz), reflecting enhanced nonlinear coupling between mouth movements and gestures. Finally, in degraded speech, the informativeness of mouth movement, but not gesture, was associated with intermodulation strength, suggesting that the informativeness of mouth movements plays a greater role in multisensory interaction when listening is challenging. Our findings demonstrate that both signal reliability and informativeness shape multisensory integration during spoken language comprehension.
- Open Access
Discriminating Mechanisms of Heart-Voice Coupling
In a landmark paper in JASA , Orlikoff & Baken (1989a) demonstrated that the heartbeat carries through acoustic features of the human voice. Heart-voice coupling questions how vocal control is functionally regulated and has many potential engineering applications to extract heart rate from the human voice. However, laboratory phonology and bioacoustics seem to have forgotten about the phenomenon, such that its physiological underpinnings have been left unexplained. The current contribution showed that vocal acoustics contain signatures of the heartbeat as originally reported by Orlikoff & Baken (1989a). More specifically, the steady-state vowel vocalizations of 17 participants were analysed and a significant relationship between the vocal acoustic envelope and the cardiac activity (ECG) was found. Furthermore, two empirical tests were conducted to discriminate between vocal fold (vascularization) and pulmonary (heart-lung interaction) mechanisms of heart-voice coupling. In addition to a stable heart-voice coupling, a significant heart-expiration coupling during conditions of silent expiration was also found. Since the vocal folds are abducted during expiration, this result demonstrated that pulmonary mechanisms that modulate expiratory flow must be involved in heart-voice coupling. It is speculated that the heart’s rhythm may be a weakly coupled pattern generator that possibly shaped the evolution of vocal and speech production.
Open AccessDiscriminating Mechanisms of Heart-Voice Coupling
In a landmark paper in JASA , Orlikoff & Baken (1989a) demonstrated that the heartbeat carries through acoustic features of the human voice. Heart-voice coupling questions how vocal control is functionally regulated and has many potential engineering applications to extract heart rate from the human voice. However, laboratory phonology and bioacoustics seem to have forgotten about the phenomenon, such that its physiological underpinnings have been left unexplained. The current contribution showed that vocal acoustics contain signatures of the heartbeat as originally reported by Orlikoff & Baken (1989a). More specifically, the steady-state vowel vocalizations of 17 participants were analysed and a significant relationship between the vocal acoustic envelope and the cardiac activity (ECG) was found. Furthermore, two empirical tests were conducted to discriminate between vocal fold (vascularization) and pulmonary (heart-lung interaction) mechanisms of heart-voice coupling. In addition to a stable heart-voice coupling, a significant heart-expiration coupling during conditions of silent expiration was also found. Since the vocal folds are abducted during expiration, this result demonstrated that pulmonary mechanisms that modulate expiratory flow must be involved in heart-voice coupling. It is speculated that the heart’s rhythm may be a weakly coupled pattern generator that possibly shaped the evolution of vocal and speech production.
- Open Access
- 14 November 2025
- Published by SAGE Publications in Autism
- Vol. 30 (2) , 439-451
Exploring auditory perception experiences in daily situations in autistic adults
Autistic individuals often show differential sensory perception, including hypo- or hypersensitivities to sound. Previous research also suggests that autistic individuals often have difficulty processing intentional and affective cues in speech acoustics. However, general speech processing difficulties remain underexplored. We investigated self-reported auditory perception using the Speech, Spatial, and Qualities of Hearing Questionnaire among autistic (self-identifying ( n = 18) and clinically diagnosed ( n = 45)) and non-autistic adults ( N = 66). The study was conducted in the Netherlands, but the questionnaire and call for participation were in English and open to anyone regardless of country of residence. Both clinically diagnosed and self-identifying individuals with autism reported significantly lower scores on the Speech, Spatial, and Qualities of Hearing Questionnaire score and on the Speech subscale compared with non-autistic individuals, indicating challenges in overall quality of auditory perception, speech comprehension. Clinically diagnosed individuals also showed lower scores on the quality and spatial subscales compared with non-autistic individuals. Post hoc analysis further suggested that speech hearing is particularly challenging for many autistic individuals. In addition, our finding that self-identifying and clinically diagnosed autistic individuals show similar patterns of hearing difficulties emphasizes the need for more inclusive research practices that collect the experiences of all the individuals in the autistic community in the study of sensory perception in autism. Lay Autistic individuals often have very different sensory experiences compared with non-autistic individuals. One anecdotally mentioned, but not well-researched phenomenon is difficulty processing what we are hearing. Rather than challenges related to language understanding, such as nonliteral or indirect language, autistic people may also have more difficulty making sense of the sounds of their environment. This may be hearing where particular sounds are coming from, or understanding what is being said, particularly in noisy situations. To bring more attention and clarity to this challenge, we asked autistic and non-autistic adults to fill out a short survey that measures one’s hearing experiences in daily life. We found that autistic individuals report more difficulty across several types of hearing, and most prominently regarding speech hearing, when compared with non-autistic individuals. This finding highlights that reports of auditory processing difficulties when there is no hearing loss are not niche experiences, but rather reflect a common experience in autistic adults. In addition, we found that clinically diagnosed and self-identifying individuals reported very similar experiences. This highlights the validity of self-identification/self-diagnosis for research aimed at understanding autistic experiences. This study, therefore, emphasizes the need for more research and awareness regarding auditory perception and hearing in autistic adults. The study also emphasizes the value of more inclusive research practices that collect the experiences of all individuals within the autism community.
- 14 November 2025
- Published by SAGE Publications in Autism
- Vol. 30 (2) , 439-451
Open AccessExploring auditory perception experiences in daily situations in autistic adults
Autistic individuals often show differential sensory perception, including hypo- or hypersensitivities to sound. Previous research also suggests that autistic individuals often have difficulty processing intentional and affective cues in speech acoustics. However, general speech processing difficulties remain underexplored. We investigated self-reported auditory perception using the Speech, Spatial, and Qualities of Hearing Questionnaire among autistic (self-identifying ( n = 18) and clinically diagnosed ( n = 45)) and non-autistic adults ( N = 66). The study was conducted in the Netherlands, but the questionnaire and call for participation were in English and open to anyone regardless of country of residence. Both clinically diagnosed and self-identifying individuals with autism reported significantly lower scores on the Speech, Spatial, and Qualities of Hearing Questionnaire score and on the Speech subscale compared with non-autistic individuals, indicating challenges in overall quality of auditory perception, speech comprehension. Clinically diagnosed individuals also showed lower scores on the quality and spatial subscales compared with non-autistic individuals. Post hoc analysis further suggested that speech hearing is particularly challenging for many autistic individuals. In addition, our finding that self-identifying and clinically diagnosed autistic individuals show similar patterns of hearing difficulties emphasizes the need for more inclusive research practices that collect the experiences of all the individuals in the autistic community in the study of sensory perception in autism. Lay Autistic individuals often have very different sensory experiences compared with non-autistic individuals. One anecdotally mentioned, but not well-researched phenomenon is difficulty processing what we are hearing. Rather than challenges related to language understanding, such as nonliteral or indirect language, autistic people may also have more difficulty making sense of the sounds of their environment. This may be hearing where particular sounds are coming from, or understanding what is being said, particularly in noisy situations. To bring more attention and clarity to this challenge, we asked autistic and non-autistic adults to fill out a short survey that measures one’s hearing experiences in daily life. We found that autistic individuals report more difficulty across several types of hearing, and most prominently regarding speech hearing, when compared with non-autistic individuals. This finding highlights that reports of auditory processing difficulties when there is no hearing loss are not niche experiences, but rather reflect a common experience in autistic adults. In addition, we found that clinically diagnosed and self-identifying individuals reported very similar experiences. This highlights the validity of self-identification/self-diagnosis for research aimed at understanding autistic experiences. This study, therefore, emphasizes the need for more research and awareness regarding auditory perception and hearing in autistic adults. The study also emphasizes the value of more inclusive research practices that collect the experiences of all individuals within the autism community.
- Open Access
- 28 October 2025
- Published by Center for Open Science in PsyArXiv
A Collaborative Guide to Rapid Invisible Frequency Tagging (RIFT): Methods, Insights, and Recommendations
Rapid Invisible Frequency Tagging (RIFT) is a recent advance in frequency tagging that exploits novel, high-frequency displays to modulate luminance at imperceptibly high frequencies. RIFT goes beyond low-frequency tagging by allowing researchers to track neural responses to rhythmic stimulation while avoiding perceptual confounds. RIFT is thus a promising method to address central questions in cognition, including attention, multimodal integration, and the neural mechanisms underlying oscillatory coordination in perception. However, setting up a RIFT study involves several technical and conceptual considerations. In an effort to make RIFT more accessible, we provide a comprehensive guide for implementing RIFT in cognitive neuroscience. On the basis of the joint experiences and data-driven insights of multiple labs, we provide practical recommendations derived from empirical datasets to improve reproducibility, covering hardware requirements, stimulus design, analysis approaches, and interpretation of results. We hope that this guide helps readers to both identify the conceptual areas where RIFT offers promising insights and navigate the technical caveats that come with the approach.
- 28 October 2025
- Published by Center for Open Science in PsyArXiv
Open AccessA Collaborative Guide to Rapid Invisible Frequency Tagging (RIFT): Methods, Insights, and Recommendations
Rapid Invisible Frequency Tagging (RIFT) is a recent advance in frequency tagging that exploits novel, high-frequency displays to modulate luminance at imperceptibly high frequencies. RIFT goes beyond low-frequency tagging by allowing researchers to track neural responses to rhythmic stimulation while avoiding perceptual confounds. RIFT is thus a promising method to address central questions in cognition, including attention, multimodal integration, and the neural mechanisms underlying oscillatory coordination in perception. However, setting up a RIFT study involves several technical and conceptual considerations. In an effort to make RIFT more accessible, we provide a comprehensive guide for implementing RIFT in cognitive neuroscience. On the basis of the joint experiences and data-driven insights of multiple labs, we provide practical recommendations derived from empirical datasets to improve reproducibility, covering hardware requirements, stimulus design, analysis approaches, and interpretation of results. We hope that this guide helps readers to both identify the conceptual areas where RIFT offers promising insights and navigate the technical caveats that come with the approach.
- Open Access
- 2 September 2025
- Published by Center for Open Science in PsyArXiv
Neural tracking of speech increases in the presence of representational gestures during face-to-face dialogue
Representational gestures have been shown to be beneficial for speech comprehension especially in adverse listening conditions, as they provide meaningful information related to speech. However, it is still unclear whether seeing representational gestures directs additional attention towards the speech signal. In the current study, we addressed this research question by investigating neural tracking of speech in the presence of representational gestures during unscripted dialogue with and without background noise. Dyads performed a tangram-based referential communication task, while audio-visual behavior and dual-EEG were recorded. Representational gestures increased neural tracking of speech in both delta and theta frequencies and in both dialogue conditions in comparison to control movements. This finding suggests that seeing representational gestures directs attention to the processing of both acoustic and linguistic information of the speech signal. As no differences in neural tracking of speech were observed between dialogue conditions, we believe that dyads made use of different strategies to overcome the noise interference. In sum, we argue that neural tracking of speech represents a flexible mechanism which can be modulated by attentional processes to meet different cognitive and communicative demands during face-to-face interaction.
- 2 September 2025
- Published by Center for Open Science in PsyArXiv
Open AccessNeural tracking of speech increases in the presence of representational gestures during face-to-face dialogue
Representational gestures have been shown to be beneficial for speech comprehension especially in adverse listening conditions, as they provide meaningful information related to speech. However, it is still unclear whether seeing representational gestures directs additional attention towards the speech signal. In the current study, we addressed this research question by investigating neural tracking of speech in the presence of representational gestures during unscripted dialogue with and without background noise. Dyads performed a tangram-based referential communication task, while audio-visual behavior and dual-EEG were recorded. Representational gestures increased neural tracking of speech in both delta and theta frequencies and in both dialogue conditions in comparison to control movements. This finding suggests that seeing representational gestures directs attention to the processing of both acoustic and linguistic information of the speech signal. As no differences in neural tracking of speech were observed between dialogue conditions, we believe that dyads made use of different strategies to overcome the noise interference. In sum, we argue that neural tracking of speech represents a flexible mechanism which can be modulated by attentional processes to meet different cognitive and communicative demands during face-to-face interaction.
- Open Access
- 15 July 2025
- Published by MIT Press in Neurobiology of Language
- Vol. 6
Using Rapid Invisible Frequency Tagging (RIFT) to Probe the Neural Interaction Between Representations of Speech Planning and Comprehension
Interlocutors often use the semantics of comprehended speech to inform the semantics of planned speech. Do representations of the comprehension and planning stimuli interact? In this EEG study, we used rapid invisible frequency tagging (RIFT) to better understand the attentional distribution to representations of comprehension and speech planning stimuli, and how they interact in the neural signal. To do this, we leveraged the picture-word interference (PWI) paradigm with delayed naming, where participants simultaneously comprehend auditory distractors (auditory [f1]; tagged at 54 Hz) while preparing to name related or unrelated target pictures (visual [f2]; tagged at 68 Hz). RIFT elicits steady-state evoked potentials, which reflect allocation of attention to the tagged stimuli. When representations of the tagged stimuli interact, increased power has been observed at the intermodulation frequency resulting from an interaction of the base frequencies (f2 ± f1; Drijvers et al., 2021). Our results showed clear power increases at 54 Hz and 68 Hz during the tagging window, but no power difference between the related and unrelated condition. Interestingly, we observed a larger power difference in the intermodulation frequency (compared to baseline) in the unrelated compared to the related condition (68 Hz − 54 Hz: 14 Hz), indicating stronger interaction between unrelated auditory and visual representations. Our results go beyond standard PWI results by showing that participants’ difficulties in the related condition do not arise from allocating attention to the pictures or distractors. Instead, processing difficulties arise during interaction of the concepts or lemmas invoked by the two stimuli, thus, we conclude, that interaction might be downregulated in the related condition.
- 15 July 2025
- Published by MIT Press in Neurobiology of Language
- Vol. 6
Open AccessUsing Rapid Invisible Frequency Tagging (RIFT) to Probe the Neural Interaction Between Representations of Speech Planning and Comprehension
Interlocutors often use the semantics of comprehended speech to inform the semantics of planned speech. Do representations of the comprehension and planning stimuli interact? In this EEG study, we used rapid invisible frequency tagging (RIFT) to better understand the attentional distribution to representations of comprehension and speech planning stimuli, and how they interact in the neural signal. To do this, we leveraged the picture-word interference (PWI) paradigm with delayed naming, where participants simultaneously comprehend auditory distractors (auditory [f1]; tagged at 54 Hz) while preparing to name related or unrelated target pictures (visual [f2]; tagged at 68 Hz). RIFT elicits steady-state evoked potentials, which reflect allocation of attention to the tagged stimuli. When representations of the tagged stimuli interact, increased power has been observed at the intermodulation frequency resulting from an interaction of the base frequencies (f2 ± f1; Drijvers et al., 2021). Our results showed clear power increases at 54 Hz and 68 Hz during the tagging window, but no power difference between the related and unrelated condition. Interestingly, we observed a larger power difference in the intermodulation frequency (compared to baseline) in the unrelated compared to the related condition (68 Hz − 54 Hz: 14 Hz), indicating stronger interaction between unrelated auditory and visual representations. Our results go beyond standard PWI results by showing that participants’ difficulties in the related condition do not arise from allocating attention to the pictures or distractors. Instead, processing difficulties arise during interaction of the concepts or lemmas invoked by the two stimuli, thus, we conclude, that interaction might be downregulated in the related condition.
- Open Access
- 22 April 2025
- Published by SAGE Publications in Psychological Science
- Vol. 36 (4) , 237-248
Co-Speech Hand Gestures Are Used to Predict Upcoming Meaning
In face-to-face conversation, people use speech and gesture to convey meaning. Seeing gestures alongside speech facilitates comprehenders’ language processing, but crucially, the mechanisms underlying this facilitation remain unclear. We investigated whether comprehenders use the semantic information in gestures, typically preceding related speech, to predict upcoming meaning. Dutch adults listened to questions asked by a virtual avatar. Questions were accompanied by an iconic gesture (e.g., typing) or meaningless control movement (e.g., arm scratch) followed by a short pause and target word (e.g., “type”). A Cloze experiment showed that gestures improved explicit predictions of upcoming target words. Moreover, an EEG experiment showed that gestures reduced alpha and beta power during the pause, indicating anticipation, and reduced N400 amplitudes, demonstrating facilitated semantic processing. Thus, comprehenders use iconic gestures to predict upcoming meaning. Theories of linguistic prediction should incorporate communicative bodily signals as predictive cues to capture how language is processed in face-to-face interaction.
- 22 April 2025
- Published by SAGE Publications in Psychological Science
- Vol. 36 (4) , 237-248
Open AccessCo-Speech Hand Gestures Are Used to Predict Upcoming Meaning
In face-to-face conversation, people use speech and gesture to convey meaning. Seeing gestures alongside speech facilitates comprehenders’ language processing, but crucially, the mechanisms underlying this facilitation remain unclear. We investigated whether comprehenders use the semantic information in gestures, typically preceding related speech, to predict upcoming meaning. Dutch adults listened to questions asked by a virtual avatar. Questions were accompanied by an iconic gesture (e.g., typing) or meaningless control movement (e.g., arm scratch) followed by a short pause and target word (e.g., “type”). A Cloze experiment showed that gestures improved explicit predictions of upcoming target words. Moreover, an EEG experiment showed that gestures reduced alpha and beta power during the pause, indicating anticipation, and reduced N400 amplitudes, demonstrating facilitated semantic processing. Thus, comprehenders use iconic gestures to predict upcoming meaning. Theories of linguistic prediction should incorporate communicative bodily signals as predictive cues to capture how language is processed in face-to-face interaction.