Harm Brouwer
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Harm Brouwer has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
- Matthew W. Crocker
Department of Language Science and Technology, Saarland University, Germany
7 shared publications Matthew W. Crocker
Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
4 shared publications- Christoph Aurnhammer
Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
3 shared publications - Francesca Delogu
Department of Language Science and Technology Saarland University Saarbrücken Germany
3 shared publications Noortje J. Venhuizen
Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
2 shared publications- Noortje J. Venhuizen
Department of Cognitive Science and Artificial Intelligence, Tilburg University
2 shared publications
Latest Publications
- Open Access
- 14 August 2026
- Published by Elsevier in Psychiatry Research Communications
- Vol. 6 (3)
Beyond seeing only illness in abnormality: Clinical challenges and methodological promises on the road towards precision psychiatry
- 14 August 2026
- Published by Elsevier in Psychiatry Research Communications
- Vol. 6 (3)
Open AccessBeyond seeing only illness in abnormality: Clinical challenges and methodological promises on the road towards precision psychiatry
- Open Access
Mapping meaning in the brain's language
- Open Access
- 8 August 2025
- Published by Elsevier in Brain Research
- Vol. 1865, 149841
On the limits of LLM surprisal as a functional explanation of the N400 and P600
- 8 August 2025
- Published by Elsevier in Brain Research
- Vol. 1865, 149841
Open AccessOn the limits of LLM surprisal as a functional explanation of the N400 and P600
- Open Access
- 29 March 2025
- Published by Elsevier in Brain and Cognition
- Vol. 186, 106293
On the biphasic nature of the N400-P600 complex underlying language comprehension
- 29 March 2025
- Published by Elsevier in Brain and Cognition
- Vol. 186, 106293
Open AccessOn the biphasic nature of the N400-P600 complex underlying language comprehension
- 3 February 2025
- Published by American Psychological Association (APA) in Psychological Review
- Vol. 133 (5) , 1183-1203
Referential retrieval and integration in language comprehension: An electrophysiological perspective.
Referential processing is part and parcel of language comprehension, but in neurocognitive theories and models of comprehension it typically does not take center stage. Models informed by event-related potentials focus on semantic and syntactic processing in terms of the two most salient event-related potentials components, the N400 and P600, while experimental findings have implicated the Nref component-a frontal, sustained negativity-in referential processing. Extant accounts of the Nref assume it reflects processes involved in establishing reference or association at a distance, but an important open question remains how these mechanisms can be reconciled with existing neurocognitive models. We here offer a mechanistic account of referential processing grounded in retrieval-integration (RI) theory, an integrated theory of language comprehension with broad empirical coverage. On RI theory, the conceptual knowledge associated with an incoming word in context is retrieved from long-term memory (N400), and accordingly integrated into the unfolding utterance representation (P600). We here argue that word meaning is not only defined by the conceptual knowledge associated with a word, but also by its referential knowledge (its presuppositions). Whenever this referential knowledge is inconsistent with what is anticipated given the context, increased referential retrieval effort ensues (Nref). In contrast to extant accounts, we do thus not implicate the Nref in the establishment of reference itself, but instead attribute referential resolution to the integrative processes underlying the P600. The resultant referential RI theory integrates the N400, Nref, and P600 in a single model, and its predictions are consistent with extant empirical evidence on referential processing. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
- 3 February 2025
- Published by American Psychological Association (APA) in Psychological Review
- Vol. 133 (5) , 1183-1203
Referential retrieval and integration in language comprehension: An electrophysiological perspective.
Referential processing is part and parcel of language comprehension, but in neurocognitive theories and models of comprehension it typically does not take center stage. Models informed by event-related potentials focus on semantic and syntactic processing in terms of the two most salient event-related potentials components, the N400 and P600, while experimental findings have implicated the Nref component-a frontal, sustained negativity-in referential processing. Extant accounts of the Nref assume it reflects processes involved in establishing reference or association at a distance, but an important open question remains how these mechanisms can be reconciled with existing neurocognitive models. We here offer a mechanistic account of referential processing grounded in retrieval-integration (RI) theory, an integrated theory of language comprehension with broad empirical coverage. On RI theory, the conceptual knowledge associated with an incoming word in context is retrieved from long-term memory (N400), and accordingly integrated into the unfolding utterance representation (P600). We here argue that word meaning is not only defined by the conceptual knowledge associated with a word, but also by its referential knowledge (its presuppositions). Whenever this referential knowledge is inconsistent with what is anticipated given the context, increased referential retrieval effort ensues (Nref). In contrast to extant accounts, we do thus not implicate the Nref in the establishment of reference itself, but instead attribute referential resolution to the integrative processes underlying the P600. The resultant referential RI theory integrates the N400, Nref, and P600 in a single model, and its predictions are consistent with extant empirical evidence on referential processing. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
- Open Access
- 20 June 2023
- Published by Springer Nature in Cognitive Neurodynamics
- Vol. 18 (6) , 3309-3325
Single-trial neurodynamics reveal N400 and P600 coupling in language comprehension
Theories of the electrophysiology of language comprehension are mostly informed by event-related potential effects observed between condition averages. We here argue that a dissociation between competing effect-level explanations of event-related potentials can be achieved by turning to predictions and analyses at the single-trial level. Specifically, we examine the single-trial dynamics in event-related potential data that exhibited a biphasic N400–P600 effect pattern. A group of multi-stream models can explain biphasic effects by positing that each individual trial should induce either an N400 increase or a P600 increase, but not both. An alternative, single-stream account, Retrieval-Integration theory, explicitly predicts that N400 amplitude and P600 amplitude should be correlated at the single-trial level. In order to investigate the single-trial dynamics of the N400 and the P600, we apply a regression-based technique in which we quantify the extent to which N400 amplitudes are predictive of the electroencephalogram in the P600 time window. Our findings suggest that, indeed, N400 amplitudes and P600 amplitudes are inversely correlated within-trial and, hence, the N400 effect and the P600 effect in biphasic data are driven by the same trials. Critically, we demonstrate that this finding also extends to data which exhibited only monophasic effects between conditions. In sum, the observation that the N400 is inversely correlated with the P600 on a by-trial basis supports a single stream view, such as Retrieval-Integration theory, and is difficult to reconcile with the processing mechanisms proposed by multi-stream models.
- 20 June 2023
- Published by Springer Nature in Cognitive Neurodynamics
- Vol. 18 (6) , 3309-3325
Open AccessSingle-trial neurodynamics reveal N400 and P600 coupling in language comprehension
Theories of the electrophysiology of language comprehension are mostly informed by event-related potential effects observed between condition averages. We here argue that a dissociation between competing effect-level explanations of event-related potentials can be achieved by turning to predictions and analyses at the single-trial level. Specifically, we examine the single-trial dynamics in event-related potential data that exhibited a biphasic N400–P600 effect pattern. A group of multi-stream models can explain biphasic effects by positing that each individual trial should induce either an N400 increase or a P600 increase, but not both. An alternative, single-stream account, Retrieval-Integration theory, explicitly predicts that N400 amplitude and P600 amplitude should be correlated at the single-trial level. In order to investigate the single-trial dynamics of the N400 and the P600, we apply a regression-based technique in which we quantify the extent to which N400 amplitudes are predictive of the electroencephalogram in the P600 time window. Our findings suggest that, indeed, N400 amplitudes and P600 amplitudes are inversely correlated within-trial and, hence, the N400 effect and the P600 effect in biphasic data are driven by the same trials. Critically, we demonstrate that this finding also extends to data which exhibited only monophasic effects between conditions. In sum, the observation that the N400 is inversely correlated with the P600 on a by-trial basis supports a single stream view, such as Retrieval-Integration theory, and is difficult to reconcile with the processing mechanisms proposed by multi-stream models.
- Top Cited PapersOpen Access
- 11 April 2023
- Published by Wiley in Psychophysiology
- Vol. 60 (9) , e14302
The P600 as a continuous index of integration effort
The integration of word meaning into an unfolding utterance representation is a core operation of incremental language comprehension. There is considerable debate, however, as to which component of the ERP signal—the N400 or the P600—directly reflects integrative processes, with far reaching consequences for the temporal organization and architecture of the comprehension system. Multi‐stream models maintaining the N400 as integration crucially rely on the presence of a semantically attractive plausible alternative interpretation to account for the absence of an N400 effect in response to certain semantic anomalies, as reported in previous studies. The single‐stream Retrieval–Integration account posits the P600 as an index of integration, further predicting that its amplitude varies continuously with integrative effort. Here, we directly test these competing hypotheses using a context manipulation design in which a semantically attractive alternative is either available or not, and target word plausibility is varied across three levels. An initial self‐paced reading study revealed graded reading times for plausibility, suggesting differential integration effort. A subsequent ERP study showed no N400 differences across conditions, and that P600 amplitude is graded for plausibility. These findings are inconsistent with the interpretation of the N400 as an index of integration, as no N400 effect emerged even in the absence of a semantically attractive alternative. By contrast, the link between plausibility, reading times, and P600 amplitude supports the view that the P600 is a continuous index of integration effort. More generally, our results support a single‐stream architecture and eschew the need for multi‐stream accounts.
- 11 April 2023
- Published by Wiley in Psychophysiology
- Vol. 60 (9) , e14302
Top Cited PapersOpen AccessThe P600 as a continuous index of integration effort
The integration of word meaning into an unfolding utterance representation is a core operation of incremental language comprehension. There is considerable debate, however, as to which component of the ERP signal—the N400 or the P600—directly reflects integrative processes, with far reaching consequences for the temporal organization and architecture of the comprehension system. Multi‐stream models maintaining the N400 as integration crucially rely on the presence of a semantically attractive plausible alternative interpretation to account for the absence of an N400 effect in response to certain semantic anomalies, as reported in previous studies. The single‐stream Retrieval–Integration account posits the P600 as an index of integration, further predicting that its amplitude varies continuously with integrative effort. Here, we directly test these competing hypotheses using a context manipulation design in which a semantically attractive alternative is either available or not, and target word plausibility is varied across three levels. An initial self‐paced reading study revealed graded reading times for plausibility, suggesting differential integration effort. A subsequent ERP study showed no N400 differences across conditions, and that P600 amplitude is graded for plausibility. These findings are inconsistent with the interpretation of the N400 as an index of integration, as no N400 effect emerged even in the absence of a semantically attractive alternative. By contrast, the link between plausibility, reading times, and P600 amplitude supports the view that the P600 is a continuous index of integration effort. More generally, our results support a single‐stream architecture and eschew the need for multi‐stream accounts.
- Open Access
- 16 August 2021
- Published by MDPI AG in Information
- Vol. 12 (8) , 329
Semantic Systematicity in Connectionist Language Production
Decades of studies trying to define the extent to which artificial neural networks can exhibit systematicity suggest that systematicity can be achieved by connectionist models but not by default. Here we present a novel connectionist model of sentence production that employs rich situation model representations originally proposed for modeling systematicity in comprehension. The high performance of our model demonstrates that such representations are also well suited to model language production. Furthermore, the model can produce multiple novel sentences for previously unseen situations, including in a different voice (actives vs. passive) and with words in new syntactic roles, thus demonstrating semantic and syntactic generalization and arguably systematicity. Our results provide yet further evidence that such connectionist approaches can achieve systematicity, in production as well as comprehension. We propose our positive results to be a consequence of the regularities of the microworld from which the semantic representations are derived, which provides a sufficient structure from which the neural network can interpret novel inputs.
- 16 August 2021
- Published by MDPI AG in Information
- Vol. 12 (8) , 329
Open AccessSemantic Systematicity in Connectionist Language Production
Decades of studies trying to define the extent to which artificial neural networks can exhibit systematicity suggest that systematicity can be achieved by connectionist models but not by default. Here we present a novel connectionist model of sentence production that employs rich situation model representations originally proposed for modeling systematicity in comprehension. The high performance of our model demonstrates that such representations are also well suited to model language production. Furthermore, the model can produce multiple novel sentences for previously unseen situations, including in a different voice (actives vs. passive) and with words in new syntactic roles, thus demonstrating semantic and syntactic generalization and arguably systematicity. Our results provide yet further evidence that such connectionist approaches can achieve systematicity, in production as well as comprehension. We propose our positive results to be a consequence of the regularities of the microworld from which the semantic representations are derived, which provides a sufficient structure from which the neural network can interpret novel inputs.
- Open Access
- 11 February 2021
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 12
Neurobehavioral Correlates of Surprisal in Language Comprehension: A Neurocomputational Model
Expectation-based theories of language comprehension, in particular Surprisal Theory, go a long way in accounting for the behavioral correlates of word-by-word processing difficulty, such as reading times. An open question, however, is in which component(s) of the Event-Related brain Potential (ERP) signal Surprisal is reflected, and how these electrophysiological correlates relate to behavioral processing indices. Here, we address this question by instantiating an explicit neurocomputational model of incremental, word-by-word language comprehension that produces estimates of the N400 and the P600—the two most salient ERP components for language processing—as well as estimates of “comprehension-centric” Surprisal for each word in a sentence. We derive model predictions for a recent experimental design that directly investigates “world-knowledge”-induced Surprisal. By relating these predictions to both empirical electrophysiological and behavioral results, we establish a close link between Surprisal, as indexed by reading times, and the P600 component of the ERP signal. The resultant model thus offers an integrated neurobehavioral account of processing difficulty in language comprehension.
- 11 February 2021
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 12
Open AccessNeurobehavioral Correlates of Surprisal in Language Comprehension: A Neurocomputational Model
Expectation-based theories of language comprehension, in particular Surprisal Theory, go a long way in accounting for the behavioral correlates of word-by-word processing difficulty, such as reading times. An open question, however, is in which component(s) of the Event-Related brain Potential (ERP) signal Surprisal is reflected, and how these electrophysiological correlates relate to behavioral processing indices. Here, we address this question by instantiating an explicit neurocomputational model of incremental, word-by-word language comprehension that produces estimates of the N400 and the P600—the two most salient ERP components for language processing—as well as estimates of “comprehension-centric” Surprisal for each word in a sentence. We derive model predictions for a recent experimental design that directly investigates “world-knowledge”-induced Surprisal. By relating these predictions to both empirical electrophysiological and behavioral results, we establish a close link between Surprisal, as indexed by reading times, and the P600 component of the ERP signal. The resultant model thus offers an integrated neurobehavioral account of processing difficulty in language comprehension.
- Open Access
- 8 September 2020
- Published by Wiley in European Journal of Neuroscience
- Vol. 53 (4) , 974-995
Splitting event‐related potentials: Modeling latent components using regression‐based waveform estimation
Event‐related potentials (ERPs) provide a multidimensional and real‐time window into neurocognitive processing. The typical Waveform‐based Component Structure (WCS) approach to ERPs assesses the modulation pattern of components—systematic, reoccurring voltage fluctuations reflecting specific computational operations—by looking at mean amplitude in predetermined time‐windows. This WCS approach, however, often leads to inconsistent results within as well as across studies. It has been argued that at least some inconsistencies may be reconciled by considering spatiotemporal overlap between components; that is, components may overlap in both space and time, and given their additive nature, this means that the WCS may fail to accurately represent its underlying latent component structure (LCS). We employ regression‐based ERP (rERP) estimation to extend traditional approaches with an additional layer of analysis, which enables the explicit modeling of the LCS underlying WCS. To demonstrate its utility, we incrementally derive an rERP analysis of a recent study on language comprehension with seemingly inconsistent WCS‐derived results. Analysis of the resultant regression models allows one to derive an explanation for the WCS in terms of how relevant regression predictors combine in space and time, and crucially, how individual predictors may be mapped onto unique components in LCS, revealing how these spatiotemporally overlap in the WCS. We conclude that rERP estimation allows for investigating how scalp‐recorded voltages derive from the spatiotemporal combination of experimentally manipulated factors. Moreover, when factors can be uniquely mapped onto components, rERPs may offer explanations for seemingly inconsistent ERP waveforms at the level of their underlying latent component structure.
- 8 September 2020
- Published by Wiley in European Journal of Neuroscience
- Vol. 53 (4) , 974-995
Open AccessSplitting event‐related potentials: Modeling latent components using regression‐based waveform estimation
Event‐related potentials (ERPs) provide a multidimensional and real‐time window into neurocognitive processing. The typical Waveform‐based Component Structure (WCS) approach to ERPs assesses the modulation pattern of components—systematic, reoccurring voltage fluctuations reflecting specific computational operations—by looking at mean amplitude in predetermined time‐windows. This WCS approach, however, often leads to inconsistent results within as well as across studies. It has been argued that at least some inconsistencies may be reconciled by considering spatiotemporal overlap between components; that is, components may overlap in both space and time, and given their additive nature, this means that the WCS may fail to accurately represent its underlying latent component structure (LCS). We employ regression‐based ERP (rERP) estimation to extend traditional approaches with an additional layer of analysis, which enables the explicit modeling of the LCS underlying WCS. To demonstrate its utility, we incrementally derive an rERP analysis of a recent study on language comprehension with seemingly inconsistent WCS‐derived results. Analysis of the resultant regression models allows one to derive an explanation for the WCS in terms of how relevant regression predictors combine in space and time, and crucially, how individual predictors may be mapped onto unique components in LCS, revealing how these spatiotemporally overlap in the WCS. We conclude that rERP estimation allows for investigating how scalp‐recorded voltages derive from the spatiotemporal combination of experimentally manipulated factors. Moreover, when factors can be uniquely mapped onto components, rERPs may offer explanations for seemingly inconsistent ERP waveforms at the level of their underlying latent component structure.