Reduced linguistic coherence in psychosis defies semantic similarity accounts and relates to altered large-scale cortical hierarchy
Open Access
- 8 February 2026
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 16 (1) , 7799
Abstract
Coherence in speech is clinically significant in mental disorders but remains difficult to quantify. We tested the widely-held assumption that semantic similarity metrics derived from large language models capture human-rated coherence. Across three large neurotypical datasets in different languages, semantic similarity failed to correlate with human ratings, while six other metrics, especially the probability-based metrics, showed significant but weak correlations. In an additional English dataset of 94 individuals, including healthy controls and patients with schizophrenia spectrum disorders (SSD), speech coherence was reduced in SSD. Incoherence in the drug-naïve first-episode samples related to altered whole-brain intrinsic functional gradients, and to the probabilistic metric of perplexity in speech. Together, these findings call into question semantic similarity as a proxy for coherence, motivate greater emphasis on probabilistic predictability measures for evaluating coherence, and substantiate the perspective of spontaneous speech as an overt readout of an alteration of hierarchical cortical organization in schizophrenia.Keywords
Funding Information
- European Research Council (ERC-2023-SyG)
This publication has 55 references indexed in Scilit:
- Automated analysis of free speech predicts psychosis onset in high-risk youthsSchizophrenia, 2015
- Neural correlates of the relationship between discourse coherence and sensory monitoring in schizophreniaCortex, 2014
- The organization of the human cerebral cortex estimated by intrinsic functional connectivityJournal of Neurophysiology, 2011
- Where Is the Semantic System? A Critical Review and Meta-Analysis of 120 Functional Neuroimaging StudiesCerebral Cortex, 2009
- Making sense of nonsense: An fMRI study of task induced inference processes during discourse comprehensionBrain Research, 2007
- Statistical validation of the criteria for symptom remission in schizophrenia: Preliminary findingsBMC Psychiatry, 2007
- Quantifying incoherence in speech: An automated methodology and novel application to schizophreniaSchizophrenia Research, 2007
- Making sense of discourse: An fMRI study of causal inferencing across sentencesNeuroImage, 2006
- Thought and Language Index: an instrument for assessing thought and language in schizophreniaThe British Journal of Psychiatry, 2002
- Thought, Language, and Communication DisordersArchives of General Psychiatry, 1979