A Cross-Linguistic Pressure for Uniform Information Density in Word Order
Top Cited Papers
Open Access
- 15 August 2023
- journal article
- research article
- Published by MIT Press in Transactions of the Association for Computational Linguistics
- Vol. 11, 1048-1065
Abstract
While natural languages differ widely in both canonical word order and word order flexibility, their word orders still follow shared cross-linguistic statistical patterns, often attributed to functional pressures. In the effort to identify these pressures, prior work has compared real and counterfactual word orders. Yet one functional pressure has been overlooked in such investigations: The uniform information density (UID) hypothesis, which holds that information should be spread evenly throughout an utterance. Here, we ask whether a pressure for UID may have influenced word order patterns cross-linguistically. To this end, we use computational models to test whether real orders lead to greater information uniformity than counterfactual orders. In our empirical study of 10 typologically diverse languages, we find that: (i) among SVO languages, real word orders consistently have greater uniformity than reverse word orders, and (ii) only linguistically implausible counterfactual orders consistently exceed the uniformity of real orders. These findings are compatible with a pressure for information uniformity in the development and usage of natural languages.1Keywords
All Related Versions
This publication has 56 references indexed in Scilit:
- Word lengths are optimized for efficient communicationProceedings of the National Academy of Sciences, 2011
- In search of on-line locality effects in sentence comprehension.Journal of Experimental Psychology: Learning, Memory, and Cognition, 2011
- On language ‘utility’: processing complexity and communicative efficiencyWIREs Cognitive Science, 2010
- Redundancy and reduction: Speakers manage syntactic information densityCognitive Psychology, 2010
- Do Grammars Minimize Dependency Length?Cognitive Science, 2010
- The natural order of events: How speakers of different languages represent events nonverballyProceedings of the National Academy of Sciences, 2008
- Expectation-based syntactic comprehensionCognition, 2008
- Euclidean distance between syntactically linked wordsPhysical Review E, 2004
- Explaining word order in the noun phraseLinguistics, 1990
- Word Order Universals RevisitedBelgian Journal of Linguistics, 1986