Lexical Predictability During Natural Reading: Effects of Surprisal and Entropy Reduction
Top Cited Papers
Open Access
- 14 February 2018
- journal article
- research article
- Published by Wiley in Cognitive Science
- Vol. 42 (S4) , 1166-1183
Abstract
What are the effects of word‐by‐word predictability on sentence processing times during the natural reading of a text? Although information complexity metrics such as surprisal and entropy reduction have been useful in addressing this question, these metrics tend to be estimated using computational language models, which require some degree of commitment to a particular theory of language processing. Taking a different approach, this study implemented a large‐scale cumulative cloze task to collect word‐by‐word predictability data for 40 passages and compute surprisal and entropy reduction values in a theory‐neutral manner. A separate group of participants read the same texts while their eye movements were recorded. Results showed that increases in surprisal and entropy reduction were both associated with increases in reading times. Furthermore, these effects did not depend on the global difficulty of the text. The findings suggest that surprisal and entropy reduction independently contribute to variation in reading times, as these metrics seem to capture different aspects of lexical predictability.Keywords
All Related Versions
Funding Information
- National Institute of Child Health and Human Development (F32 HD084100)
This publication has 43 references indexed in Scilit:
- Limits on lexical prediction during readingCognitive Psychology, 2016
- Abstract linguistic structure correlates with temporal activity during naturalistic comprehensionBrain and Language, 2016
- Prediction, Information Structure, and Good-Enough Language Processing2016
- The ERP response to the amount of information conveyed by words in sentencesBrain and Language, 2015
- The effect of word predictability on reading time is logarithmicCognition, 2013
- Data from eye-tracking corpora as evidence for theories of syntactic processing complexityCognition, 2008
- Expectation-based syntactic comprehensionCognition, 2008
- A Rose by Any Other Name: Long-Term Memory Structure and Sentence ProcessingJournal of Memory and Language, 1999
- The interaction of contextual constraints and parafoveal visual information in readingCognitive Psychology, 1985
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948