Language models, like humans, show content effects on reasoning tasks
Top Cited Papers
Open Access
- 28 June 2024
- journal article
- research article
- Published by Oxford University Press (OUP) in PNAS Nexus
- Vol. 3 (7) , pgae233
Abstract
Reasoning is a key ability for an intelligent system. Large language models (LMs) achieve above-chance performance on abstract reasoning tasks but exhibit many imperfections. However, human abstract reasoning is also imperfect. Human reasoning is affected by our real-world knowledge and beliefs, and shows notable “content effects”; humans reason more reliably when the semantic content of a problem supports the correct logical inferences. These content-entangled reasoning patterns are central to debates about the fundamental nature of human intelligence. Here, we investigate whether language models—whose prior expectations capture some aspects of human knowledge—similarly mix content into their answers to logic problems. We explored this question across three logical reasoning tasks: natural language inference, judging the logical validity of syllogisms, and the Wason selection task. We evaluate state of the art LMs, as well as humans, and find that the LMs reflect many of the same qualitative human patterns on these tasks—like humans, models answer more accurately when the semantic content of a task supports the logical inferences. These parallels are reflected in accuracy patterns, and in some lower-level features like the relationship between LM confidence over possible answers and human response times. However, in some cases the humans and models behave differently—particularly on the Wason task, where humans perform much worse than large models, and exhibit a distinct error pattern. Our findings have implications for understanding possible contributors to these human cognitive effects, as well as the factors that influence language model performance.Keywords
All Related Versions
This publication has 45 references indexed in Scilit:
- Integrated Intelligence from Distributed Brain ActivityTrends in Cognitive Sciences, 2020
- Distributed semantic representations for modeling human judgmentCurrent Opinion in Behavioral Sciences, 2019
- Letting structure emerge: connectionist and dynamical systems approaches to cognitionTrends in Cognitive Sciences, 2010
- In two minds: dual-process accounts of reasoningTrends in Cognitive Sciences, 2003
- Using Language1996
- The logic of social exchange: Has natural selection shaped how humans reason? Studies with the Wason selection taskCognition, 1989
- Connectionism and cognitive architecture: A critical analysisCognition, 1988
- Pragmatic reasoning schemasCognitive Psychology, 1985
- Judgment under Uncertainty1982
- Speed-accuracy tradeoff and information processing dynamicsActa Psychologica, 1977