What Can Language Models Tell Us About Human Cognition?
Authors:
Open Access
- 28 April 2024
- journal article
- research article
- Published by SAGE Publications in Current Directions in Psychological Science
- Vol. 33 (3) , 181-189
Abstract
Language models are a rapidly developing field of artificial intelligence with enormous potential to improve our understanding of human cognition. However, many popular language models are cognitively implausible on multiple fronts. For language models to offer plausible insights into human cognitive processing, they should implement a transparent and cognitively plausible learning mechanism, train on a quantity of text that is achievable in a human’s lifetime of language exposure, and not assume to represent all of word meaning. When care is taken to create plausible language models within these constraints, they can be a powerful tool in uncovering the nature and scope of how language shapes semantic knowledge. The distributional relationships between words, which humans represent in memory as linguistic distributional knowledge, allow people to represent and process semantic information flexibly, robustly, and efficiently.Keywords
All Related Versions
Funding Information
- H2020 European Research Council (682848)
This publication has 34 references indexed in Scilit:
- Scalable cognitive modelling: Putting Simon’s (1969) ant back on the beach.Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale, 2023
- Making sense of sensory language: Acquisition of sensory knowledge by individuals with congenital sensory impairmentsNeuropsychologia, 2022
- A comparative evaluation and analysis of three generations of Distributional Semantic ModelsLanguage Resources and Evaluation, 2022
- Building semantic memory from embodied and distributional language experienceWIREs Cognitive Science, 2021
- Catastrophic Interference in Predictive Neural Network Models of Distributional SemanticsComputational Brain & Behavior, 2020
- Explaining human performance in psycholinguistic tasks with models of semantic similarity based on prediction and counting: A review and empirical validationJournal of Memory and Language, 2017
- Optimal foraging in semantic memory.Psychological Review, 2012
- The linguistic and embodied nature of conceptual processingCognition, 2010
- Representing word meaning and order information in a composite holographic lexicon.Psychological Review, 2007
- The symbol grounding problemPhysica D: Nonlinear Phenomena, 1990