Humans can navigate complex graph structures acquired during latent learning
Authors:
- Milena RmusMRMilena Rmus
- Harrison RitzHRHarrison Ritz
- Lindsay E HunterLHLindsay E Hunter
- Aaron M BornsteinABAaron M Bornstein
- Amitai ShenhavASAmitai Shenhav
Preprint
Abstract
Humans appear to represent many forms of knowledge in associative networks whose nodes are multiply connected, including sensory, spatial, and semantic. Recent work has shown that explicitly augmenting artificial agents with such graph-structured representations endows them with more human-like capabilities of compositionality and transfer learning. An open question is how humans acquire these representations. Previously, it has been shown that humans can learn to navigate graph-structured conceptual spaces on the basis of direct experience with trajectories that intentionally draw the network contours (Schapiro et al., 2012;2016), or through direct experience with rewards that covary with the underlying associative distance (Wu et al., 2018). Here, we provide initial evidence that this capability is more general, extending to learning to reason about shortest-path distances across a graph structure acquired across disjoint experiences with randomized edges of the graph - a form of latent learning. In other words, we show that humans can infe r graph structures, assembling them from disordered experiences. We further show that the degree to which individuals learn to reason correctly and with reference to the structure of the graph corresponds to their propensity, in a separate task, to use model-based reinforcement learning to achieve rewards. This connection suggests that the correct acquisition of graph-structured relationships is a central ability underlying forward planning and reasoning, and may be a core computation across the many domains in which graph-based reasoning is advantageous.Keywords
All Related Versions
- Published version: Cognition, 225, 105103.
This publication has 52 references indexed in Scilit:
- The Emergence and Representation of Knowledge about Social and Nonsocial HierarchiesNeuron, 2012
- Preference by Association: How Memory Mechanisms in the Hippocampus Bias DecisionsScience, 2012
- Generalization of value in reinforcement learning by humansEuropean Journal of Neuroscience, 2012
- Model-Based Influences on Humans' Choices and Striatal Prediction ErrorsNeuron, 2011
- Evidence for Model-Based Action Planning in a Sequential Finger Movement TaskJournal of Motor Behavior, 2010
- Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision PointThe Journal of Neuroscience, 2007
- Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learningArtificial Intelligence, 1999
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- A Probabilistic Model of Lexical and Syntactic Access and DisambiguationCognitive Science, 1996
- Cognitive maps in rats and men.Psychological Review, 1948