Cognitive graphs: Representational substrates for planning.
- 1 October 2024
- journal article
- research article
- Published by American Psychological Association (APA) in Decision
- Vol. 11 (4) , 537-556
Abstract
Making plans for upcoming actions is a computationally demanding process. To mitigate these demands, individuals can build extensive internal models of their environment—states, actions, and their sequential relationships—that allow for plans to be developed with minimal computational costs. Initially, these models reflect elaborate networks of learned associative relationships, which can be used to generate plans for reward through more iterative computations such as trajectory sampling. After sufficient experience, compressed forms of these models can efficiently capture long-range sequential structure, allowing them to be used for rapid planning even in pursuit of novel or changing rewards. Here, we review recent work on the multitude of representations that can support different forms of planning. We discuss how cognitive graphs, a framework with roots in both cognitive psychology and computer science, can provide a unifying view of these representations and their relationships to one another. Conceptualizing internal models as forms of graphs situates them on a spectrum where different kinds of structured sequences can be queried to support both planning and the formation of iteratively more compressed predictive representations. We discuss how each of these kinds of cognitive graphs are created during learning, and used to transfer and generalize knowledge across environments. Taken together, this review highlights the significant impact that the various associative structures of memory have on planning.Keywords
All Related Versions
Funding Information
- National Institute on Aging (R21AG072673)
- National Institute of Neurological Disorders and Stroke (R01NS119468)
This publication has 85 references indexed in Scilit:
- Dynamic decision making: Empirical and theoretical directions2022
- Mixing memory and desire: How memory reactivation supports deliberative decision‐makingWIREs Cognitive Science, 2021
- Gender Disparity in Citations in High-Impact Journal ArticlesJAMA Network Open, 2021
- Policy compression: An information bottleneck in action selection2021
- The Tolman-Eichenbaum Machine: Unifying Space and Relational Memory through Generalization in the Hippocampal FormationCell, 2020
- Depressive symptoms bias the prediction-error enhancement of memory towards negative events in reinforcement learningPsychopharmacology, 2019
- Decisions from experience: Why small samples?Cognition, 2010
- Pulling out the intentional structure of action: the relation between action processing and action production in infancyCognition, 2005
- Small feedback‐based decisions and their limited correspondence to description‐based decisionsJournal of Behavioral Decision Making, 2003
- A Distributed Representation of Temporal ContextJournal of Mathematical Psychology, 2002