Using hippocampal-striatal loops for spatial navigation and goal-directed decision-making
- 18 July 2012
- journal article
- Published by Springer Nature in Cognitive Processing
- Vol. 13 (S1) , 125-129
Abstract
The hippocampus plays a central role in spatial representation, declarative and episodic memory. In this area, so-called place cells possess high spatial selectivity, firing preferentially when the individual is within a small area of the environment. Interestingly, it has been found in rats that these cells can be active also when the animal is outside the location or context of their corresponding place field producing so-called “forward sweeps”. These typically occur at decision points during task execution and seem to be utilized, among other things, for the evaluation of potential alternative paths. Anticipatory firing is also found in the ventral striatum, a brain area that is strongly interconnected with the hippocampus and is known to encode value and reward. In this paper, we describe a biologically based computational model of the hippocampal-ventral striatum circuit that implements a goal-directed mechanism of choice, with the hippocampus primarily involved in the mental simulation of possible navigation paths and the ventral striatum involved in the evaluation of the associated reward expectancies. The model is validated in a navigation task in which a rat is placed in a complex maze with multiple rewarding sites. We show that the rat mentally activates place cells to simulate paths, estimate their value, and make decisions, implementing two essential processes of model-based reinforcement learning algorithms of choice: look-ahead prediction and the evaluation of predicted states.Keywords
This publication has 12 references indexed in Scilit:
- Spatial Learning and Action Planning in a Prefrontal Cortical Network ModelPLOS Computational Biology, 2011
- Preplay of future place cell sequences by hippocampal cellular assembliesNature, 2010
- Hippocampus Leads Ventral Striatum in Replay of Place-Reward InformationPLOS Biology, 2009
- Prediction, sequences and the hippocampusPhilosophical Transactions of the Royal Society B: Biological Sciences, 2009
- Using Imagination to Understand the Neural Basis of Episodic MemoryThe Journal of Neuroscience, 2007
- Neural Ensembles in CA3 Transiently Encode Paths Forward of the Animal at a Decision PointThe Journal of Neuroscience, 2007
- Pattern Separation in the Dentate Gyrus and CA3 of the HippocampusScience, 2007
- Self-projection and the brainTrends in Cognitive Sciences, 2007
- Independent Codes for Spatial and Episodic Memory in Hippocampal Neuronal EnsemblesScience, 2005
- A neuron model with fluid properties for solving labyrinthian puzzleBiological Cybernetics, 1990