Self-generation of goal-directed choices in a distributed dopaminergic and prefrontal circuit
Preprint
Abstract
Summary: Goal-directed choices that are not triggered by external cues arise from internal representations of the outcomes. The use of a stimulus to specify when to act, which option to take, or whether to explore, has led to consider the reward circuit as a feedforward set of modules carrying independent computations. Here, we develop an uncued task in which mice self-determine the initiation, direction, vigor and pace of their actions based on their knowledge of the outcomes. Using electrophysiological recordings, pharmacology and optogenetics, we identify a sequence of oscillations and firing in the ventral tegmental area (VTA), orbitofrontal (OFC) and prefrontal cortices (PFC) that co-encodes and co-determines self-initiation and choices. This sequence appeared with learning as an unguided realignment of spontaneous dynamics. The interactions between the structures depended on the reward context, in particular regarding the uncertainty associated with the different options. We suggest that self-generated choices arise from a distributed circuit based on an OFC-VTA core setting whether to wait or to initiate actions, while the PFC is specifically engaged by reward uncertainty to participate in both the selection and pace of actions. Highlights: Self-paced actions arise from contextual reorganization of mesocortical dynamics. VTA, PFC and OFC complementarily encode predictions and errors about outcomes. Distributed firing-then-oscillations dynamics set the goal, initiation and pace of actions. VTA and PFC antagonistically promote and inhibit motivation by reward uncertainty.Keywords
This publication has 71 references indexed in Scilit:
- Phasic Mesolimbic Dopamine Signaling Precedes and Predicts Performance of a Self-Initiated Action Sequence TaskBiological Psychiatry, 2012
- Transient activation of midbrain dopamine neurons by reward riskNeuroscience, 2011
- Expectancy-related changes in firing of dopamine neurons depend on orbitofrontal cortexNature Neuroscience, 2011
- A 4 Hz Oscillation Adaptively Synchronizes Prefrontal, VTA, and Hippocampal ActivitiesNeuron, 2011
- Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesisProceedings of the National Academy of Sciences, 2011
- Medial frontal cortex: from self-generated action to reflection on one's own performanceTrends in Cognitive Sciences, 2010
- The Reward Circuit: Linking Primate Anatomy and Human ImagingNeuropsychopharmacology, 2009
- Risk-dependent reward value signal in human prefrontal cortexProceedings of the National Academy of Sciences, 2009
- The Orbitofrontal Cortex and Ventral Tegmental Area Are Necessary for Learning from Unexpected OutcomesNeuron, 2009
- Dopamine neurons encode the better option in rats deciding between differently delayed or sized rewardsNature Neuroscience, 2007