Dopamine-Mediated Learning and Switching in Cortico-Striatal Circuit Explain Behavioral Changes in Reinforcement Learning
Authors:
Open Access
- 1 January 2011
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Behavioral Neuroscience
- Vol. 5, 8477
Abstract
The basal ganglia (BG) are thought to play a crucial role in reinforcement learning. Central to the learning mechanism are dopamine D1 and D2 receptors located in the cortico-striatal synapses. However, it is still unclear how this dopamine-mediated synaptic plasticity is deployed and coordinated during reward-contingent behavioral changes. Here we propose a computational model of reinforcement learning that uses different thresholds of D1- and D2-mediated synaptic plasticity which are antagonized by dopamine-independent synaptic plasticity. A phasic increase in dopamine release caused by a larger-than-expected reward induces long-term potentiation (LTP) in the direct pathway, whereas a phasic decrease in dopamine release caused by a smaller-than-expected reward induces a cessation of long-term depression (LTD), leading to LTP in the indirect pathway. This learning mechanism can explain the robust behavioral adaptation observed in a location-reward-value-association task where the animal makes shorter latency saccades to rewarding locations. The changes in saccade latency become quicker as the monkey becomes more experienced. This behavior can be explained by a switching mechanism which activates the cortico-striatal circuit selectively. Our model can also simulate the effects of D1 and D2 receptor blockade, and behavioral changes in Parkinson’s disease.Keywords
This publication has 79 references indexed in Scilit:
- Rule-based categorization deficits in focal basal ganglia lesion and Parkinson's disease patientsNeuropsychologia, 2010
- Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitryNature, 2010
- Mechanisms Underlying Dopamine-Mediated Reward Bias in Compulsive BehaviorsNeuron, 2010
- Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skillNature Neuroscience, 2009
- The Globus Pallidus Sends Reward-Related Signals to the Lateral HabenulaNeuron, 2008
- Dichotomous Dopaminergic Control of Striatal Synaptic PlasticityScience, 2008
- Single dose of a dopamine agonist impairs reinforcement learning in humans: Behavioral evidence from a laboratory-based measure of reward responsivenessPsychopharmacology, 2007
- Dopamine-dependent prediction errors underpin reward-seeking behaviour in humansNature, 2006
- A Neural Substrate of Prediction and RewardScience, 1997
- AGEING AND PARKINSON'S DISEASE: SUBSTANTIA NIGRA REGIONAL SELECTIVITYBrain, 1991