Striatal modulation supports policy-specific reinforcement and not action selection
Preprint
Abstract
Two contrasting models dominate our understanding of basal ganglia function: action selection and reinforcement learning. Prolonged, indiscriminate stimulation of direct and indirect pathway striatal neurons produces effects consistent with the action selection; however this approach ignores the transient, movement-specific dynamics that characterize these cells. To determine how striatal subpopulations contribute to mouse behavior, we applied brief closed-loop optogenetic stimulation to modulate ongoing activity in a manner that directly dissociates the contrasting models: upon the detection of locomotor arrest or leftward turns. While action selection models predict that increased direct pathway stimulation should induce locomotion and turning contralaterally to the side of stimulation, selective stimulation biased behavioral policies towards more frequent locomotor arrest and leftward turns, regardless of the side of stimulation. Indirect pathway stimulation had the opposite effect. Behavior followed the policy associated with the change in striatal activity, providing a mechanism to enable the reinforcement a wide range of behavioral features to shape performance.Keywords
This publication has 50 references indexed in Scilit:
- A competitive model for striatal action selectionBrain Research, 2019
- Complementary Contributions of Striatal Projection Pathways to Action Initiation and ExecutionCell, 2016
- Cell-Type-Specific Control of Brainstem Locomotor Circuits by Basal GangliaCell, 2016
- Dopamine Is Required for the Neural Representation and Control of Movement VigorCell, 2015
- The integrative function of the basal ganglia in instrumental conditioningBehavioural Brain Research, 2009
- A computational neuroanatomy for motor controlExperimental Brain Research, 2008
- Building action repertoires: memory and learning functions of the basal gangliaCurrent Opinion in Neurobiology, 1995
- The functional anatomy of basal ganglia disordersTrends in Neurosciences, 1989
- The pallidointralaminar and pallidonigral projections in primate as studied by retrograde double-labeling methodBrain Research, 1983
- The output organization of the substantia nigra in primate as revealed by a retrograde double labeling methodBrain Research Bulletin, 1983