Pupil Correlates of Decision Variables in Mice Playing a Competitive Mixed-Strategy Game
Open Access
- 15 February 2022
- journal article
- research article
- Published by Society for Neuroscience in eneuro
- Vol. 9 (2)
Abstract
In a competitive game involving an animal and an opponent, the outcome is contingent on the choices of both players. To succeed, the animal must continually adapt to competitive pressure, or else risk being exploited and lose out on rewards. In this study, we demonstrate that head-fixed male mice can be trained to play the iterative competitive game “matching pennies” against a virtual computer opponent. We find that the animals’ performance is well described by a hybrid computational model that includes Q-learning and choice kernels. Comparing between matching pennies and a non-competitive two-armed bandit task, we show that the tasks encourage animals to operate at different regimes of reinforcement learning. To understand the involvement of neuromodulatory mechanisms, we measure fluctuations in pupil size and use multiple linear regression to relate the trial-by-trial transient pupil responses to decision-related variables. The analysis reveals that pupil responses are modulated by observable variables, including choice and outcome, as well as latent variables for value updating, but not action selection. Collectively, these results establish a paradigm for studying competitive decision-making in head-fixed mice and provide insights into the role of arousal-linked neuromodulation in the decision process. Visual AbstractKeywords
All Related Versions
This publication has 55 references indexed in Scilit:
- Rational regulation of learning dynamics by pupil-linked arousal systemsNature Neuroscience, 2012
- Role of rodent secondary motor cortex in value-based action selectionNature Neuroscience, 2011
- Distinct Roles of Rodent Orbitofrontal and Medial Prefrontal Cortex in Decision MakingNeuron, 2010
- Lateral Intraparietal Cortex and Reinforcement Learning during a Mixed-Strategy GameJournal of Neuroscience, 2009
- Behavioral and Neural Changes after Gains and Losses of Conditioned ReinforcersJournal of Neuroscience, 2009
- PIGEONS (COLUMBA LIVIA) APPROACH NASH EQUILIBRIUM IN EXPERIMENTAL MATCHING PENNIES COMPETITIONSJournal of the Experimental Analysis of Behavior, 2009
- Neural correlates of mentalizing-related computations during strategic interactions in humansProceedings of the National Academy of Sciences, 2008
- Game theory and neural basis of social decision makingNature Neuroscience, 2008
- Temporal Filtering of Reward Signals in the Dorsal Anterior Cingulate Cortex during a Mixed-Strategy GameJournal of Neuroscience, 2007
- Neural mechanism for stochastic behaviour during a competitive gameNeural Networks, 2006