Efficient coding of cognitive variables underlies dopamine response and choice behavior
- 6 June 2022
- journal article
- research article
- Published by Springer Nature in Nature Neuroscience
- Vol. 25 (6) , 738-748
Abstract
Reward expectations based on internal knowledge of the external environment are a core component of adaptive behavior. However, internal knowledge may be inaccurate or incomplete due to errors in sensory measurements. Some features of the environment may also be encoded inaccurately to minimize representational costs associated with their processing. In this study, we investigated how reward expectations are affected by features of internal representations by studying behavior and dopaminergic activity while mice make time-based decisions. We show that several possible representations allow a reinforcement learning agent to model animals’ overall performance during the task. However, only a small subset of highly compressed representations simultaneously reproduced the co-variability in animals’ choice behavior and dopaminergic activity. Strikingly, these representations predict an unusual distribution of response times that closely match animals’ behavior. These results inform how constraints of representational efficiency may be expressed in encoding representations of dynamic cognitive variables used for reward-based computations.Keywords
This publication has 47 references indexed in Scilit:
- Generalization of value in reinforcement learning by humansEuropean Journal of Neuroscience, 2012
- Building Bridges between Perceptual and Economic Decision-Making: Neural and Computational MechanismsFrontiers in Neuroscience, 2012
- Hierarchically organized behavior and its neural foundations: A reinforcement learning perspectiveCognition, 2009
- Representation of Confidence Associated with a Decision by Neurons in the Parietal CortexScience, 2009
- Stimulus Representation and the Timing of Reward-Prediction Errors in Models of the Dopamine SystemNeural Computation, 2008
- How Behavioral Constraints May Determine Optimal Sensory RepresentationsPLOS Biology, 2006
- Representation and Timing in Theories of the Dopamine SystemNeural Computation, 2006
- Discrete Coding of Reward Probability and Uncertainty by Dopamine NeuronsScience, 2003
- A Neural Substrate of Prediction and RewardScience, 1997
- Naturalistic stimuli increase the rate and efficiency of information transmission by primary auditory afferentsProceedings Of The Royal Society B-Biological Sciences, 1995