Reward learning and working memory: Effects of massed versus spaced training and post-learning delay period
Open Access
- 14 September 2021
- journal article
- research article
- Published by Springer Nature in Memory & Cognition
- Vol. 50 (2) , 312-324
Abstract
Neuroscience research has illuminated the mechanisms supporting learning from reward feedback, demonstrating a critical role for the striatum and midbrain dopamine system. However, in humans, short-term working memory that is dependent on frontal and parietal cortices can also play an important role, particularly in commonly used paradigms in which learning is relatively condensed in time. Given the growing use of reward-based learning tasks in translational studies in computational psychiatry, it is important to understand the extent of the influence of working memory and also how core gradual learning mechanisms can be better isolated. In our experiments, we manipulated the spacing between repetitions along with a post-learning delay preceding a test phase. We found that learning was slower for stimuli repeated after a long delay (spaced-trained) compared to those repeated immediately (massed-trained), likely reflecting the remaining contribution of feedback learning mechanisms when working memory is not available. For massed learning, brief interruptions led to drops in subsequent performance, and individual differences in working memory capacity positively correlated with overall performance. Interestingly, when tested after a delay period but not immediately, relative preferences decayed in the massed condition and increased in the spaced condition. Our results provide additional support for a large role of working memory in reward-based learning in temporally condensed designs. We suggest that spacing training within or between sessions is a promising approach to better isolate and understand mechanisms supporting gradual reward-based learning, with particular importance for understanding potential learning dysfunctions in addiction and psychiatric disorders.Keywords
All Related Versions
Funding Information
- Deutsche Forschungsgemeinschaft (Research Fellowship)
- National Institutes of Health (R01AG041653)
This publication has 57 references indexed in Scilit:
- The Curse of PlanningPsychological Science, 2013
- Generalization of value in reinforcement learning by humansEuropean Journal of Neuroscience, 2012
- How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysisEuropean Journal of Neuroscience, 2012
- Computational psychiatryTrends in Cognitive Sciences, 2012
- Contextual Novelty Modulates the Neural Dynamics of Reward AnticipationJournal of Neuroscience, 2011
- Model-Based Influences on Humans' Choices and Striatal Prediction ErrorsNeuron, 2011
- Contextual Novelty Changes Reward Representations in the StriatumJournal of Neuroscience, 2010
- The role of covert retrieval in working memory span tasks: Evidence from delayed recall testsJournal of Memory and Language, 2008
- Dopamine Modulation of Hippocampal-Prefrontal Cortical Interaction Drives Memory-Guided BehaviorCerebral Cortex, 2007
- Modulation of competing memory systems by distractionProceedings of the National Academy of Sciences, 2006