Duration between rewards controls the rate of behavioral and dopaminergic learning
Top Cited Papers
Open Access
- 12 February 2026
- journal article
- research article
- Published by Springer Nature in Nature Neuroscience
- Vol. 29 (4) , 825-839
Abstract
Learning the causes of rewards is crucial for survival. Cue–reward associative learning is controlled in the brain by mesolimbic dopamine. It is widely believed that dopamine drives learning by conveying a reward prediction error. Dopamine-based learning algorithms are generally ‘trial-based’: learning progresses sequentially across individual cue–outcome experiences. A foundational assumption of these models is that the more cue–reward pairings one experiences over a fixed duration, the more one learns this association. By identifying a new biological principle governing learning, we disprove this assumption. Specifically, across many conditions in mice, we show that behavioral and dopaminergic learning rates are proportional to the duration between rewards (or punishments). Due to this rule, the overall learning over a fixed duration is independent of the number of cue–outcome experiences. A dopamine-based model of retrospective learning explains these findings, thereby providing a unified account of the biological mechanisms of learning.Keywords
All Related Versions
Funding Information
- National Institute of Mental Health (R00MH118422)
- National Institute of Mental Health (R01MH129582)
- National Institute on Alcohol Abuse and Alcoholism (R01AA029661)
- Scott Alan Myers Endowed Professorship, Alfred P Sloan Fellowship, Pew Biomedical Scholarship, Klingenstein-Simons Fellowship
- National Institute on Drug Abuse (F32DA060044)
- National Science Foundation (GRFP)
- National Science Foundation (GRFP)
- Klingenstein-Simons Fellowship, the David and Lucile Packard Foundation, and Shurl and Kay Curci Foundation
This publication has 70 references indexed in Scilit:
- Bridging Computation and Representation in Associative LearningComputational Brain & Behavior, 2025
- Learning Temporal Relationships Between Symbols with Laplace Neural ManifoldsComputational Brain & Behavior, 2024
- Dopamine transients encode reward prediction errors independent of learning ratesCell Reports, 2024
- “But why?” Dopamine and causal learningCurrent Opinion in Behavioral Sciences, 2024
- Dopamine release in the nucleus accumbens core signals perceived saliencyCurrent Biology, 2021
- A Unified Framework for Dopamine Signals across TimescalesCell, 2020
- Number and time in acquisition, extinction and recoveryJournal of the Experimental Analysis of Behavior, 2019
- Information Theory, Memory, Prediction, and Timing in Associative Learning2017
- Intact-Brain Analyses Reveal Distinct Information Carried by SNc Dopamine SubcircuitsCell, 2015
- Spacing effects and their implications for theory and practiceEducational Psychology Review, 1989