Top Cited Papers
Open Access
Abstract
Learning the causes of rewards is crucial for survival. Cue–reward associative learning is controlled in the brain by mesolimbic dopamine. It is widely believed that dopamine drives learning by conveying a reward prediction error. Dopamine-based learning algorithms are generally ‘trial-based’: learning progresses sequentially across individual cue–outcome experiences. A foundational assumption of these models is that the more cue–reward pairings one experiences over a fixed duration, the more one learns this association. By identifying a new biological principle governing learning, we disprove this assumption. Specifically, across many conditions in mice, we show that behavioral and dopaminergic learning rates are proportional to the duration between rewards (or punishments). Due to this rule, the overall learning over a fixed duration is independent of the number of cue–outcome experiences. A dopamine-based model of retrospective learning explains these findings, thereby providing a unified account of the biological mechanisms of learning.
All Related Versions
Funding Information
  • National Institute of Mental Health (R00MH118422)
  • National Institute of Mental Health (R01MH129582)
  • National Institute on Alcohol Abuse and Alcoholism (R01AA029661)
  • Scott Alan Myers Endowed Professorship, Alfred P Sloan Fellowship, Pew Biomedical Scholarship, Klingenstein-Simons Fellowship
  • National Institute on Drug Abuse (F32DA060044)
  • National Science Foundation (GRFP)
  • National Science Foundation (GRFP)
  • Klingenstein-Simons Fellowship, the David and Lucile Packard Foundation, and Shurl and Kay Curci Foundation

This publication has 70 references indexed in Scilit: