Basal Ganglia Circuits for Reward Value–Guided Behavior
- 8 July 2014
- journal article
- review article
- Published by Annual Reviews in Annual Review of Neuroscience
- Vol. 37 (1) , 289-306
Abstract
The basal ganglia are equipped with inhibitory and disinhibitory mechanisms that enable a subject to choose valuable objects and actions. Notably, a value can be determined flexibly by recent experience or stably by prolonged experience. Recent studies have revealed that the head and tail of the caudate nucleus selectively and differentially process flexible and stable values of visual objects. These signals are sent to the superior colliculus through different parts of the substantia nigra so that the animal looks preferentially at high-valued objects, but in different manners. Thus, relying on short-term value memories, the caudate head circuit allows the subject's gaze to move expectantly to recently valued objects. Relying on long-term value memories, the caudate tail circuit allows the subject's gaze to move automatically to previously valued objects. The basal ganglia also contain an equivalent parallel mechanism for action values. Such flexible–stable parallel mechanisms for object and action values create a highly adaptable system for decision making.Keywords
This publication has 108 references indexed in Scilit:
- Value-driven attentional captureProceedings of the National Academy of Sciences, 2011
- Dopamine in Motivational Control: Rewarding, Aversive, and AlertingNeuron, 2010
- Goal-directed and habitual control in the basal ganglia: implications for Parkinson's diseaseNature Reviews Neuroscience, 2010
- Good judgments do not require complex cognitionCognitive Processing, 2009
- The intrinsic value of visual information affects saccade velocitiesExperimental Brain Research, 2009
- Rewards Evoke Learning of Unconsciously Processed Visual Stimuli in Adult HumansNeuron, 2009
- The dynamics of memory as a consequence of optimal adaptation to a changing bodyNature Neuroscience, 2007
- Should I stay or should I go? How the human brain manages the trade-off between exploitation and explorationPhilosophical Transactions of the Royal Society B: Biological Sciences, 2007
- Cortical substrates for exploratory decisions in humansNature, 2006
- A Neural Substrate of Prediction and RewardScience, 1997