Adaptive integration of habits into depth-limited planning defines a habitual-goal–directed spectrum
- 24 October 2016
- journal article
- research article
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 113 (45) , 12868-12873
Abstract
Significance: Solving complex tasks often requires estimates of the future consequences of current actions. Estimates could be learned from past experience, but they then risk being out of date, or they could be calculated by a form of planning into the future, a process that is computationally taxing. We show that humans integrate learned estimates into their planning calculations, saving mental effort and time. We also show that increasing time pressure leads to reliance on learned estimates after fewer steps of planning. We suggest a normative rationale for this effect using a computational model. Our results provide a perspective on how the brain combines different decision processes collaboratively to exploit their comparative computational advantages.Keywords
This publication has 37 references indexed in Scilit:
- Goals and Habits in the BrainNeuron, 2013
- The Mixed Instrumental Controller: Using Value of Information to Combine Habitual Choice and Mental SimulationFrontiers in Psychology, 2013
- How to set the switches on this thingCurrent Opinion in Neurobiology, 2012
- Habits, action sequences and reinforcement learningEuropean Journal of Neuroscience, 2012
- Bonsai Trees in Your Head: How the Pavlovian System Sculpts Goal-Directed Choices by Pruning Decision TreesPLOS Computational Biology, 2012
- Speed/Accuracy Trade-Off between the Habitual and the Goal-Directed ProcessesPLOS Computational Biology, 2011
- Model-Based Influences on Humans' Choices and Striatal Prediction ErrorsNeuron, 2011
- States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement LearningNeuron, 2010
- Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual ActionNeuropsychopharmacology, 2009
- A Neural Substrate of Prediction and RewardScience, 1997