Optimal policy for value-based decision-making
Top Cited Papers
Open Access
- 18 August 2016
- journal article
- Published by Springer Nature in Nature Communications
- Vol. 7 (1) , 12400
Abstract
For decades now, normative theories of perceptual decisions, and their implementation as drift diffusion models, have driven and significantly improved our understanding of human and animal behaviour and the underlying neural processes. While similar processes seem to govern value-based decisions, we still lack the theoretical understanding of why this ought to be the case. Here, we show that, similar to perceptual decisions, drift diffusion models implement the optimal strategy for value-based decisions. Such optimal decisions require the models’ decision boundaries to collapse over time, and to depend on thea prioriknowledge about reward contingencies. Diffusion models only implement the optimal strategy under specific task assumptions, and cease to be optimal once we start relaxing these assumptions, by, for example, using non-linear utility functions. Our findings thus provide the much-needed theory for value-based decisions, explain the apparent similarity to perceptual decisions, and predict conditions under which this similarity should break down.Keywords
This publication has 30 references indexed in Scilit:
- A Mechanism for Value-Sensitive Decision-MakingPLOS ONE, 2013
- The Cost of Accumulating Evidence in Perceptual Decision MakingThe Journal of Neuroscience, 2012
- Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisionsProceedings of the National Academy of Sciences, 2011
- Dynamic Integration of Reward and Stimulus Information in Perceptual Decision-MakingPLOS ONE, 2011
- How the brain integrates costs and benefits during decision makingProceedings of the National Academy of Sciences, 2010
- The Drift Diffusion Model Can Account for the Accuracy and Reaction Time of Value-Based Choices Under High and Low Time PressureSSRN Electronic Journal, 2010
- Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards?PLOS Computational Biology, 2009
- Probabilistic Population Codes for Bayesian Decision MakingNeuron, 2008
- Decision Making in Recurrent Neuronal CircuitsNeuron, 2008
- Decision-making with multiple alternativesNature Neuroscience, 2008