Open Access
- 3 April 2014
- journal article
- research article
- Published by Wiley in Human Brain Mapping
- Vol. 35 (9) , 4805-4814
Abstract
Surprise drives learning. Various neural “prediction error” signals are believed to underpin surprise‐based reinforcement learning. Here, we report a surprise signal that reflects reinforcement learning but is neither un/signed reward prediction error (RPE) nor un/signed state prediction error (SPE). To exclude these alternatives, we measured surprise responses in the absence of RPE and accounted for a host of potential SPE confounds. This new surprise signal was evident in ventral striatum, primary sensory cortex, frontal poles, and amygdala. We interpret these findings via a normative model of surprise. Hum Brain Mapp 35:4805–4814, 2014. © 2014 The Authors. Human Brain Mapping Published by Wiley Periodicals, Inc.Keywords
Funding Information
- CoMPLEX, Switzerland, by the Swiss National Science Foundation (PP00P1_128574 and CRSII3_141965)
- Swiss National Centre of Competence in Research in Affective Sciences
This publication has 42 references indexed in Scilit:
- Surprise! Neural correlates of Pearce–Hall and Rescorla–Wagner coexist within the brainEuropean Journal of Neuroscience, 2012
- Model‐based learning and the contribution of the orbitofrontal cortex to the model‐free worldEuropean Journal of Neuroscience, 2012
- Understanding dopamine and reinforcement learning: The dopamine reward prediction error hypothesisProceedings of the National Academy of Sciences of the United States of America, 2011
- Toward a neurobiology of delusionsProgress in Neurobiology, 2010
- States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement LearningNeuron, 2010
- Explicit neural signals reflecting reward uncertaintyPhilosophical Transactions of the Royal Society B: Biological Sciences, 2008
- A Dual Role for Prediction Error in Associative LearningCerebral Cortex, 2008
- Neural repetition suppression reflects fulfilled perceptual expectationsNature Neuroscience, 2008
- The role of the orbitofrontal cortex in the pursuit of happiness and more specific rewardsNature, 2008
- Adapting to the unpredictable: reproductive biology of vertebrates in the Australian wet–dry tropicsPhilosophical Transactions of the Royal Society B: Biological Sciences, 2007