The Neural Bases of Action-Outcome Learning in Humans
Open Access
- 16 March 2022
- journal article
- research article
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 42 (17) , 3636-3647
Abstract
From an associative perspective the acquisition of new goal-directed actions requires the encoding of specific action-outcome (AO) associations and, therefore, sensitivity to the validity of an action as a predictor of a specific outcome relative to other events. Although competitive architectures have been proposed within associative learning theory to achieve this kind of identity-based selection, whether and how these architectures are implemented by the brain is still a matter of conjecture. To investigate this issue, we trained human participants to encode various AO associations while undergoing functional neuroimaging (fMRI). We then degraded one AO contingency by increasing the probability of the outcome in the absence of its associated action while keeping other AO contingencies intact. We found that this treatment selectively reduced performance of the degraded action. Furthermore, when a signal predicted the unpaired outcome, performance of the action was restored, suggesting that the degradation effect reflects competition between the action and the context for prediction of the specific outcome. We used a Kalman filter to model the contribution of different causal variables to AO learning and found that activity in the medial prefrontal cortex (mPFC) and the dorsal anterior cingulate cortex (dACC) tracked changes in the association of the action and context, respectively, with regard to the specific outcome. Furthermore, we found the mPFC participated in a network with the striatum and posterior parietal cortex to segregate the influence of the various competing predictors to establish specific AO associations.SIGNIFICANCE STATEMENTHumans and other animals learn the consequences of their actions, allowing them to control their environment in a goal-directed manner. Nevertheless, it is unknown how we parse environmental causes from the effects of our own actions to establish these specific action-outcome (AO) relationships. Here, we show that the brain learns the causal structure of the environment by segregating the unique influence of actions from other causes in the medial prefrontal and anterior cingulate cortices and, through a network of structures, including the caudate nucleus and posterior parietal cortex, establishes the distinct causal relationships from which specific AO associations are formed.Keywords
Funding Information
- Australian Research Council (FL0992409, FT100100260)
- Department of Health | National Health and Medical Research Council (GNT1175420, GNT1069487, GNT1122842)
This publication has 57 references indexed in Scilit:
- Medial prefrontal cortex as an action-outcome predictorNature Neuroscience, 2011
- Neural Correlates of Instrumental Contingency Learning: Differential Effects of Action–Reward Conjunction and DisjunctionThe Journal of Neuroscience, 2011
- States versus Rewards: Dissociable Neural Prediction Error Signals Underlying Model-Based and Model-Free Reinforcement LearningNeuron, 2010
- Human and Rodent Homologies in Action Control: Corticostriatal Determinants of Goal-Directed and Habitual ActionNeuropsychopharmacology, 2009
- Bayesian model selection for group studiesNeuroImage, 2009
- Calculating Consequences: Brain Systems That Encode the Causal Effects of ActionsJournal of Neuroscience, 2008
- Generating stimuli for neuroscience using PsychoPyFrontiers in Neuroinformatics, 2008
- Power calculation for group fMRI studies accounting for arbitrary design and temporal autocorrelationNeuroImage, 2008
- PsychoPy—Psychophysics software in PythonJournal of Neuroscience Methods, 2007
- Dopamine-dependent prediction errors underpin reward-seeking behaviour in humansNature, 2006