Human thalamic low-frequency oscillations correlate with expected value and outcomes during reinforcement learning
Open Access
- 17 October 2023
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 14 (1) , 1-10
Abstract
Reinforcement-based adaptive decision-making is believed to recruit fronto-striatal circuits. A critical node of the fronto-striatal circuit is the thalamus. However, direct evidence of its involvement in human reinforcement learning is lacking. We address this gap by analyzing intra-thalamic electrophysiological recordings from eight participants while they performed a reinforcement learning task. We found that in both the anterior thalamus (ATN) and dorsomedial thalamus (DMTN), low frequency oscillations (LFO, 4-12 Hz) correlated positively with expected value estimated from computational modeling during reward-based learning (after outcome delivery) or punishment-based learning (during the choice process). Furthermore, LFO recorded from ATN/DMTN were also negatively correlated with outcomes so that both components of reward prediction errors were signaled in the human thalamus. The observed differences in the prediction signals between rewarding and punishing conditions shed light on the neural mechanisms underlying action inhibition in punishment avoidance learning. Our results provide insight into the role of thalamus in reinforcement-based decision-making in humans.Keywords
Funding Information
- Agence Nationale de la Recherche (ANR-17-CE37-0018, ANR-22-CE17-0057)
This publication has 53 references indexed in Scilit:
- The role of the anterior, mediodorsal, and parafascicular thalamus in instrumental conditioningFrontiers in Systems Neuroscience, 2013
- A Role for the Subthalamic Nucleus in Response Inhibition during ConflictJournal of Neuroscience, 2012
- Opponency Revisited: Competition and Cooperation Between Dopamine and SerotoninNeuropsychopharmacology, 2010
- Pavlovian to instrumental transfer: A neurobehavioural perspectiveNeuroscience & Biobehavioral Reviews, 2010
- Electrical stimulation of the anterior nucleus of thalamus for treatment of refractory epilepsyEpilepsia, 2010
- Broadband Shifts in Local Field Potential Power Spectra Are Correlated with Single-Neuron Spiking in HumansThe Journal of Neuroscience, 2009
- A high resolution and high contrast MRI for differentiation of subcortical structures for DBS targeting: The Fast Gray Matter Acquisition T1 Inversion Recovery (FGATIR)NeuroImage, 2009
- Dopamine-dependent prediction errors underpin reward-seeking behaviour in humansNature, 2006
- By Carrot or by Stick: Cognitive Reinforcement Learning in ParkinsonismScience, 2004
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998