Cholinergic modulation of reinforcement learning and prefrontal value computations under uncertainty
Preprint
Abstract
The neuromodulator acetylcholine has been suggested to govern learning under uncertainty. Here, we investigated the role of muscarinic acetylcholine receptors in reward-guided learning and decision making under different degrees of uncertainty. We administered the muscarinic antagonist biperiden (4 mg) to healthy male participants (n = 43) in a within-subjects, placebo-controlled design. Participants performed a gambling and a learning task involving different levels of uncertainty, while magnetoencephalography (MEG) was recorded. We show that biperiden did not affect decision making in the gambling task, where no learning was required. However, in the learning task, where option values were associated with uncertainty, biperiden reduced the sensitivity to probabilities, particularly when choice-outcome-contingencies switched frequently. Reinforcement learning models revealed that the change in behaviour was caused by noisier estimates of probabilities resulting from increased learning rates for rewarded choices under biperiden. These behavioural findings were paralleled by elimination of the lateral prefrontal representation of learnt reward probability in high-beta (20 - 30 Hz) power under biperiden. Together, these findings suggest that muscarinic acetylcholine transmission controls learning in highly uncertain contexts, when the demand for carefully calibrated adjustments is highest.Keywords
This publication has 100 references indexed in Scilit:
- Cholinergic and dopaminergic effects on prediction error and uncertainty responses during sensory associative learningNeuroImage, 2021
- Oxotremorine-M potentiates NMDA receptors by muscarinic receptor dependent and independent mechanismsBiochemical and Biophysical Research Communications, 2018
- Central Cholinergic Neurons Are Rapidly Recruited by Reinforcement FeedbackCell, 2015
- Acetylcholine Mediates Behavioral and Neural Post-Error ControlCurrent Biology, 2015
- Dissociable contributions of ventromedial prefrontal and posterior parietal cortex to value-guided choiceNeuroImage, 2014
- PsychoPy—Psychophysics software in PythonJournal of Neuroscience Methods, 2007
- The role of acetylcholine in learning and memoryCurrent Opinion in Neurobiology, 2006
- Modulatory functions of neurotransmitters in the striatum: ACh/dopamine/NMDA interactionsTrends in Neurosciences, 1994
- Pharmacokinetic and pharmacodynamic studies following the intravenous and oral administration of the antiparkinsonian drug biperiden to normal subjectsEuropean Journal of Clinical Pharmacology, 1986
- The assessment and analysis of handedness: The Edinburgh inventoryNeuropsychologia, 1971