Exploring the steps of learning: Computational modeling of initiatory-actions among individuals with Attention-Deficit/Hyperactivity Disorder
Authors:
- Gili KatabiGKGili Katabi
- Nitzan ShaharNSNitzan Shahar
Preprint
- 7 August 2023
- preprint
- Published by Springer Nature in Research Square
Abstract
ADHD is characterized by a difficulty to act in a goal-directed manner. While most environments require a sequence of actions for goal attainment, ADHD was never studied in the context of value-based sequence learning. Here, we made use of current advancements in hierarchical reinforcement-learning algorithms to track the internal value and choice policy of individuals with ADHD performing a three-stage sequence learning task. Specifically, 54 participants (28 ADHD, 26 controls) completed a value-based reinforcement-learning task that allowed us to estimate internal action values for each trial and stage using computational modeling. We found attenuated sensitivity to action values in ADHD compared to controls, both in choice and reaction-time variability estimates. Remarkably, this was found only for first stage actions (i.e., initiatory actions), while for action performed just before outcome delivery the two groups were strikingly indistinguishable. These results suggest a difficulty in following value estimation for initiatory actions in ADHD.Keywords
All Related Versions
This publication has 76 references indexed in Scilit:
- Actions, Action Sequences and Habits: Evidence That Goal-Directed and Habitual Action Control Are Hierarchically OrganizedPLOS Computational Biology, 2013
- Working Memory-Related Functional Brain Patterns in Never Medicated Children with ADHDPLOS ONE, 2012
- Habits, action sequences and reinforcement learningEuropean Journal of Neuroscience, 2012
- Evidence for higher reaction time variability for children with ADHD on a range of cognitive tasks including reward and event rate manipulations.Neuropsychology, 2011
- Model-Based Influences on Humans' Choices and Striatal Prediction ErrorsNeuron, 2011
- Motivation deficit in ADHD is associated with dysfunction of the dopamine reward pathwayMolecular Psychiatry, 2010
- Hierarchically organized behavior and its neural foundations: A reinforcement learning perspectiveCognition, 2009
- Childhood Predictors of Adult Attention-Deficit/Hyperactivity Disorder: Results from the World Health Organization World Mental Health Survey InitiativeBiological Psychiatry, 2009
- Cortical substrates for exploratory decisions in humansNature, 2006
- A Neural Substrate of Prediction and RewardScience, 1997