Hua Tang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Hua Tang has a total of 41 co-authors. Here are the top co-authors by number of shared publications:
- Bruno B. Averbeck
Comparative Brain Physiology Consortium, Center on Compulsive Behaviors; Intramural Research Program, National Institutes of Health, Bethesda, MD 20892
7 shared publications - Fei Luo
Center for Neuropsychiatric Diseases, Institute of Life Science, Nanchang University, Nanchang 330031, China
6 shared publications - Christos Constantinidis
Department of Biomedical Engineering, Vanderbilt University, Nashville, USA
4 shared publications Mitchell R. Riley
Department of Neurobiology & Anatomy, Wake Forest School of Medicine, Winston-Salem, USA
4 shared publications- Diana C. Burk
Section on Learning and Decision Making, National Institute of Mental Health, Bethesda, MD
3 shared publications - Ramon Bartolo
Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health
3 shared publications
Latest Publications
- Open Access
Long-term Learning Induces Plastic Changes in Frontostriatal Circuits
Neural activity in frontal-striatal circuits underlies reinforcement learning. Traditional theories suggest that reinforcement signals, which drive learning, strengthen connections within the basal ganglia. This strengthening is believed to shift information processing from cortical regions to subcortical regions as learning becomes established over time. To examine this hypothesis, we trained macaques to associate multiple sets of images with their values. Selecting different images led to either an increase (+2, +1) or a decrease (−1, −2) in the number of tokens, which subsequently determined the amount of juice reward the macaques received. We simultaneously recorded neuronal activity from orbitofrontal cortex, ventral striatum, amygdala, and dorsomedial thalamic nucleus, analyzing the dynamic changes in these brain regions during both the initial learning and overlearned stages. The results indicated that as learning progressed from the initial stage to the overlearned stage, information processing shifted from the ventral striatum to the orbitofrontal cortex, corresponding to the abstraction from stimulus value to state value. This finding challenges traditional theories and provides a new perspective on the neural circuit mechanisms of learning.
Open AccessLong-term Learning Induces Plastic Changes in Frontostriatal Circuits
Neural activity in frontal-striatal circuits underlies reinforcement learning. Traditional theories suggest that reinforcement signals, which drive learning, strengthen connections within the basal ganglia. This strengthening is believed to shift information processing from cortical regions to subcortical regions as learning becomes established over time. To examine this hypothesis, we trained macaques to associate multiple sets of images with their values. Selecting different images led to either an increase (+2, +1) or a decrease (−1, −2) in the number of tokens, which subsequently determined the amount of juice reward the macaques received. We simultaneously recorded neuronal activity from orbitofrontal cortex, ventral striatum, amygdala, and dorsomedial thalamic nucleus, analyzing the dynamic changes in these brain regions during both the initial learning and overlearned stages. The results indicated that as learning progressed from the initial stage to the overlearned stage, information processing shifted from the ventral striatum to the orbitofrontal cortex, corresponding to the abstraction from stimulus value to state value. This finding challenges traditional theories and provides a new perspective on the neural circuit mechanisms of learning.
- Open Access
- 26 April 2024
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 44 (24)
Computational Mechanisms Underlying Motivation to Earn Symbolic Reinforcers
Reinforcement learning is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g., money, points) that are later exchanged for primary reinforcers (e.g., food, drink). Although symbolic reinforcers are ubiquitous in our daily lives, widely used in laboratory tasks because they can be motivating, mechanisms by which they become motivating are less understood. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g., the current number of accumulated tokens, choice options, task epoch, trials since the last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to then correlate with the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task ( n = 5 monkeys, three males and two females). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in the state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement.
- 26 April 2024
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 44 (24)
Open AccessComputational Mechanisms Underlying Motivation to Earn Symbolic Reinforcers
Reinforcement learning is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g., money, points) that are later exchanged for primary reinforcers (e.g., food, drink). Although symbolic reinforcers are ubiquitous in our daily lives, widely used in laboratory tasks because they can be motivating, mechanisms by which they become motivating are less understood. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g., the current number of accumulated tokens, choice options, task epoch, trials since the last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to then correlate with the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task ( n = 5 monkeys, three males and two females). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in the state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement.
- Open Access
Ventral frontostriatal circuitry mediates the computation of reinforcement from symbolic gains and losses
SUMMARY: Reinforcement learning (RL), particularly in primates, is often driven by symbolic outcomes. However, it is usually studied with primary reinforcers. To examine the neural mechanisms underlying learning from symbolic outcomes, we trained monkeys on a task in which they learned to choose options that led to gains of tokens and avoid choosing options that led to losses of tokens. We then recorded simultaneously from the orbitofrontal cortex (OFC), ventral striatum (VS), amygdala (AMY), and the mediodorsal thalamus (MDt). We found that the OFC played a dominant role in coding token outcomes and token prediction errors. The other areas contributed complementary functions with the VS coding appetitive outcomes and the AMY coding the salience of outcomes. The MDt coded actions and relayed information about tokens between the OFC and VS. Thus, OFC leads the process of symbolic reinforcement learning in the ventral frontostriatal circuitry.
Open AccessVentral frontostriatal circuitry mediates the computation of reinforcement from symbolic gains and losses
SUMMARY: Reinforcement learning (RL), particularly in primates, is often driven by symbolic outcomes. However, it is usually studied with primary reinforcers. To examine the neural mechanisms underlying learning from symbolic outcomes, we trained monkeys on a task in which they learned to choose options that led to gains of tokens and avoid choosing options that led to losses of tokens. We then recorded simultaneously from the orbitofrontal cortex (OFC), ventral striatum (VS), amygdala (AMY), and the mediodorsal thalamus (MDt). We found that the OFC played a dominant role in coding token outcomes and token prediction errors. The other areas contributed complementary functions with the VS coding appetitive outcomes and the AMY coding the salience of outcomes. The MDt coded actions and relayed information about tokens between the OFC and VS. Thus, OFC leads the process of symbolic reinforcement learning in the ventral frontostriatal circuitry.
- Open Access
Computational mechanisms underlying motivation to earn symbolic reinforcers
Reinforcement learning (RL) is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g. money, points) that can later be exchanged for primary reinforcers (e.g. food, drink). Although symbolic reinforcers are motivating, little is understood about the neural or computational mechanisms underlying the motivation to earn them. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g. current number of accumulated tokens, choice options, task epoch, trials since last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to capture the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task (n=5 monkeys). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement. Significance statement: Symbolic reinforcers, like money and points, play a critical role in our lives. Like rewards, symbolic reinforcers can be motivating and can even lead to compulsive behaviors like gambling addiction. However, we lack an understanding of how symbolic reinforcement can drive fluctuations in motivation. Here we investigated the effect of symbolic reinforcers on behaviors related to motivation during a token reinforcement learning task, using a novel reinforcement learning model and data from five monkeys. Our findings suggest that the value of a task state can affect willingness to initiate a trial, speed to choose, and persistence to complete a trial. Our model makes testable predictions for within trial fluctuations of neural activity related to values of task states.
Open AccessComputational mechanisms underlying motivation to earn symbolic reinforcers
Reinforcement learning (RL) is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g. money, points) that can later be exchanged for primary reinforcers (e.g. food, drink). Although symbolic reinforcers are motivating, little is understood about the neural or computational mechanisms underlying the motivation to earn them. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g. current number of accumulated tokens, choice options, task epoch, trials since last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to capture the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task (n=5 monkeys). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement. Significance statement: Symbolic reinforcers, like money and points, play a critical role in our lives. Like rewards, symbolic reinforcers can be motivating and can even lead to compulsive behaviors like gambling addiction. However, we lack an understanding of how symbolic reinforcement can drive fluctuations in motivation. Here we investigated the effect of symbolic reinforcers on behaviors related to motivation during a token reinforcement learning task, using a novel reinforcement learning model and data from five monkeys. Our findings suggest that the value of a task state can affect willingness to initiate a trial, speed to choose, and persistence to complete a trial. Our model makes testable predictions for within trial fluctuations of neural activity related to values of task states.
- Open Access
- 10 January 2022
- Published by Springer Nature in Nature Communications
- Vol. 13 (1) , 1-12
Prefrontal cortical plasticity during learning of cognitive tasks
Training in working memory tasks is associated with lasting changes in prefrontal cortical activity. To assess the neural activity changes induced by training, we recorded single units, multi-unit activity (MUA) and local field potentials (LFP) with chronic electrode arrays implanted in the prefrontal cortex of two monkeys, throughout the period they were trained to perform cognitive tasks. Mastering different task phases was associated with distinct changes in neural activity, which included recruitment of larger numbers of neurons, increases or decreases of their firing rate, changes in the correlation structure between neurons, and redistribution of power across LFP frequency bands. In every training phase, changes induced by the actively learned task were also observed in a control task, which remained the same across the training period. Our results reveal how learning to perform cognitive tasks induces plasticity of prefrontal cortical activity, and how activity changes may generalize between tasks.
- 10 January 2022
- Published by Springer Nature in Nature Communications
- Vol. 13 (1) , 1-12
Open AccessPrefrontal cortical plasticity during learning of cognitive tasks
Training in working memory tasks is associated with lasting changes in prefrontal cortical activity. To assess the neural activity changes induced by training, we recorded single units, multi-unit activity (MUA) and local field potentials (LFP) with chronic electrode arrays implanted in the prefrontal cortex of two monkeys, throughout the period they were trained to perform cognitive tasks. Mastering different task phases was associated with distinct changes in neural activity, which included recruitment of larger numbers of neurons, increases or decreases of their firing rate, changes in the correlation structure between neurons, and redistribution of power across LFP frequency bands. In every training phase, changes induced by the actively learned task were also observed in a control task, which remained the same across the training period. Our results reveal how learning to perform cognitive tasks induces plasticity of prefrontal cortical activity, and how activity changes may generalize between tasks.
- Open Access
- 4 January 2022
- Published by Elsevier in Cell Reports
- Vol. 38 (1) , 110198
Differential coding of goals and actions in ventral and dorsal corticostriatal circuits during goal-directed behavior
- 4 January 2022
- Published by Elsevier in Cell Reports
- Vol. 38 (1) , 110198
Open AccessDifferential coding of goals and actions in ventral and dorsal corticostriatal circuits during goal-directed behavior
- Open Access
- 9 February 2021
- Published by Springer Nature in Nature Communications
- Vol. 12 (1) , 1-13
Reward-related choices determine information timing and flow across macaque lateral prefrontal cortex
Prefrontal cortex is critical for cognition. Although much is known about the representation of cognitive variables in the prefrontal cortex, much less is known about the spatio-temporal neural dynamics that underlie cognitive operations. In the present study, we examined information timing and flow across the lateral prefrontal cortex (LPFC), while monkeys carried out a two-armed bandit reinforcement learning task in which they had to learn to select rewarding actions or rewarding objects. When we analyzed signals independently within subregions of the LPFC, we found a task-specific, caudo-rostral gradient in the strength and timing of signals related to chosen objects and chosen actions. In addition, when we characterized information flow among subregions, we found that information flow from action to object representations was stronger from the dorsal to ventral LPFC, and information flow from object to action representations was stronger from the ventral to dorsal LPFC. The object to action effects were more pronounced in object blocks, and also reflected learning specifically in these blocks. These results suggest anatomical segregation followed by the rapid integration of information within the LPFC.
- 9 February 2021
- Published by Springer Nature in Nature Communications
- Vol. 12 (1) , 1-13
Open AccessReward-related choices determine information timing and flow across macaque lateral prefrontal cortex
Prefrontal cortex is critical for cognition. Although much is known about the representation of cognitive variables in the prefrontal cortex, much less is known about the spatio-temporal neural dynamics that underlie cognitive operations. In the present study, we examined information timing and flow across the lateral prefrontal cortex (LPFC), while monkeys carried out a two-armed bandit reinforcement learning task in which they had to learn to select rewarding actions or rewarding objects. When we analyzed signals independently within subregions of the LPFC, we found a task-specific, caudo-rostral gradient in the strength and timing of signals related to chosen objects and chosen actions. In addition, when we characterized information flow among subregions, we found that information flow from action to object representations was stronger from the dorsal to ventral LPFC, and information flow from object to action representations was stronger from the ventral to dorsal LPFC. The object to action effects were more pronounced in object blocks, and also reflected learning specifically in these blocks. These results suggest anatomical segregation followed by the rapid integration of information within the LPFC.
- Open Access
Training-induced prefrontal neuronal changes transfer between tasks
Training to improve working memory is associated with changes in prefrontal activation and confers lasting benefits, some of which generalize to untrained tasks, though the issue remains contentious and the neural substrate underlying such transfer are unknown. To assess how neural activity changes induced by training transfer across tasks, we recorded single units, multi-unit activity (MUA) and local field potentials (LFP) with chronic electrode arrays implanted in the prefrontal cortex of two monkeys, as they were trained to perform cognitive tasks. Mastering different tasks was associated with distinct changes in neural activity, which included redistribution of power across frequency bands in the LFP, recruitment of larger numbers of MUA sites, and increase or decrease of mean neural activity across single units. In every training phase, changes induced by the actively learned task transferred to an untrained control task, which remained the same across the training period. The results explicate the neural basis through which training can transfer across cognitive tasks.
Open AccessTraining-induced prefrontal neuronal changes transfer between tasks
Training to improve working memory is associated with changes in prefrontal activation and confers lasting benefits, some of which generalize to untrained tasks, though the issue remains contentious and the neural substrate underlying such transfer are unknown. To assess how neural activity changes induced by training transfer across tasks, we recorded single units, multi-unit activity (MUA) and local field potentials (LFP) with chronic electrode arrays implanted in the prefrontal cortex of two monkeys, as they were trained to perform cognitive tasks. Mastering different tasks was associated with distinct changes in neural activity, which included redistribution of power across frequency bands in the LFP, recruitment of larger numbers of MUA sites, and increase or decrease of mean neural activity across single units. In every training phase, changes induced by the actively learned task transferred to an untrained control task, which remained the same across the training period. The results explicate the neural basis through which training can transfer across cognitive tasks.
- 15 March 2019
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 116 (14) , 7095-7100
Working memory capacity is enhanced by distributed prefrontal activation and invariant temporal dynamics
Significance: Working memory capacity is notoriously limited to a handful of items, creating one of the central bottlenecks of human cognition, but can be improved by training. The neural basis of this improvement remains a matter of debate, as human imaging studies have produced contradictory results about the mechanisms that effect improved capacity. To resolve this controversy, we recorded neuronal activity from monkeys while they were being trained to improve their ability in maintaining multiple stimuli in memory. Our results reveal that improvement of working memory is effected by a more distributed activation of the prefrontal cortex and invariant temporal dynamics of neuronal activity. These changes render the prefrontal network more robust, allowing it to maintain more items in memory.
- 15 March 2019
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 116 (14) , 7095-7100
Working memory capacity is enhanced by distributed prefrontal activation and invariant temporal dynamics
Significance: Working memory capacity is notoriously limited to a handful of items, creating one of the central bottlenecks of human cognition, but can be improved by training. The neural basis of this improvement remains a matter of debate, as human imaging studies have produced contradictory results about the mechanisms that effect improved capacity. To resolve this controversy, we recorded neuronal activity from monkeys while they were being trained to improve their ability in maintaining multiple stimuli in memory. Our results reveal that improvement of working memory is effected by a more distributed activation of the prefrontal cortex and invariant temporal dynamics of neuronal activity. These changes render the prefrontal network more robust, allowing it to maintain more items in memory.