Diana C. Burk
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Diana C. Burk has a total of 41 co-authors. Here are the top co-authors by number of shared publications:
- Bruno B. Averbeck
Comparative Brain Physiology Consortium, Center on Compulsive Behaviors; Intramural Research Program, National Institutes of Health, Bethesda, MD 20892
6 shared publications - Hua Tang
Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health
3 shared publications - David L. Sheinberg
Brown University
2 shared publications Ellen Leibenluft
Office of the Scientific Director of the Intramural Research Program, National Institute of Mental Health
2 shared publicationsAnderson M Winkler
Emotion and Development Branch, National Institute of Mental Health, National Institutes of Health
1 shared publicationAndrea L Gold
Emotion and Development Branch, National Institute of Mental Health, National Institutes of Health
1 shared publication
Latest Publications
- Open Access
- 23 October 2026
- Published by Elsevier in Biological Psychiatry: Cognitive Neuroscience and Neuroimaging
Frustration Induction Alters Reward Prediction Error Encoding in Pediatric Irritability
- 23 October 2026
- Published by Elsevier in Biological Psychiatry: Cognitive Neuroscience and Neuroimaging
Open AccessFrustration Induction Alters Reward Prediction Error Encoding in Pediatric Irritability
- Open Access
Consensus across limbic areas predicts motivational disengagement
: Motivational disengagement is widely attributed to low expected reward, yet animals and humans disengage even when reward expectations are constant. This implies a latent mechanism beyond reward. After accounting for expected reward, we found a neural signal across multiple limbic areas that predicted disengagement. As animals disengaged, neural activity across areas converged onto a shared, low-dimensional axis. Consensus across areas predicted whether disengagement persisted, suggesting why single brain area perturbations have produced inconsistent effects. We showed that engagement and disengagement operated as distinct attractor states whose strength scaled with expected reward, revealing that value modulates, but does not determine, motivational state. These findings reframe motivation as a collective computation and suggest that effective interventions for motivational deficits may require targeting multiple areas simultaneously.
Open AccessConsensus across limbic areas predicts motivational disengagement
: Motivational disengagement is widely attributed to low expected reward, yet animals and humans disengage even when reward expectations are constant. This implies a latent mechanism beyond reward. After accounting for expected reward, we found a neural signal across multiple limbic areas that predicted disengagement. As animals disengaged, neural activity across areas converged onto a shared, low-dimensional axis. Consensus across areas predicted whether disengagement persisted, suggesting why single brain area perturbations have produced inconsistent effects. We showed that engagement and disengagement operated as distinct attractor states whose strength scaled with expected reward, revealing that value modulates, but does not determine, motivational state. These findings reframe motivation as a collective computation and suggest that effective interventions for motivational deficits may require targeting multiple areas simultaneously.
- Open Access
Long-term Learning Induces Plastic Changes in Frontostriatal Circuits
Neural activity in frontal-striatal circuits underlies reinforcement learning. Traditional theories suggest that reinforcement signals, which drive learning, strengthen connections within the basal ganglia. This strengthening is believed to shift information processing from cortical regions to subcortical regions as learning becomes established over time. To examine this hypothesis, we trained macaques to associate multiple sets of images with their values. Selecting different images led to either an increase (+2, +1) or a decrease (−1, −2) in the number of tokens, which subsequently determined the amount of juice reward the macaques received. We simultaneously recorded neuronal activity from orbitofrontal cortex, ventral striatum, amygdala, and dorsomedial thalamic nucleus, analyzing the dynamic changes in these brain regions during both the initial learning and overlearned stages. The results indicated that as learning progressed from the initial stage to the overlearned stage, information processing shifted from the ventral striatum to the orbitofrontal cortex, corresponding to the abstraction from stimulus value to state value. This finding challenges traditional theories and provides a new perspective on the neural circuit mechanisms of learning.
Open AccessLong-term Learning Induces Plastic Changes in Frontostriatal Circuits
Neural activity in frontal-striatal circuits underlies reinforcement learning. Traditional theories suggest that reinforcement signals, which drive learning, strengthen connections within the basal ganglia. This strengthening is believed to shift information processing from cortical regions to subcortical regions as learning becomes established over time. To examine this hypothesis, we trained macaques to associate multiple sets of images with their values. Selecting different images led to either an increase (+2, +1) or a decrease (−1, −2) in the number of tokens, which subsequently determined the amount of juice reward the macaques received. We simultaneously recorded neuronal activity from orbitofrontal cortex, ventral striatum, amygdala, and dorsomedial thalamic nucleus, analyzing the dynamic changes in these brain regions during both the initial learning and overlearned stages. The results indicated that as learning progressed from the initial stage to the overlearned stage, information processing shifted from the ventral striatum to the orbitofrontal cortex, corresponding to the abstraction from stimulus value to state value. This finding challenges traditional theories and provides a new perspective on the neural circuit mechanisms of learning.
- Open Access
- 26 April 2024
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 44 (24)
Computational Mechanisms Underlying Motivation to Earn Symbolic Reinforcers
Reinforcement learning is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g., money, points) that are later exchanged for primary reinforcers (e.g., food, drink). Although symbolic reinforcers are ubiquitous in our daily lives, widely used in laboratory tasks because they can be motivating, mechanisms by which they become motivating are less understood. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g., the current number of accumulated tokens, choice options, task epoch, trials since the last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to then correlate with the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task ( n = 5 monkeys, three males and two females). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in the state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement.
- 26 April 2024
- Published by Society for Neuroscience in Journal of Neuroscience
- Vol. 44 (24)
Open AccessComputational Mechanisms Underlying Motivation to Earn Symbolic Reinforcers
Reinforcement learning is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g., money, points) that are later exchanged for primary reinforcers (e.g., food, drink). Although symbolic reinforcers are ubiquitous in our daily lives, widely used in laboratory tasks because they can be motivating, mechanisms by which they become motivating are less understood. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g., the current number of accumulated tokens, choice options, task epoch, trials since the last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to then correlate with the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task ( n = 5 monkeys, three males and two females). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in the state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement.
- Open Access
Cross-species real time detection of trends in pupil size fluctuation
Pupillometry is a popular method because pupil size is easily measured, sensitive to central neural activity, and associated with behavior, cognition, emotion, and perception. Currently, there is no method for online monitoring phases of pupil size fluctuation. We introduce rtPupilPhase – an open source software that automatically detects trends in pupil size in real time, enabling novel implementations of real time pupillometry towards achieving numerous research and translational goals. We validated the performance of rtPupilPhase on human, rodent, and monkey pupil data and propose future applications of real time pupillometry.
Open AccessCross-species real time detection of trends in pupil size fluctuation
Pupillometry is a popular method because pupil size is easily measured, sensitive to central neural activity, and associated with behavior, cognition, emotion, and perception. Currently, there is no method for online monitoring phases of pupil size fluctuation. We introduce rtPupilPhase – an open source software that automatically detects trends in pupil size in real time, enabling novel implementations of real time pupillometry towards achieving numerous research and translational goals. We validated the performance of rtPupilPhase on human, rodent, and monkey pupil data and propose future applications of real time pupillometry.
- Open Access
Computational mechanisms underlying motivation to earn symbolic reinforcers
Reinforcement learning (RL) is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g. money, points) that can later be exchanged for primary reinforcers (e.g. food, drink). Although symbolic reinforcers are motivating, little is understood about the neural or computational mechanisms underlying the motivation to earn them. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g. current number of accumulated tokens, choice options, task epoch, trials since last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to capture the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task (n=5 monkeys). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement. Significance statement: Symbolic reinforcers, like money and points, play a critical role in our lives. Like rewards, symbolic reinforcers can be motivating and can even lead to compulsive behaviors like gambling addiction. However, we lack an understanding of how symbolic reinforcement can drive fluctuations in motivation. Here we investigated the effect of symbolic reinforcers on behaviors related to motivation during a token reinforcement learning task, using a novel reinforcement learning model and data from five monkeys. Our findings suggest that the value of a task state can affect willingness to initiate a trial, speed to choose, and persistence to complete a trial. Our model makes testable predictions for within trial fluctuations of neural activity related to values of task states.
Open AccessComputational mechanisms underlying motivation to earn symbolic reinforcers
Reinforcement learning (RL) is a theoretical framework that describes how agents learn to select options that maximize rewards and minimize punishments over time. We often make choices, however, to obtain symbolic reinforcers (e.g. money, points) that can later be exchanged for primary reinforcers (e.g. food, drink). Although symbolic reinforcers are motivating, little is understood about the neural or computational mechanisms underlying the motivation to earn them. In the present study, we examined how monkeys learn to make choices that maximize fluid rewards through reinforcement with tokens. The question addressed here is how the value of a state, which is a function of multiple task features (e.g. current number of accumulated tokens, choice options, task epoch, trials since last delivery of primary reinforcer, etc.), drives value and affects motivation. We constructed a Markov decision process model that computes the value of task states given task features to capture the motivational state of the animal. Fixation times, choice reaction times, and abort frequency were all significantly related to values of task states during the tokens task (n=5 monkeys). Furthermore, the model makes predictions for how neural responses could change on a moment-by-moment basis relative to changes in state value. Together, this task and model allow us to capture learning and behavior related to symbolic reinforcement. Significance statement: Symbolic reinforcers, like money and points, play a critical role in our lives. Like rewards, symbolic reinforcers can be motivating and can even lead to compulsive behaviors like gambling addiction. However, we lack an understanding of how symbolic reinforcement can drive fluctuations in motivation. Here we investigated the effect of symbolic reinforcers on behaviors related to motivation during a token reinforcement learning task, using a novel reinforcement learning model and data from five monkeys. Our findings suggest that the value of a task state can affect willingness to initiate a trial, speed to choose, and persistence to complete a trial. Our model makes testable predictions for within trial fluctuations of neural activity related to values of task states.
- Open Access
- 30 January 2023
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 19 (1) , e1010873
Environmental uncertainty and the advantage of impulsive choice strategies
Choice impulsivity is characterized by the choice of immediate, smaller reward options over future, larger reward options, and is often thought to be associated with negative life outcomes. However, some environments make future rewards more uncertain, and in these environments impulsive choices can be beneficial. Here we examined the conditions under which impulsive vs. non-impulsive decision strategies would be advantageous. We used Markov Decision Processes (MDPs) to model three common decision-making tasks: Temporal Discounting, Information Sampling, and an Explore-Exploit task. We manipulated environmental variables to create circumstances where future outcomes were relatively uncertain. We then manipulated the discount factor of an MDP agent, which affects the value of immediate versus future rewards, to model impulsive and non-impulsive behavior. This allowed us to examine the performance of impulsive and non-impulsive agents in more or less predictable environments. In Temporal Discounting, we manipulated the transition probability to delayed rewards and found that the agent with the lower discount factor (i.e. the impulsive agent) collected more average reward than the agent with a higher discount factor (the non-impulsive agent) by selecting immediate reward options when the probability of receiving the future reward was low. In the Information Sampling task, we manipulated the amount of information obtained with each sample. When sampling led to small information gains, the impulsive MDP agent collected more average reward than the non-impulsive agent. Third, in the Explore-Exploit task, we manipulated the substitution rate for novel options. When the substitution rate was high, the impulsive agent again performed better than the non-impulsive agent, as it explored the novel options less and instead exploited options with known reward values. The results of these analyses show that impulsivity can be advantageous in environments that are unexpectedly uncertain.
- 30 January 2023
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 19 (1) , e1010873
Open AccessEnvironmental uncertainty and the advantage of impulsive choice strategies
Choice impulsivity is characterized by the choice of immediate, smaller reward options over future, larger reward options, and is often thought to be associated with negative life outcomes. However, some environments make future rewards more uncertain, and in these environments impulsive choices can be beneficial. Here we examined the conditions under which impulsive vs. non-impulsive decision strategies would be advantageous. We used Markov Decision Processes (MDPs) to model three common decision-making tasks: Temporal Discounting, Information Sampling, and an Explore-Exploit task. We manipulated environmental variables to create circumstances where future outcomes were relatively uncertain. We then manipulated the discount factor of an MDP agent, which affects the value of immediate versus future rewards, to model impulsive and non-impulsive behavior. This allowed us to examine the performance of impulsive and non-impulsive agents in more or less predictable environments. In Temporal Discounting, we manipulated the transition probability to delayed rewards and found that the agent with the lower discount factor (i.e. the impulsive agent) collected more average reward than the agent with a higher discount factor (the non-impulsive agent) by selecting immediate reward options when the probability of receiving the future reward was low. In the Information Sampling task, we manipulated the amount of information obtained with each sample. When sampling led to small information gains, the impulsive MDP agent collected more average reward than the non-impulsive agent. Third, in the Explore-Exploit task, we manipulated the substitution rate for novel options. When the substitution rate was high, the impulsive agent again performed better than the non-impulsive agent, as it explored the novel options less and instead exploited options with known reward values. The results of these analyses show that impulsivity can be advantageous in environments that are unexpectedly uncertain.
- Open Access
- 18 August 2022
- Published by Oxford University Press (OUP) in Cerebral Cortex Communications
- Vol. 3 (3) , tgac034
Neurons in inferior temporal cortex are sensitive to motion trajectory during degraded object recognition
Our brains continuously acquire sensory information and make judgments even when visual information is limited. In some circumstances, an ambiguous object can be recognized from how it moves, such as an animal hopping or a plane flying overhead. Yet it remains unclear how movement is processed by brain areas involved in visual object recognition. Here we investigate whether inferior temporal (IT) cortex, an area known for its relevance in visual form processing, has access to motion information during recognition. We developed a matching task that required monkeys to recognize moving shapes with variable levels of shape degradation. Neural recordings in area IT showed that, surprisingly, some IT neurons responded stronger to degraded shapes than clear ones. Furthermore, neurons exhibited motion sensitivity at different times during the presentation of the blurry target. Population decoding analyses showed that motion patterns could be decoded from IT neuron pseudo-populations. Contrary to previous findings, these results suggest that neurons in IT can integrate visual motion and shape information, particularly when shape information is degraded, in a way that has been previously overlooked. Our results highlight the importance of using challenging multifeature recognition tasks to understand the role of area IT in naturalistic visual object recognition.
- 18 August 2022
- Published by Oxford University Press (OUP) in Cerebral Cortex Communications
- Vol. 3 (3) , tgac034
Open AccessNeurons in inferior temporal cortex are sensitive to motion trajectory during degraded object recognition
Our brains continuously acquire sensory information and make judgments even when visual information is limited. In some circumstances, an ambiguous object can be recognized from how it moves, such as an animal hopping or a plane flying overhead. Yet it remains unclear how movement is processed by brain areas involved in visual object recognition. Here we investigate whether inferior temporal (IT) cortex, an area known for its relevance in visual form processing, has access to motion information during recognition. We developed a matching task that required monkeys to recognize moving shapes with variable levels of shape degradation. Neural recordings in area IT showed that, surprisingly, some IT neurons responded stronger to degraded shapes than clear ones. Furthermore, neurons exhibited motion sensitivity at different times during the presentation of the blurry target. Population decoding analyses showed that motion patterns could be decoded from IT neuron pseudo-populations. Contrary to previous findings, these results suggest that neurons in IT can integrate visual motion and shape information, particularly when shape information is degraded, in a way that has been previously overlooked. Our results highlight the importance of using challenging multifeature recognition tasks to understand the role of area IT in naturalistic visual object recognition.
- Open Access
- 27 April 2022
- Published by eLife Sciences Publications, Ltd in eLife
- Vol. 11
Computational modeling of threat learning reveals links with anxiety and neuroanatomy in humans
Influential theories implicate variations in the mechanisms supporting threat learning in the severity of anxiety symptoms. We use computational models of associative learning in conjunction with structural imaging to explicate links among the mechanisms underlying threat learning, their neuroanatomical substrates, and anxiety severity in humans. We recorded skin-conductance data during a threat-learning task from individuals with and without anxiety disorders (N=251; 8-50 years; 116 females). Reinforcement-learning model variants quantified processes hypothesized to relate to anxiety: threat conditioning, threat generalization, safety learning, and threat extinction. We identified the best-fitting models for these processes and tested associations among latent learning parameters, whole-brain anatomy, and anxiety severity. Results indicate that greater anxiety severity related specifically to slower safety learning and slower extinction of response to safe stimuli. Nucleus accumbens gray-matter volume moderated learning-anxiety associations. Using a modeling approach, we identify computational mechanisms linking threat learning and anxiety severity and their neuroanatomical substrates.
- 27 April 2022
- Published by eLife Sciences Publications, Ltd in eLife
- Vol. 11
Open AccessComputational modeling of threat learning reveals links with anxiety and neuroanatomy in humans
Influential theories implicate variations in the mechanisms supporting threat learning in the severity of anxiety symptoms. We use computational models of associative learning in conjunction with structural imaging to explicate links among the mechanisms underlying threat learning, their neuroanatomical substrates, and anxiety severity in humans. We recorded skin-conductance data during a threat-learning task from individuals with and without anxiety disorders (N=251; 8-50 years; 116 females). Reinforcement-learning model variants quantified processes hypothesized to relate to anxiety: threat conditioning, threat generalization, safety learning, and threat extinction. We identified the best-fitting models for these processes and tested associations among latent learning parameters, whole-brain anatomy, and anxiety severity. Results indicate that greater anxiety severity related specifically to slower safety learning and slower extinction of response to safe stimuli. Nucleus accumbens gray-matter volume moderated learning-anxiety associations. Using a modeling approach, we identify computational mechanisms linking threat learning and anxiety severity and their neuroanatomical substrates.
- Open Access
Neurons in inferior temporal cortex are sensitive to motion trajectory during degraded object recognition
Our brains continuously acquire sensory information and make judgments even when visual information is limited. In some circumstances, an ambiguous object can be recognized from how it moves, such as an animal hopping or a plane flying overhead. Yet it remains unclear how movement is processed by brain areas involved in visual object recognition. Here we investigate whether inferior temporal cortex, an area traditionally known for shape processing, has access to motion information during degraded shape recognition. We developed a matching task that required monkeys to recognize moving shapes with variable levels of shape degradation. Neural recordings in area IT showed that, surprisingly, some IT neurons preferred blurry shapes over clear ones. Further, many of the neurons exhibited motion sensitivity at different times during the presentation of the blurry target. Population decoding analyses showed that motion pattern could be decoded from IT neuron pseudo-populations. Contrary to previous findings, these results suggest that neurons in IT can integrate visual motion and shape information, particularly when shape information is degraded, in a way that has been previously overlooked. Our results highlight the importance of using challenging multi-feature recognition tasks to understand the role of area IT in naturalistic visual object recognition. (Word count: 199)
Open AccessNeurons in inferior temporal cortex are sensitive to motion trajectory during degraded object recognition
Our brains continuously acquire sensory information and make judgments even when visual information is limited. In some circumstances, an ambiguous object can be recognized from how it moves, such as an animal hopping or a plane flying overhead. Yet it remains unclear how movement is processed by brain areas involved in visual object recognition. Here we investigate whether inferior temporal cortex, an area traditionally known for shape processing, has access to motion information during degraded shape recognition. We developed a matching task that required monkeys to recognize moving shapes with variable levels of shape degradation. Neural recordings in area IT showed that, surprisingly, some IT neurons preferred blurry shapes over clear ones. Further, many of the neurons exhibited motion sensitivity at different times during the presentation of the blurry target. Population decoding analyses showed that motion pattern could be decoded from IT neuron pseudo-populations. Contrary to previous findings, these results suggest that neurons in IT can integrate visual motion and shape information, particularly when shape information is degraded, in a way that has been previously overlooked. Our results highlight the importance of using challenging multi-feature recognition tasks to understand the role of area IT in naturalistic visual object recognition. (Word count: 199)