David L. Sheinberg
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
David L. Sheinberg has a total of 51 co-authors. Here are the top co-authors by number of shared publications:
- Aarit Ahuja
Brown University
4 shared publications Ryan E. B. Mruczek
Department of Neuroscience, Brown University, Providence, Rhode Island 02912, USA
4 shared publicationsAlekh Karkada Ashok
Department of Cognitive and Psychological Science, Brown University, Thayer Street, Providence, RI 02906, USA
3 shared publicationsBritt Anderson
Brown University, Department of Neuroscience, Box G-L, Sidney Frank Hall, 185 Meeting Street, Providence, RI 02912, USA
3 shared publicationsDaniel I. Brooks
Brown University, Department of Neuroscience, 185 Meeting Street, Box GL-N, Providence, Rhode Island 02912, United States
3 shared publicationsKeisuke Kawasaki
Department of Neuroscience, Brown University, Providence, Rhode Island 02912, USA
3 shared publications
Latest Publications
- 1 July 2026
- Published by MIT Press in Journal of Cognitive Neuroscience
- Vol. 38 (7) , 1297-1306
Visual Simulation Is Supported by Sequential Monitoring in the Lateral Prefrontal Cortex
Visual simulation—a process that allows us to create complex internal models of the world—is essential for the completion of daily tasks, such as our morning commute. We can mentally track our progress along the route and make adjustments on the fly, all internally. Previous work has shown that complex visual simulations are supported by visuomotor regions across humans and nonhuman primates, but relatively little is known of the cognitive processes involved. We hypothesized that neural areas involved in sequential monitoring (i.e., keeping track of the state or step in an ordered series) are selectively active during visual simulation. A monotonic increase (ramping) in lateral prefrontal cortex (LPFC) activity has been previously shown to be necessary for executing nonmotor sequences. Therefore, to test the hypothesis, we examined LPFC activity in humans and a macaque monkey using fMRI while they performed a visual simulation task, “Planko.” We found LPFC ramping across species that was specific to the visual simulation condition. These findings suggest that visual simulation tasks are supported by sequence monitoring regions across species, providing a foundation for understanding this complex and universal cognitive process.
- 1 July 2026
- Published by MIT Press in Journal of Cognitive Neuroscience
- Vol. 38 (7) , 1297-1306
Visual Simulation Is Supported by Sequential Monitoring in the Lateral Prefrontal Cortex
Visual simulation—a process that allows us to create complex internal models of the world—is essential for the completion of daily tasks, such as our morning commute. We can mentally track our progress along the route and make adjustments on the fly, all internally. Previous work has shown that complex visual simulations are supported by visuomotor regions across humans and nonhuman primates, but relatively little is known of the cognitive processes involved. We hypothesized that neural areas involved in sequential monitoring (i.e., keeping track of the state or step in an ordered series) are selectively active during visual simulation. A monotonic increase (ramping) in lateral prefrontal cortex (LPFC) activity has been previously shown to be necessary for executing nonmotor sequences. Therefore, to test the hypothesis, we examined LPFC activity in humans and a macaque monkey using fMRI while they performed a visual simulation task, “Planko.” We found LPFC ramping across species that was specific to the visual simulation condition. These findings suggest that visual simulation tasks are supported by sequence monitoring regions across species, providing a foundation for understanding this complex and universal cognitive process.
- 15 November 2024
- Published by Elsevier in Current Biology
- Vol. 34 (24) , 5635-5645.e3
Monkeys engage in visual simulation to solve complex problems
- 15 November 2024
- Published by Elsevier in Current Biology
- Vol. 34 (24) , 5635-5645.e3
Monkeys engage in visual simulation to solve complex problems
- Open Access
Monkeys engage in visual simulation to solve complex problems
Visual simulation — i.e., using internal reconstructions of the world to experience potential future versions of events that are not currently happening — is among the most sophisticated capacities of the human mind. But is this ability in fact uniquely human? To answer this question, we tested monkeys on a series of experiments involving the ‘Planko’ game, which we have previously used to evoke visual simulation in human participants. We found that monkeys were able to successfully play the game using a simulation strategy, predicting the trajectory of a ball through a field of planks while demonstrating a level of accuracy and behavioral signatures comparable to humans. Computational analyses further revealed that the monkeys’ strategy while playing Planko aligned with a recurrent neural network (RNN) that approached the task using a spontaneously learned simulation strategy. Finally, we carried out awake functional magnetic resonance imaging while monkeys played Planko. We found activity in motion-sensitive regions of the monkey brain during hypothesized simulation periods, even without any perceived visual motion cues. This neural result closely mirrors previous findings from human research, suggesting a shared mechanism of visual simulation across species. In all, these findings challenge traditional views of animal cognition, proposing that nonhuman primates possess a complex cognitive landscape, capable of invoking imaginative and predictive mental experiences to solve complex everyday problems.
Open AccessMonkeys engage in visual simulation to solve complex problems
Visual simulation — i.e., using internal reconstructions of the world to experience potential future versions of events that are not currently happening — is among the most sophisticated capacities of the human mind. But is this ability in fact uniquely human? To answer this question, we tested monkeys on a series of experiments involving the ‘Planko’ game, which we have previously used to evoke visual simulation in human participants. We found that monkeys were able to successfully play the game using a simulation strategy, predicting the trajectory of a ball through a field of planks while demonstrating a level of accuracy and behavioral signatures comparable to humans. Computational analyses further revealed that the monkeys’ strategy while playing Planko aligned with a recurrent neural network (RNN) that approached the task using a spontaneously learned simulation strategy. Finally, we carried out awake functional magnetic resonance imaging while monkeys played Planko. We found activity in motion-sensitive regions of the monkey brain during hypothesized simulation periods, even without any perceived visual motion cues. This neural result closely mirrors previous findings from human research, suggesting a shared mechanism of visual simulation across species. In all, these findings challenge traditional views of animal cognition, proposing that nonhuman primates possess a complex cognitive landscape, capable of invoking imaginative and predictive mental experiences to solve complex everyday problems.
- Open Access
Learning of the same task subserved by substantially different mechanisms between patients with Body Dysmorphic Disorder and healthy individuals
It is generally believed that learning of a perceptual task involving low-level neuronal mechanisms is similar between individuals. However, it is unclear whether this assumption also applies to individuals with psychiatric disorders that are known to have altered brain activation during visual processing. We investigated this question in patients with body dysmorphic disorder (BDD), a psychiatric disorder characterized by distressing or impairing preoccupation with nonexistent or slight defects in one’s physical appearance, and in healthy controls. Participants completed six training sessions on separate days on a visual detection task for human faces with low spatial frequency (LSF) components. Brain activation during task performance was measured with functional magnetic resonance imaging (fMRI) on separate days prior to and after training. The behavioral results showed that both groups of participants improved on the visual detection task to a similar extent through training. Despite this similarity in behavioral improvement, neuronal changes in the Fusiform Face Area (FFA), a core cortical region involved in face processing, with training were substantially different between groups. First, activation in the right FFA for LSF faces relative to High Spatial Frequency (HSF) faces that were used as an untrained control increased after training in BDD patients but decreased in controls. Second, resting state functional connectivity between left and right FFAs decreased after training in BDD patients but increased in controls. Contrary to the assumption that learning of a perceptual task is subserved by the same neuronal mechanisms across individuals, our results indicate that the neuronal mechanisms involved in learning of a face detection task differ fundamentally between patients with BDD and healthy individuals. The involvement of different neuronal mechanisms for learning of even simple perceptual tasks in patients with BDD might reflect the brain’s adaptations to altered functions imposed by the psychiatric disorder.
Open AccessLearning of the same task subserved by substantially different mechanisms between patients with Body Dysmorphic Disorder and healthy individuals
It is generally believed that learning of a perceptual task involving low-level neuronal mechanisms is similar between individuals. However, it is unclear whether this assumption also applies to individuals with psychiatric disorders that are known to have altered brain activation during visual processing. We investigated this question in patients with body dysmorphic disorder (BDD), a psychiatric disorder characterized by distressing or impairing preoccupation with nonexistent or slight defects in one’s physical appearance, and in healthy controls. Participants completed six training sessions on separate days on a visual detection task for human faces with low spatial frequency (LSF) components. Brain activation during task performance was measured with functional magnetic resonance imaging (fMRI) on separate days prior to and after training. The behavioral results showed that both groups of participants improved on the visual detection task to a similar extent through training. Despite this similarity in behavioral improvement, neuronal changes in the Fusiform Face Area (FFA), a core cortical region involved in face processing, with training were substantially different between groups. First, activation in the right FFA for LSF faces relative to High Spatial Frequency (HSF) faces that were used as an untrained control increased after training in BDD patients but decreased in controls. Second, resting state functional connectivity between left and right FFAs decreased after training in BDD patients but increased in controls. Contrary to the assumption that learning of a perceptual task is subserved by the same neuronal mechanisms across individuals, our results indicate that the neuronal mechanisms involved in learning of a face detection task differ fundamentally between patients with BDD and healthy individuals. The involvement of different neuronal mechanisms for learning of even simple perceptual tasks in patients with BDD might reflect the brain’s adaptations to altered functions imposed by the psychiatric disorder.
- Open Access
Computing a human-like reaction time metric from stable recurrent vision models
The meteoric rise in the adoption of deep neural networks as computational models of vision has inspired efforts to "align" these models with humans. One dimension of interest for alignment includes behavioral choices, but moving beyond characterizing choice patterns to capturing temporal aspects of visual decision-making has been challenging. Here, we sketch a general-purpose methodology to construct computational accounts of reaction times from a stimulus-computable, task-optimized model. Specifically, we introduce a novel metric leveraging insights from subjective logic theory summarizing evidence accumulation in recurrent vision models. We demonstrate that our metric aligns with patterns of human reaction times for stimulus manipulations across four disparate visual decision-making tasks spanning perceptual grouping, mental simulation, and scene categorization. This work paves the way for exploring the temporal alignment of model and human visual strategies in the context of various other cognitive tasks toward generating testable hypotheses for neuroscience. Links to the code and data can be found on the project page: https://serre-lab.github.io/rnn_rts_site.
Open AccessComputing a human-like reaction time metric from stable recurrent vision models
The meteoric rise in the adoption of deep neural networks as computational models of vision has inspired efforts to "align" these models with humans. One dimension of interest for alignment includes behavioral choices, but moving beyond characterizing choice patterns to capturing temporal aspects of visual decision-making has been challenging. Here, we sketch a general-purpose methodology to construct computational accounts of reaction times from a stimulus-computable, task-optimized model. Specifically, we introduce a novel metric leveraging insights from subjective logic theory summarizing evidence accumulation in recurrent vision models. We demonstrate that our metric aligns with patterns of human reaction times for stimulus manipulations across four disparate visual decision-making tasks spanning perceptual grouping, mental simulation, and scene categorization. This work paves the way for exploring the temporal alignment of model and human visual strategies in the context of various other cognitive tasks toward generating testable hypotheses for neuroscience. Links to the code and data can be found on the project page: https://serre-lab.github.io/rnn_rts_site.
- 20 April 2023
- Published by Springer Nature in Psychonomic Bulletin & Review
- Vol. 30 (5) , 1643-1667
The Architecture of Object-Based Attention
The allocation of attention to objects raises several intriguing questions: What are objects, how does attention access them, what anatomical regions are i
- 20 April 2023
- Published by Springer Nature in Psychonomic Bulletin & Review
- Vol. 30 (5) , 1643-1667
The Architecture of Object-Based Attention
The allocation of attention to objects raises several intriguing questions: What are objects, how does attention access them, what anatomical regions are i
- Open Access
- 18 August 2022
- Published by Oxford University Press (OUP) in Cerebral Cortex Communications
- Vol. 3 (3) , tgac034
Neurons in inferior temporal cortex are sensitive to motion trajectory during degraded object recognition
Our brains continuously acquire sensory information and make judgments even when visual information is limited. In some circumstances, an ambiguous object can be recognized from how it moves, such as an animal hopping or a plane flying overhead. Yet it remains unclear how movement is processed by brain areas involved in visual object recognition. Here we investigate whether inferior temporal (IT) cortex, an area known for its relevance in visual form processing, has access to motion information during recognition. We developed a matching task that required monkeys to recognize moving shapes with variable levels of shape degradation. Neural recordings in area IT showed that, surprisingly, some IT neurons responded stronger to degraded shapes than clear ones. Furthermore, neurons exhibited motion sensitivity at different times during the presentation of the blurry target. Population decoding analyses showed that motion patterns could be decoded from IT neuron pseudo-populations. Contrary to previous findings, these results suggest that neurons in IT can integrate visual motion and shape information, particularly when shape information is degraded, in a way that has been previously overlooked. Our results highlight the importance of using challenging multifeature recognition tasks to understand the role of area IT in naturalistic visual object recognition.
- 18 August 2022
- Published by Oxford University Press (OUP) in Cerebral Cortex Communications
- Vol. 3 (3) , tgac034
Open AccessNeurons in inferior temporal cortex are sensitive to motion trajectory during degraded object recognition
Our brains continuously acquire sensory information and make judgments even when visual information is limited. In some circumstances, an ambiguous object can be recognized from how it moves, such as an animal hopping or a plane flying overhead. Yet it remains unclear how movement is processed by brain areas involved in visual object recognition. Here we investigate whether inferior temporal (IT) cortex, an area known for its relevance in visual form processing, has access to motion information during recognition. We developed a matching task that required monkeys to recognize moving shapes with variable levels of shape degradation. Neural recordings in area IT showed that, surprisingly, some IT neurons responded stronger to degraded shapes than clear ones. Furthermore, neurons exhibited motion sensitivity at different times during the presentation of the blurry target. Population decoding analyses showed that motion patterns could be decoded from IT neuron pseudo-populations. Contrary to previous findings, these results suggest that neurons in IT can integrate visual motion and shape information, particularly when shape information is degraded, in a way that has been previously overlooked. Our results highlight the importance of using challenging multifeature recognition tasks to understand the role of area IT in naturalistic visual object recognition.
- Open Access
- 11 May 2022
- Published by Center for Open Science in PsyArXiv
Object-Based Attention
There appear to be three independent systems for allocating attention: space-based, feature based, and object-based. Here, we review the literature of object-based attention to determine its underlying mechanisms. First, findings from unconscious priming and cuing suggest that the pre-attentive targets of object-based attention can be fully developed object representations. Next, the control of object-based attention appears to come from ventral visual areas specialized in object analysis that project downward to early visual areas. Whether feedback from object areas can accurately target the object’s specific locations and features is controversial, but recent work in autoencoding has made this plausible. Finally, we suggest that the three classic modes of attention may not be as independent as is commonly considered, and instead could rely on object-based attention for all three modes of selection. Specifically, studies show that attention can spread over the separated members of a group – without affecting the space between them — matching the defining property of feature-based attention. At the same time, object-based attention directed to a single small item has the properties of space-based attention. Nevertheless, the evidence for a parallel, space-based selection controlled through saccade centers is also convincing. We outline the architecture for this combined system and discuss how it works in parallel with other attention pathways.
- 11 May 2022
- Published by Center for Open Science in PsyArXiv
Open AccessObject-Based Attention
There appear to be three independent systems for allocating attention: space-based, feature based, and object-based. Here, we review the literature of object-based attention to determine its underlying mechanisms. First, findings from unconscious priming and cuing suggest that the pre-attentive targets of object-based attention can be fully developed object representations. Next, the control of object-based attention appears to come from ventral visual areas specialized in object analysis that project downward to early visual areas. Whether feedback from object areas can accurately target the object’s specific locations and features is controversial, but recent work in autoencoding has made this plausible. Finally, we suggest that the three classic modes of attention may not be as independent as is commonly considered, and instead could rely on object-based attention for all three modes of selection. Specifically, studies show that attention can spread over the separated members of a group – without affecting the space between them — matching the defining property of feature-based attention. At the same time, object-based attention directed to a single small item has the properties of space-based attention. Nevertheless, the evidence for a parallel, space-based selection controlled through saccade centers is also convincing. We outline the architecture for this combined system and discuss how it works in parallel with other attention pathways.
- Open Access
- 1 May 2022
- Published by Society for Neuroscience in eneuro
- Vol. 9 (3)
Evidence for Independent Processing of Shape by Vision and Touch
Although visual object recognition is well studied and relatively well understood, much less is known about how shapes are recognized by touch and how such haptic stimuli might be compared with visual shapes. One might expect that the processes of visual and haptic object recognition engage similar brain structures given the advantages of avoiding redundant brain circuitry and indeed there is some evidence that this is the case. A potentially fruitful approach to understanding the differences in how shapes might be neurally represented is to find an algorithmic method of comparing shapes, which agrees with human behavior and determines whether that method differs between different modality conditions. If not, it would provide further evidence for a shared representation of shape. We recruited human participants to perform a one-back same–different visual and haptic shape comparison task both within (i.e., comparing two visual shapes or two haptic shapes) and across (i.e., comparing visual with haptic shapes) modalities. We then used various shape metrics to predict performance based on the shape, orientation, and modality of the two stimuli that were being compared on each trial. We found that the metrics that best predict shape comparison behavior heavily depended on the modality of the two shapes, suggesting differences in which features are used for comparing shapes depending on modality and that object recognition is not necessarily performed in a single, modality-agnostic region.
- 1 May 2022
- Published by Society for Neuroscience in eneuro
- Vol. 9 (3)
Open AccessEvidence for Independent Processing of Shape by Vision and Touch
Although visual object recognition is well studied and relatively well understood, much less is known about how shapes are recognized by touch and how such haptic stimuli might be compared with visual shapes. One might expect that the processes of visual and haptic object recognition engage similar brain structures given the advantages of avoiding redundant brain circuitry and indeed there is some evidence that this is the case. A potentially fruitful approach to understanding the differences in how shapes might be neurally represented is to find an algorithmic method of comparing shapes, which agrees with human behavior and determines whether that method differs between different modality conditions. If not, it would provide further evidence for a shared representation of shape. We recruited human participants to perform a one-back same–different visual and haptic shape comparison task both within (i.e., comparing two visual shapes or two haptic shapes) and across (i.e., comparing visual with haptic shapes) modalities. We then used various shape metrics to predict performance based on the shape, orientation, and modality of the two stimuli that were being compared on each trial. We found that the metrics that best predict shape comparison behavior heavily depended on the modality of the two shapes, suggesting differences in which features are used for comparing shapes depending on modality and that object recognition is not necessarily performed in a single, modality-agnostic region.
- Open Access
Neurons in inferior temporal cortex are sensitive to motion trajectory during degraded object recognition
Our brains continuously acquire sensory information and make judgments even when visual information is limited. In some circumstances, an ambiguous object can be recognized from how it moves, such as an animal hopping or a plane flying overhead. Yet it remains unclear how movement is processed by brain areas involved in visual object recognition. Here we investigate whether inferior temporal cortex, an area traditionally known for shape processing, has access to motion information during degraded shape recognition. We developed a matching task that required monkeys to recognize moving shapes with variable levels of shape degradation. Neural recordings in area IT showed that, surprisingly, some IT neurons preferred blurry shapes over clear ones. Further, many of the neurons exhibited motion sensitivity at different times during the presentation of the blurry target. Population decoding analyses showed that motion pattern could be decoded from IT neuron pseudo-populations. Contrary to previous findings, these results suggest that neurons in IT can integrate visual motion and shape information, particularly when shape information is degraded, in a way that has been previously overlooked. Our results highlight the importance of using challenging multi-feature recognition tasks to understand the role of area IT in naturalistic visual object recognition. (Word count: 199)
Open AccessNeurons in inferior temporal cortex are sensitive to motion trajectory during degraded object recognition
Our brains continuously acquire sensory information and make judgments even when visual information is limited. In some circumstances, an ambiguous object can be recognized from how it moves, such as an animal hopping or a plane flying overhead. Yet it remains unclear how movement is processed by brain areas involved in visual object recognition. Here we investigate whether inferior temporal cortex, an area traditionally known for shape processing, has access to motion information during degraded shape recognition. We developed a matching task that required monkeys to recognize moving shapes with variable levels of shape degradation. Neural recordings in area IT showed that, surprisingly, some IT neurons preferred blurry shapes over clear ones. Further, many of the neurons exhibited motion sensitivity at different times during the presentation of the blurry target. Population decoding analyses showed that motion pattern could be decoded from IT neuron pseudo-populations. Contrary to previous findings, these results suggest that neurons in IT can integrate visual motion and shape information, particularly when shape information is degraded, in a way that has been previously overlooked. Our results highlight the importance of using challenging multi-feature recognition tasks to understand the role of area IT in naturalistic visual object recognition. (Word count: 199)