Robert Shapley
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Robert Shapley has a total of 22 co-authors. Here are the top co-authors by number of shared publications:
- Felix A. Wichmann
Neural Information Processing Group, University of Tübingen, Tübingen, Germany
3 shared publications - Lai-Sang Young
New York University
3 shared publications - Marianne Maertens
Computational Psychology, Technische Universität, Berlin, Germany
3 shared publications Ehud Kaplan
Rockefeller University
2 shared publicationsJames Gordon
Psychology Department, Hunter College, USA
2 shared publications- Logan Chariker
School of Natural Sciences, Institute for Advanced Study, Princeton, USA
2 shared publications
Latest Publications
- 2 March 2025
- Published by Elsevier in Vision Research
- Vol. 229, 108564
Cortical processing of color: Chromatic visual evoked potentials
- 2 March 2025
- Published by Elsevier in Vision Research
- Vol. 229, 108564
Cortical processing of color: Chromatic visual evoked potentials
- 19 June 2024
- Published by Elsevier in Vision Research
- Vol. 222, 108448
Low luminance contrast’s effect on the color appearance of S-cone patterns
- 19 June 2024
- Published by Elsevier in Vision Research
- Vol. 222, 108448
Low luminance contrast’s effect on the color appearance of S-cone patterns
- 5 August 2021
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 118 (32)
A theory of direction selectivity for macaque primary visual cortex
Significance: Motion perception is important for primates, and direction selectivity (DS), the ability to perceive the direction a target is moving, is an essential part of motion perception. Yet no satisfactory mechanistic explanation has been proposed for the origin of DS in the primate visual cortex up until now. In this paper, we hypothesize that DS is initiated in feed-forward LGN input as a result of the dynamic differences between the ON and OFF pathways. The mechanisms we propose are biology based, and our theory explains experimental data for all spatial and temporal frequencies in visual stimuli. Exploiting temporal biases in parallel pathways is relevant beyond visual neuroscience; similar ideas likely apply to other types of neural signal processing.
- 5 August 2021
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 118 (32)
A theory of direction selectivity for macaque primary visual cortex
Significance: Motion perception is important for primates, and direction selectivity (DS), the ability to perceive the direction a target is moving, is an essential part of motion perception. Yet no satisfactory mechanistic explanation has been proposed for the origin of DS in the primate visual cortex up until now. In this paper, we hypothesize that DS is initiated in feed-forward LGN input as a result of the dynamic differences between the ON and OFF pathways. The mechanisms we propose are biology based, and our theory explains experimental data for all spatial and temporal frequencies in visual stimuli. Exploiting temporal biases in parallel pathways is relevant beyond visual neuroscience; similar ideas likely apply to other types of neural signal processing.
- Open Access
- 9 April 2020
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 20 (4) , 16
Contrast response in a comprehensive network model of macaque V1
The response to contrast is one of the most important functions of the macaque primary visual cortex, V1, but up to now there has not been an adequate theory for it. To fill this gap in our understanding of cortical function, we built and analyzed a new large-scale, biologically constrained model of the input layer, 4Cα, of macaque V1. We called the new model CSY2. We challenged CSY2 with a three-parameter family of visual stimuli that varied in contrast, orientation, and spatial frequency. CSY2 accurately simulated experimental data and made many new predictions. It accounted for 1) the shapes of firing-rate-versus-contrast functions, 2) orientation and spatial frequency tuning versus contrast, and 3) the approximate contrast-invariance of cortical activity maps. Post-analysis revealed that the mechanisms that were needed to produce the successful simulations of contrast response included strong recurrent excitation and inhibition that find dynamic equilibria across the cortical surface, dynamic feedback between L6 and L4, and synaptic dynamics like inhibitory synaptic depression.
- 9 April 2020
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 20 (4) , 16
Open AccessContrast response in a comprehensive network model of macaque V1
The response to contrast is one of the most important functions of the macaque primary visual cortex, V1, but up to now there has not been an adequate theory for it. To fill this gap in our understanding of cortical function, we built and analyzed a new large-scale, biologically constrained model of the input layer, 4Cα, of macaque V1. We called the new model CSY2. We challenged CSY2 with a three-parameter family of visual stimuli that varied in contrast, orientation, and spatial frequency. CSY2 accurately simulated experimental data and made many new predictions. It accounted for 1) the shapes of firing-rate-versus-contrast functions, 2) orientation and spatial frequency tuning versus contrast, and 3) the approximate contrast-invariance of cortical activity maps. Post-analysis revealed that the mechanisms that were needed to produce the successful simulations of contrast response included strong recurrent excitation and inhibition that find dynamic equilibria across the cortical surface, dynamic feedback between L6 and L4, and synaptic dynamics like inhibitory synaptic depression.
- Open Access
Distinct spatiotemporal mechanisms underlie extra-classical receptive field modulation in macaque V1 microcircuits
Complex scene perception depends upon the interaction between signals from the classical receptive field (CRF) and the extra-classical receptive field (eCRF) in primary visual cortex (V1) neurons. While much is known about V1 eCRF properties, it remains unknown how the underlying mechanisms map onto the cortical microcircuit. We probed the spatio-temporal dynamics of eCRF modulation using a reverse correlation paradigm, and found three principal eCRF mechanisms: tuned-facilitation, untuned-suppression, and tuned-suppression. Each mechanism had a distinct timing and spatial profile. Laminar analysis showed that the timing, orientation-tuning, and strength of eCRF mechanisms had distinct signatures within magnocellular and parvocellular processing streams in the V1 microcircuit. The existence of multiple eCRF mechanisms provides new insights into how V1 responds to spatial context. Modeling revealed that the differences in timing and scale of these mechanisms predicted distinct patterns of net modulation, reconciling many previous disparate physiological and psychophysical findings.
Open AccessDistinct spatiotemporal mechanisms underlie extra-classical receptive field modulation in macaque V1 microcircuits
Complex scene perception depends upon the interaction between signals from the classical receptive field (CRF) and the extra-classical receptive field (eCRF) in primary visual cortex (V1) neurons. While much is known about V1 eCRF properties, it remains unknown how the underlying mechanisms map onto the cortical microcircuit. We probed the spatio-temporal dynamics of eCRF modulation using a reverse correlation paradigm, and found three principal eCRF mechanisms: tuned-facilitation, untuned-suppression, and tuned-suppression. Each mechanism had a distinct timing and spatial profile. Laminar analysis showed that the timing, orientation-tuning, and strength of eCRF mechanisms had distinct signatures within magnocellular and parvocellular processing streams in the V1 microcircuit. The existence of multiple eCRF mechanisms provides new insights into how V1 responds to spatial context. Modeling revealed that the differences in timing and scale of these mechanisms predicted distinct patterns of net modulation, reconciling many previous disparate physiological and psychophysical findings.
- Open Access
- 23 July 2019
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 15 (7) , e1007198
A case study in the functional consequences of scaling the sizes of realistic cortical models
Neuroscience models come in a wide range of scales and specificity, from mean-field rate models to large-scale networks of spiking neurons. There are potential trade-offs between simplicity and realism, versatility and computational speed. This paper is about large-scale cortical network models, and the question we address is one of scalability: would scaling down cell density impact a network’s ability to reproduce cortical dynamics and function? We investigated this problem using a previously constructed realistic model of the monkey visual cortex that is true to size. Reducing cell density gradually up to 50-fold, we studied changes in model behavior. Size reduction without parameter adjustment was catastrophic. Surprisingly, relatively minor compensation in synaptic weights guided by a theoretical algorithm restored mean firing rates and basic function such as orientation selectivity to models 10-20 times smaller than the real cortex. Not all was normal in the reduced model cortices: intracellular dynamics acquired a character different from that of real neurons, and while the ability to relay feedforward inputs remained intact, reduced models showed signs of deficiency in functions that required dynamical interaction among cortical neurons. These findings are not confined to models of the visual cortex, and modelers should be aware of potential issues that accompany size reduction. Broader implications of this study include the importance of homeostatic maintenance of firing rates, and the functional consequences of feedforward versus recurrent dynamics, ideas that may shed light on other species and on systems suffering cell loss. With the vast numbers of neurons in the cerebral cortex, models in neuroscience are, for practical reasons, often orders of magnitude smaller than the actual network. We examine in this article the scalability of cortical networks. We find that function and dynamics in a network depend on network size. For illustration, we use a previously constructed realistic model of monkey visual cortex. Reducing the number of cells in the model, we find that small changes in synaptic weights can help maintain firing rates. However, model characteristics change fundamentally in the reduced models. Neurons have abnormal intracellular dynamics. The model becomes dominated by feedforward inputs and is less capable of functions requiring neuronal interaction. Modelers need to be aware of the potential issues with reduced cortical network models.
- 23 July 2019
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 15 (7) , e1007198
Open AccessA case study in the functional consequences of scaling the sizes of realistic cortical models
Neuroscience models come in a wide range of scales and specificity, from mean-field rate models to large-scale networks of spiking neurons. There are potential trade-offs between simplicity and realism, versatility and computational speed. This paper is about large-scale cortical network models, and the question we address is one of scalability: would scaling down cell density impact a network’s ability to reproduce cortical dynamics and function? We investigated this problem using a previously constructed realistic model of the monkey visual cortex that is true to size. Reducing cell density gradually up to 50-fold, we studied changes in model behavior. Size reduction without parameter adjustment was catastrophic. Surprisingly, relatively minor compensation in synaptic weights guided by a theoretical algorithm restored mean firing rates and basic function such as orientation selectivity to models 10-20 times smaller than the real cortex. Not all was normal in the reduced model cortices: intracellular dynamics acquired a character different from that of real neurons, and while the ability to relay feedforward inputs remained intact, reduced models showed signs of deficiency in functions that required dynamical interaction among cortical neurons. These findings are not confined to models of the visual cortex, and modelers should be aware of potential issues that accompany size reduction. Broader implications of this study include the importance of homeostatic maintenance of firing rates, and the functional consequences of feedforward versus recurrent dynamics, ideas that may shed light on other species and on systems suffering cell loss. With the vast numbers of neurons in the cerebral cortex, models in neuroscience are, for practical reasons, often orders of magnitude smaller than the actual network. We examine in this article the scalability of cortical networks. We find that function and dynamics in a network depend on network size. For illustration, we use a previously constructed realistic model of monkey visual cortex. Reducing the number of cells in the model, we find that small changes in synaptic weights can help maintain firing rates. However, model characteristics change fundamentally in the reduced models. Neurons have abnormal intracellular dynamics. The model becomes dominated by feedforward inputs and is less capable of functions requiring neuronal interaction. Modelers need to be aware of the potential issues with reduced cortical network models.
- Open Access
Human Sound Localization Depends on Sound Intensity: Implications for Sensory Coding
A fundamental question of human perception is how we perceive target locations in space. Through our eyes and skin, the activation patterns of sensory organs provide rich spatial cues. However, for other sensory dimensions, including sound localization and visual depth perception, spatial locations must be computed by the brain. For instance, interaural time differences (ITDs) of the sounds reaching the ears allow listeners to localize sound in the horizontal plane. Our experiments tested two prevalent theories on how ITDs affect human sound localization: 1) the labelled-line model, encoding space through tuned representations of spatial location; versus 2) the hemispheric-difference model, representing space through spike-rate distances relative to a perceptual anchor. Unlike the labelled-line model, the hemispheric-difference model predicts that with decreasing intensity, sound localization should collapse toward midline reference, and this is what we observed behaviorally. These findings cast doubt on models of human sound localization that rely on a spatially tuned map. Moreover, analogous experimental results in vision indicate that perceived depth depends upon the contrast of the target. Based on our findings, we propose that the brain uses a canonical computation of location across sensory modalities: perceived location is encoded through population spike rate relative to baseline.
Open AccessHuman Sound Localization Depends on Sound Intensity: Implications for Sensory Coding
A fundamental question of human perception is how we perceive target locations in space. Through our eyes and skin, the activation patterns of sensory organs provide rich spatial cues. However, for other sensory dimensions, including sound localization and visual depth perception, spatial locations must be computed by the brain. For instance, interaural time differences (ITDs) of the sounds reaching the ears allow listeners to localize sound in the horizontal plane. Our experiments tested two prevalent theories on how ITDs affect human sound localization: 1) the labelled-line model, encoding space through tuned representations of spatial location; versus 2) the hemispheric-difference model, representing space through spike-rate distances relative to a perceptual anchor. Unlike the labelled-line model, the hemispheric-difference model predicts that with decreasing intensity, sound localization should collapse toward midline reference, and this is what we observed behaviorally. These findings cast doubt on models of human sound localization that rely on a spatially tuned map. Moreover, analogous experimental results in vision indicate that perceived depth depends upon the contrast of the target. Based on our findings, we propose that the brain uses a canonical computation of location across sensory modalities: perceived location is encoded through population spike rate relative to baseline.
- Open Access
- 1 September 2017
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 17 (11) , 9
Nonlinear dynamics of cortical responses to color in the human cVEP
The main finding of this paper is that the human visual cortex responds in a very nonlinear manner to the color contrast of pure color patterns. We examined human cortical responses to color checkerboard patterns at many color contrasts, measuring the chromatic visual evoked potential (cVEP) with a dense electrode array. Cortical topography of the cVEPs showed that they were localized near the posterior electrode at position Oz, indicating that the primary cortex (V1) was the major source of responses. The choice of fine spatial patterns as stimuli caused the cVEP response to be driven by double-opponent neurons in V1. The cVEP waveform revealed nonlinear color signal processing in the V1 cortex. The cVEP time-to-peak decreased and the waveform's shape was markedly narrower with increasing cone contrast. Comparison of the linear dynamics of retinal and lateral geniculate nucleus responses with the nonlinear dynamics of the cortical cVEP indicated that the nonlinear dynamics originated in the V1 cortex. The nature of the nonlinearity is a kind of automatic gain control that adjusts cortical dynamics to be faster when color contrast is greater.
- 1 September 2017
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 17 (11) , 9
Open AccessNonlinear dynamics of cortical responses to color in the human cVEP
The main finding of this paper is that the human visual cortex responds in a very nonlinear manner to the color contrast of pure color patterns. We examined human cortical responses to color checkerboard patterns at many color contrasts, measuring the chromatic visual evoked potential (cVEP) with a dense electrode array. Cortical topography of the cVEPs showed that they were localized near the posterior electrode at position Oz, indicating that the primary cortex (V1) was the major source of responses. The choice of fine spatial patterns as stimuli caused the cVEP response to be driven by double-opponent neurons in V1. The cVEP waveform revealed nonlinear color signal processing in the V1 cortex. The cVEP time-to-peak decreased and the waveform's shape was markedly narrower with increasing cone contrast. Comparison of the linear dynamics of retinal and lateral geniculate nucleus responses with the nonlinear dynamics of the cortical cVEP indicated that the nonlinear dynamics originated in the V1 cortex. The nature of the nonlinearity is a kind of automatic gain control that adjusts cortical dynamics to be faster when color contrast is greater.
- Open Access
- 1 October 2015
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 15 (14) , 1
Noise masking of White's illusion exposes the weakness of current spatial filtering models of lightness perception
Spatial filtering models are currently a widely accepted mechanistic account of human lightness perception. Their popularity can be ascribed to two reasons: They correctly predict how human observers perceive a variety of lightness illusions, and the processing steps involved in the models bear an apparent resemblance with known physiological mechanisms at early stages of visual processing. Here, we tested the adequacy of these models by probing their response to stimuli that have been modified by adding narrowband noise. Psychophysically, it has been shown that noise in the range of one to five cycles per degree (cpd) can drastically reduce the strength of some lightness phenomena, while noise outside this range has little or no effect on perceived lightness. Choosing White's illusion (White, 1979) as a test case, we replicated and extended the psychophysical results, and found that none of the spatial filtering models tested was able to reproduce the spatial frequency specific effect of narrowband noise. We discuss the reasons for failure for each model individually, but we argue that the failure is indicative of the general inadequacy of this class of spatial filtering models. Given the present evidence we do not believe that spatial filtering models capture the mechanisms that are responsible for producing many of the lightness phenomena observed in human perception. Instead we think that our findings support the idea that low-level contributions to perceived lightness are primarily determined by the luminance contrast at surface boundaries.
- 1 October 2015
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 15 (14) , 1
Open AccessNoise masking of White's illusion exposes the weakness of current spatial filtering models of lightness perception
Spatial filtering models are currently a widely accepted mechanistic account of human lightness perception. Their popularity can be ascribed to two reasons: They correctly predict how human observers perceive a variety of lightness illusions, and the processing steps involved in the models bear an apparent resemblance with known physiological mechanisms at early stages of visual processing. Here, we tested the adequacy of these models by probing their response to stimuli that have been modified by adding narrowband noise. Psychophysically, it has been shown that noise in the range of one to five cycles per degree (cpd) can drastically reduce the strength of some lightness phenomena, while noise outside this range has little or no effect on perceived lightness. Choosing White's illusion (White, 1979) as a test case, we replicated and extended the psychophysical results, and found that none of the spatial filtering models tested was able to reproduce the spatial frequency specific effect of narrowband noise. We discuss the reasons for failure for each model individually, but we argue that the failure is indicative of the general inadequacy of this class of spatial filtering models. Given the present evidence we do not believe that spatial filtering models capture the mechanisms that are responsible for producing many of the lightness phenomena observed in human perception. Instead we think that our findings support the idea that low-level contributions to perceived lightness are primarily determined by the luminance contrast at surface boundaries.
- Open Access
- 1 August 2015
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 15 (11) , 14
Testing the role of luminance edges in White's illusion with contour adaptation
White's illusion is the perceptual effect that two equiluminant gray patches superimposed on a black-and-white square-wave grating appear different in lightness: A test patch placed on a dark stripe of the grating looks lighter than one placed on a light stripe. Although the effect does not depend on the aspect ratio of the test patches, and thus on the amount of border that is shared with either the dark or the light stripe, the context of each patch must, in a yet to be specified way, influence their lightness. We employed a contour adaptation paradigm (Anstis, 2013) to test the contribution of each of the test patches' edges to the perceived lightness of the test patches. We found that adapting to the edges that are oriented parallel to the grating slightly increased the lightness illusion, whereas adapting to the orthogonal edges abolished, or for some observers even reversed, the lightness illusion. We implemented a temporal adaptation mechanism in three spatial filtering models of lightness perception, and show that the models cannot account for the observed adaptation effects. We conclude that White's illusion is largely determined by edge contrast across the edge orthogonal to the grating, whereas the parallel edge has little or no influence. We suggest mechanisms that could explain this asymmetry.
- 1 August 2015
- Published by Association for Research in Vision and Ophthalmology (ARVO) in Journal of Vision
- Vol. 15 (11) , 14
Open AccessTesting the role of luminance edges in White's illusion with contour adaptation
White's illusion is the perceptual effect that two equiluminant gray patches superimposed on a black-and-white square-wave grating appear different in lightness: A test patch placed on a dark stripe of the grating looks lighter than one placed on a light stripe. Although the effect does not depend on the aspect ratio of the test patches, and thus on the amount of border that is shared with either the dark or the light stripe, the context of each patch must, in a yet to be specified way, influence their lightness. We employed a contour adaptation paradigm (Anstis, 2013) to test the contribution of each of the test patches' edges to the perceived lightness of the test patches. We found that adapting to the edges that are oriented parallel to the grating slightly increased the lightness illusion, whereas adapting to the orthogonal edges abolished, or for some observers even reversed, the lightness illusion. We implemented a temporal adaptation mechanism in three spatial filtering models of lightness perception, and show that the models cannot account for the observed adaptation effects. We conclude that White's illusion is largely determined by edge contrast across the edge orthogonal to the grating, whereas the parallel edge has little or no influence. We suggest mechanisms that could explain this asymmetry.