DHDavid J. Heeger

David J. Heeger

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


David J. Heeger has a total of 119 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Hierarchical Neural Circuit Theory of Normalization and Inter-areal Communication

    by Asit Pal, Shivang Rawat, David J Heeger, Stefano Martiniani

    The primate brain exhibits a hierarchical, modular architecture with conserved microcircuits executing canonical computations across reciprocally connected cortical areas. We present a hierarchical neural circuit theory with feedback connections that dynamically implements divisive normalization across its hierarchy. In a two-stage instantiation (V1 ↔ V2), increasing feedback from V2 to V1 amplifies responses in both areas. We analytically derive power spectra (V1) and coherence spectra (V1-V2) as functions of frequency (f), and compare them with experimental observations: peaks in both spectra shift to higher frequencies with increased stimulus contrast, and power decays as 1/f4 at high frequencies. The closed-form spectra are validated against direct stochastic simulation of the full nonlinear circuit across contrasts. The theory further predicts distinctive spectral signatures of feedback and input gain modulation. Crucially, the theory offers a unified view of inter-areal communication, defined as the ability to linearly predict neural activity in one brain area from neural activity in another, with emergent features consistent with empirical observations of both communication subspaces and inter-areal coherence. It admits a low-dimensional communication subspace, where inter-areal communication is lower-dimensional than within-area communication. It further predicts that: i) increasing feedback strength enhances inter-areal communication and diminishes within-area communication, without altering the subspace dimensionality; ii) communication is strongest, and the subspace dimensionality lowest, at the frequencies at which V1-V2 coherence peaks; iii) normalization reduces the subspace dimensionality. Finally, a three-area (V1 ↔ V4 and V1 ↔ V5) instantiation of the theory demonstrates that differential feedback from higher to lower cortical areas dictates their dynamic functional connectivity. Altogether, our theory provides a robust and analytically tractable framework for generating experimentally-testable predictions about normalization, inter-areal communication, and functional connectivity.

  • Open Access

    Hierarchical Neural Circuit Theory of Normalization and Inter-areal Communication

    by Asit Pal, Shivang Rawat, David J Heeger, Stefano Martiniani

    The primate brain exhibits a hierarchical, modular architecture with conserved microcircuits executing canonical computations across reciprocally connected cortical areas. We present a hierarchical neural circuit theory with feedback connections that dynamically implements divisive normalization across its hierarchy. In a two-stage instantiation (V1 ↔ V2), increasing feedback from V2 to V1 amplifies responses in both areas. We analytically derive power spectra (V1) and coherence spectra (V1-V2), and validate them against experimental observations: peaks in both spectra shift to higher frequencies with increased stimulus contrast, and power decays as 1/f4 at high frequencies (f). The theory further predicts distinctive spectral signatures of feedback and input gain modulation. Crucially, the theory offers a unified view of inter-areal communication, with emergent features commensurate with empirical observations of both communication subspaces and inter-areal coherence. It admits a low-dimensional communication subspace, where inter-areal communication is lower-dimensional than within-area communication. It further predicts that: i) increasing feedback strength enhances inter-areal communication and diminishes within-area communication, without altering the subspace dimensionality; ii) high-coherence frequencies are characterized by stronger communication (ability to estimate neural activity in one brain area from neural activity in another brain area) and reduced subspace dimensionality; iii) Normalization reduces the subspace dimensionality. Finally, a three-area (V1 ↔ V4 and V1↔ V5) instantiation of the theory demonstrates that differential feedback from higher to lower cortical areas dictates their dynamic functional connectivity. Altogether, our theory provides a robust and analytically tractable framework for generating experimentally-testable predictions about normalization, inter-areal communication, and functional connectivity.

  • Open Access

    Stabilization of recurrent neural networks through divisive normalization

    by Flaviano Morone, Shivang Rawat, David J. Heeger, Stefano Martiniani

    Stability is a fundamental requirement for both biological and engineered neural circuits, yet it is surprisingly difficult to guarantee in the presence of recurrent interactions. Standard linear dynamical models of recurrent networks are sensitive to the precise values of the synaptic weights, since stability requires all eigenvalues of the recurrent matrix to lie within the unit circle. Here we demonstrate, both theoretically and numerically, that an arbitrary recurrent neural network can remain stable even when its spectral radius exceeds 1, provided it incorporates divisive normalization, a dynamical neural operation that suppresses the responses of individual neurons. Sufficiently strong recurrent weights lead to instability, but the approach to the unstable phase is preceded by a regime of critical slowing down, a well-known early warning signal for loss of stability. Remarkably, the onset of critical slowing down coincides with the breakdown of normalization, which we predict analytically as a function of the synaptic strength and the magnitude of the external input. Our findings suggest that the widespread implementation of normalization across neural systems may be linked to its essential role in ensuring dynamical stability in the presence of the strong recurrent interactions required for complex cortical computations.

  • Open Access

    Attention-induced perceptual traveling waves in binocular rivalry

    by João V. X. Cardoso, Hsin-Hung Li, David J. Heeger, Laura Dugué

    Cortical traveling waves-smooth changes of phase over time across the cortical surface-have been proposed to modulate perception periodically as they travel through retinotopic cortex, yet little is known about the underlying computational principles. Here, we make use of binocular rivalry, a perceptual phenomenon in which perceptual (illusory) waves are perceived when a shift in dominance occurs between two rival images. First, we assessed these perceptual waves using psychophysics. Participants viewed a stimulus restricted to an annulus around fixation, with orthogonal orientations presented to each eye. The stimulus presented to one eye was of greater contrast, thus generating perceptual dominance. When a patch of greater contrast was flashed briefly at one position in the other eye, it created a change in dominance that started at that location of the flash and expanded progressively, like a wave, as the previously suppressed stimulus became dominant. We found that the duration of the perceptual propagation increased with both distance traveled and eccentricity of the annulus. Diverting attention away from the annulus reduced drastically the occurrence and the speed of the wave. Second, we developed a computational model of traveling waves in which competition between the neural representations of the two stimuli is driven by both attentional modulation and mutual inhibition. We found that the model captured the key features of wave propagation dynamics. Together, these findings provide new insights into the functional relevance of cortical traveling waves and offer a framework for further experimental investigation into their role in perception.


  • Open Access

    Hierarchical Neural Circuit Theory of Normalization and Inter-areal Communication

    by Asit Pal, Shivang Rawat, David J. Heeger, Stefano Martiniani

    The primate brain exhibits a hierarchical, modular architecture with conserved microcircuits executing canonical computations across reciprocally connected cortical areas. We present a hierarchical neural circuit theory with feedback connections that dynamically implements divisive normalization across its hierarchy. In a two-stage instantiation (V1 ↔ V2), increasing feedback from V2 to V1 amplifies responses in both areas. We analytically derive power spectra (V1) and coherence spectra (V1-V2), and validate them against experimental observations: peaks in both spectra shift to higher frequencies with increased stimulus contrast, and power decays as 1/f 4 at high frequencies (f). The theory further predicts distinctive spectral signatures of feedback and input gain modulation. Crucially, the theory offers a unified view of inter-areal communication, with emergent features commensurate with empirical observations of both communication subspaces and inter-areal coherence. It admits a low-dimensional communication subspace, where inter-areal communication is lower-dimensional than within-area communication. It further predicts that: i) increasing feedback strength enhances inter-areal communication and diminishes within-area communication, without altering the subspace dimensionality; ii) high-coherence frequencies are characterized by stronger communication (ability to estimate neural activity in one brain area from neural activity in another brain area) and reduced subspace dimensionality; iii) Normalization reduces the subspace dimensionality. Finally, a three-area (V1 ↔ V4 and V1↔ V5) instantiation of the theory demonstrates that differential feedback from higher to lower cortical areas dictates their dynamic functional connectivity. Altogether, our theory provides a robust and analytically tractable framework for generating experimentally-testable predictions about normalization, inter-areal communication, and functional connectivity.

  • Open Access

    Attention induced perceptual traveling waves in binocular rivalry

    by João V. X. Cardoso, Hsin-Hung Li, David J. Heeger, Laura Dugué

    Cortical traveling waves –smooth changes of phase over time across the cortical surface– have been proposed to modulate perception periodically as they travel through retinotopic cortex. Yet, little is known about the underlying computational principles. Here, we make use of binocular rivalry, a perceptual phenomenon in which perceptual (illusory) waves are perceived when a shift in dominance occurs between two rival images. First, we assessed these perceptual waves using psychophysics. Participants viewed a stimulus restricted to an annulus around fixation, with orthogonal orientations presented to each eye. The stimulus presented to one eye was of higher contrast thus generating perceptual dominance. When a patch of higher contrast was flashed briefly at one position in the other eye, it created a change in dominance that started at that location of the flash and expanded progressively, like a wave, as the previously suppressed stimulus became dominant. We found that the duration of the perceptual propagation increased with both distance traveled and eccentricity of the annulus. Diverting attention away from the annulus reduced drastically the occurrence and the speed of the wave. Second, we developed a computational model of traveling waves in which competition between the neural representations of the two stimuli is driven by both attentional modulation and mutual inhibition. We found that the model captured the key features of wave propagation dynamics. Together, these findings provide new insights into the functional relevance of cortical traveling waves and offer a framework for further experimental investigation into their role in perception.

  • Open Access

    Anticipatory and evoked visual cortical dynamics of voluntary temporal attention

    by Rachel N. Denison, Karen J. Tian, David J. Heeger, Marisa Carrasco

    We can often anticipate the precise moment when a stimulus will be relevant for our behavioral goals. Voluntary temporal attention, the prioritization of sensory information at task-relevant time points, enhances visual perception. However, the neural mechanisms of voluntary temporal attention have not been isolated from those of temporal expectation, which reflects timing predictability rather than relevance. Here we use time-resolved steady-state visual evoked responses (SSVER) to investigate how temporal attention dynamically modulates visual activity when temporal expectation is controlled. We recorded magnetoencephalography while participants directed temporal attention to one of two sequential grating targets with predictable timing. Meanwhile, a co-localized SSVER probe continuously tracked visual cortical modulations both before and after the target stimuli. We find that in the pre-target period, the SSVER gradually ramps up as the targets approach, reflecting temporal expectation. Furthermore, we find a low-frequency modulation of the SSVER, which shifts approximately half a cycle in phase according to which target is attended. In the post-target period, temporal attention to the first target transiently modulates the SSVER shortly after target onset. Thus, temporal attention dynamically modulates visual cortical responses via both periodic pre-target and transient post-target mechanisms to prioritize sensory information at precise moments.


  • Open Access

    Traveling Waves in the Human Visual Cortex: an MEG-EEG Model-Based Approach

    by Laetitia Grabot, Garance Merholz, Jonathan Winawer, David J. Heeger, Laura Dugué

    Brain oscillations might be traveling waves propagating in cortex. Studying their propagation within single cortical areas has mostly been restricted to invasive measurements. Their investigation in healthy humans, however, requires non-invasive recordings, such as MEG or EEG. Identifying traveling waves with these techniques is challenging because source summation, volume conduction, and low signal-to-noise ratios make it difficult to localize cortical activity from sensor responses. The difficulty is compounded by the lack of a known ground truth in traveling wave experiments. Rather than source-localizing cortical responses from sensor activity, we developed a two-part model-based neuroimaging approach: (1) The putative neural sources of a propagating oscillation were modeled within primary visual cortex (V1) via retinotopic mapping from functional MRI recordings (encoding model); and (2) the modeled sources were projected onto MEG and EEG sensors to predict the resulting signal using a biophysical head model. We tested our model by comparing its predictions against the MEG-EEG signal obtained when participants viewed visual stimuli designed to elicit either fovea-to-periphery or periphery-to-fovea traveling waves or standing waves in V1, in which ground truth cortical waves could be reasonably assumed. Correlations on within-sensor phase and amplitude relations between predicted and measured data revealed good model performance. Crucially, the model predicted sensor data more accurately when the input to the model was a traveling wave going in the stimulus direction compared to when the input was a standing wave, or a traveling wave in a different direction. Furthermore, model accuracy peaked at the spatial and temporal frequency parameters of the visual stimulation. Together, our model successfully recovers traveling wave properties in cortex when they are induced by traveling waves in stimuli. This provides a sound basis for using MEG-EEG to study endogenous traveling waves in cortex and test hypothesis related with their role in cognition. Author Summary Brain oscillations, thought to be crucial for many cognitive processes, might actually be waves that travel across the brain’s surface. Understanding these traveling waves is notoriously difficult because current non-invasive methods like magneto- and electro-encephalography (MEG-EEG) face significant technical limitations. To address this challenge, we developed a new approach that combines brain imaging techniques and computational modeling. We focused on the primary visual cortical area (V1) of the brain and created a model that simulates traveling activity across the cortex and predicts how these traveling waves should appear in EEG and MEG recordings. We tested our model by comparing its predictions with brain data collected when participants view visual patterns specifically designed to induce traveling waves in the visual system. The results show that our model accurately captures the direction and pattern of the traveling waves, as well as the specific parameters of the visual stimuli. This novel modeling tool offers a promising method for studying endogenous traveling waves and will enable neuroscientists to explore hypotheses about the spatiotemporal organization of brain activity and its role in cognition.


  • Arterial Oxygen Desaturation Hinders Gamified Working Memory Performance

    by Jason M Keeler, Jennifer B Listman, M Jo Hite, David J Heeger, Erica Tourula, Nicholas L Port, Zachary J Schlader

    Hypoxia presents a physiological challenge to the Warfighters during military aviation and subterranean warfare operations by decreasing the supply of oxygen to the brain, which results in a reduced cognitive function depending on the magnitude and duration of hypoxic exposure. Moderate hypoxic exposures, fractions of inspired oxygen (FiO2) of 0.11 to 0.14, show no effects on simple tasks, but complex tasks like working memory may be hindered. Unfortunately, people often cannot recognize their own symptoms of hypoxemia, which are individualistic at moderate hypoxic exposure. Thus, screening tools, like gamified cognitive assessments, during moderate hypoxia may provide personnel objective feedback to initiate safety protocols before a possible accident. However, whether gamified assessments of working memory are sensitive to moderate hypoxia is unknown. Therefore, we tested the hypothesis which moderate normobaric hypoxia decreases gamified working memory performance when accounting for the individualistic responses of arterial blood oxygen saturations. Following 3 consecutive days of 2 practice sessions per day, 30 healthy adults (25 ± 5 years, 10 women) completed three 1-min rounds of the tablet-based working memory game (Backtracker, Statespace Labs, Inc.) at baseline and 60 and 90 min after exposure to FiO2 (= 0.138 ± 0.002 [hypoxia] and 0.201± 0.004 [normoxia] oxygen). Both conditions were completed on the same day and administered in a single-blind, block randomized manner. Arterial oxyhemoglobin saturation was estimated via forehead pulse oximetry (SpO2). Data were analyzed using linear mixed effects modeling. Compared to normoxia (99 ± 1%), SpO2 was lower (P < .001) at 60 (90 ± 2%) and 90 (90 ± 2%) min of hypoxia. A decrease in SpO2 was associated with a statistically significant decrease in the proportion of both tiles with the correct location (P < .02; −0.016) and correct order of appearance recalled (P < .01; −0.016). A decrease in SpO2 was associated with a statistically significant decrease in median time to first tap (P < .01; −0.041 s) and median time between taps (P < .01; −0.030 s). A significant interaction effect between the SpO2 decrease and baseline performance was found for proportion of tiles with the correct location recalled (P < .05; −0.014), median time to first tap (P < .01; −0.070 s), and median time between taps (P < .01; −0.037 s). A significant interaction effect between the SpO2 decrease and the path length was found for the proportion of tiles with the correct location recalled (P < .01; +0.021), median time to first tap (P < .01; −0.036 s), and median time between taps (P < .01; −0.043 s). These findings indicate that greater decreases in SpO2 during moderate hypoxic exposure hinder performance on a gamified assessment of working memory as measured by the proportion of correctly identified order and location of tiles. Considering the statistically significant decrease in both median time to first tap and median time between taps associated with the decrease in SpO2, participants are taking less time to plan or execute movements, which may compound or independently contribute to spatial and temporal memory mistakes.


  • Open Access

    Adaptive coding efficiency in recurrent cortical circuits via gain control

    by Lyndon R. Duong, Colin Bredenberg, David J. Heeger, Eero P. Simoncelli

    Sensory systems across all modalities and species exhibit adaptation to continuously changing input statistics. Individual neurons have been shown to modulate their response gains so as to maximize information transmission in different stimulus contexts. Experimental measurements have revealed additional, nuanced sensory adaptation effects including changes in response maxima and minima, tuning curve repulsion from the adapter stimulus, and stimulus-driven response decorrelation. Existing explanations of these phenomena rely on changes in inter-neuronal synaptic efficacy, which, while more flexible, are unlikely to operate as rapidly or reversibly as single neuron gain modulations. Using published V1 population adaptation data, we show that propagation of single neuron gain changes in a recurrent network is sufficient to capture the entire set of observed adaptation effects. We propose a novel adaptive efficient coding objective with which single neuron gains are modulated, maximizing the fidelity of the stimulus representation while minimizing overall activity in the network. From this objective, we analytically derive a set of gains that optimize the trade-off between preserving information about the stimulus and conserving metabolic resources. Our model generalizes well-established concepts of single neuron adaptive gain control to recurrent populations, and parsimoniously explains experimental adaptation data.