Jesse Alexander Livezey
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Jesse Alexander Livezey has a total of 203 co-authors. Here are the top co-authors by number of shared publications:
- Kristofer E. Bouchard
Redwood Center for Theoretical Neuroscience, UC Berkeley, 110 Sproul Hall, Berkeley, CA, 94720, USA.
8 shared publications - Pratik Singh Sachdeva
D-Lab, University of California, Berkeley, Berkeley, California, USA
5 shared publications - Edward F. Chang
Department of Neurological Surgery, University of California, San Francisco, San Francisco, CA, USA
3 shared publications - Maximilian E. Dougherty
Department of Neurology, University of California
3 shared publications - Michael Robert DeWeese
University of California, Berkeley
3 shared publications - Ahyeon Hwang
Department of Computer Science, University of California Irvine, Irvine, California 92697, USA
2 shared publications
Latest Publications
- Open Access
Closed-loop optimization of a high-dimensional generative latent space for rhythmic visual response
Neural oscillations accompany a wide range of cognitive states and behaviors including perception, memory, and movement, and modulating them is of growing interest for both basic neuroscience and clinical research. Previous demonstrations of closed-loop modulation of visual neural responses mainly relied on invasive recordings and focused on firing-rate maximization rather than rhythmic modulation. Here, we show that the relative power of steady-state visual evoked response (SSVEP), measured with readily-available, non-invasive electroencephalography, can be modulated in closed-loop as a function of image stimulus parameters for single participants within a single session. Stimulus optimization with flicker frequencies in the alpha and theta bands was successful in 10, 20, and 40 dimensional latent spaces. We also show that optimized stimuli generalize to new participants when shown in open-loop. Finally, we characterize the visual features that modulate relative SSVEP power and find that low-frequency spatial power in the image drives theta and alpha in opposite directions. Together, our results show that closed-loop stimulus optimization is a viable method for rhythmic neural modulation using noninvasive neuroimaging methods.
Open AccessClosed-loop optimization of a high-dimensional generative latent space for rhythmic visual response
Neural oscillations accompany a wide range of cognitive states and behaviors including perception, memory, and movement, and modulating them is of growing interest for both basic neuroscience and clinical research. Previous demonstrations of closed-loop modulation of visual neural responses mainly relied on invasive recordings and focused on firing-rate maximization rather than rhythmic modulation. Here, we show that the relative power of steady-state visual evoked response (SSVEP), measured with readily-available, non-invasive electroencephalography, can be modulated in closed-loop as a function of image stimulus parameters for single participants within a single session. Stimulus optimization with flicker frequencies in the alpha and theta bands was successful in 10, 20, and 40 dimensional latent spaces. We also show that optimized stimuli generalize to new participants when shown in open-loop. Finally, we characterize the visual features that modulate relative SSVEP power and find that low-frequency spatial power in the image drives theta and alpha in opposite directions. Together, our results show that closed-loop stimulus optimization is a viable method for rhythmic neural modulation using noninvasive neuroimaging methods.
- Open Access
Cortical surface electrical potentials are composed of multiple bandlimited frequency components, including high-gamma
A common challenge in neuroscience is how to decompose noisy, multi-source signals measured in experiments into biophysically interpretable components. Analysis of cortical surface electrical potentials (CSEPs) measured using electrocorticography arrays (ECoG) typifies this problem. We hypothesized that high frequency (70-1,000 Hz) CSEPs are composed of broadband (i.e., power-law) and bandlimited components with potentially differing biophysical origins. In particular, the high-gamma band (70-150 Hz) has been shown to be highly predictive for encoding and decoding behaviors and stimuli. Despite its demonstrated importance, whether high-gamma is composed of a bandlimited signal is poorly understood. To address this gap, we recorded CSEPs from rat auditory cortex and demonstrate that the evoked CSEPs are composed of multiple distinct frequency components, including high-gamma. We then show, using a novel robust regression method, that at fast timescales and on single trials during speech production, human high-gamma amplitude cannot be explained by a modulating power-law component; thus, high-gamma is band-limited. Furthermore, we show that the power-law component is less predictive of produced speech compared to the raw high-gamma amplitude. Finally, we show that the largest variance component of human ECoG signals is low-frequency and band-limited, not broadband. Together these results demonstrate that there are multiple, band-limited components of high frequency power in cortical surface electrical potentials, including the high-gamma band, which may have different biophysical origins. Significance Statement: Electrocortigraphy (ECoG) records cortical surface electrical potentials (CSEPs). ECoG is utilized in both humans and animal models to understand distributed cortical processing and for brain machine interfaces. The spectral structure of evoked CSEPs is greatly debated. To address this issue, we recorded from rat auditory cortex using µ ECoG and human ventral sensory-motor cortex during speech production with high-density ECoG. Using novel analytic approaches, we found that evoked CSEPs are composed of multiple band-limited components, including high-gamma. These results contrast with the dominant thinking in the field that the high-frequency power in ECoG is broadband. Our results raise the possibility that distinct frequency components of ECoG are biomarkers of processing in different cortical layers.
Open AccessCortical surface electrical potentials are composed of multiple bandlimited frequency components, including high-gamma
A common challenge in neuroscience is how to decompose noisy, multi-source signals measured in experiments into biophysically interpretable components. Analysis of cortical surface electrical potentials (CSEPs) measured using electrocorticography arrays (ECoG) typifies this problem. We hypothesized that high frequency (70-1,000 Hz) CSEPs are composed of broadband (i.e., power-law) and bandlimited components with potentially differing biophysical origins. In particular, the high-gamma band (70-150 Hz) has been shown to be highly predictive for encoding and decoding behaviors and stimuli. Despite its demonstrated importance, whether high-gamma is composed of a bandlimited signal is poorly understood. To address this gap, we recorded CSEPs from rat auditory cortex and demonstrate that the evoked CSEPs are composed of multiple distinct frequency components, including high-gamma. We then show, using a novel robust regression method, that at fast timescales and on single trials during speech production, human high-gamma amplitude cannot be explained by a modulating power-law component; thus, high-gamma is band-limited. Furthermore, we show that the power-law component is less predictive of produced speech compared to the raw high-gamma amplitude. Finally, we show that the largest variance component of human ECoG signals is low-frequency and band-limited, not broadband. Together these results demonstrate that there are multiple, band-limited components of high frequency power in cortical surface electrical potentials, including the high-gamma band, which may have different biophysical origins. Significance Statement: Electrocortigraphy (ECoG) records cortical surface electrical potentials (CSEPs). ECoG is utilized in both humans and animal models to understand distributed cortical processing and for brain machine interfaces. The spectral structure of evoked CSEPs is greatly debated. To address this issue, we recorded from rat auditory cortex using µ ECoG and human ventral sensory-motor cortex during speech production with high-density ECoG. Using novel analytic approaches, we found that evoked CSEPs are composed of multiple band-limited components, including high-gamma. These results contrast with the dominant thinking in the field that the high-frequency power in ECoG is broadband. Our results raise the possibility that distinct frequency components of ECoG are biomarkers of processing in different cortical layers.
- 15 May 2022
- Published by Springer Nature
- p. 3-14
Hangul Fonts Dataset: A Hierarchical and Compositional Dataset for Investigating Learned Representations
- 15 May 2022
- Published by Springer Nature
- p. 3-14
Hangul Fonts Dataset: A Hierarchical and Compositional Dataset for Investigating Learned Representations
- Open Access
- 31 March 2022
- Published by The Open Journal in Journal of Open Source Education
- Vol. 5 (49) , 118
Neuromatch Academy: a 3-week, online summer school in computational neuroscience
- 31 March 2022
- Published by The Open Journal in Journal of Open Source Education
- Vol. 5 (49) , 118
Open AccessNeuromatch Academy: a 3-week, online summer school in computational neuroscience
- Open Access
Not optimal, just noisy: the geometry of correlated variability leads to highly suboptimal sensory coding
The brain represents the world through the activity of neural populations. Correlated variability across simultaneously recorded neurons (noise correlations) has been observed across cortical areas and experimental paradigms. Many studies have shown that correlated variability improves stimulus coding compared to a null model with no correlations. However, such results do not shed light on whether neural populations’ correlated variability achieves optimal coding. Here, we assess optimality of noise correlations in diverse datasets by developing two novel null models each with a unique biological interpretation: a uniform correlations null model and a factor analysis null model. We show that across datasets, the correlated variability in neural populations leads to highly suboptimal coding performance according to these null models. We demonstrate that biological constraints prevent many subsets of the neural populations from achieving optimality according to these null models, and that subselecting based on biological criteria leaves coding performance suboptimal. Finally, we show that the optimal subpopulation is exponentially small as a function of neural dimensionality. Together, these results show that the geometry of correlated variability leads to highly suboptimal sensory coding.
Open AccessNot optimal, just noisy: the geometry of correlated variability leads to highly suboptimal sensory coding
The brain represents the world through the activity of neural populations. Correlated variability across simultaneously recorded neurons (noise correlations) has been observed across cortical areas and experimental paradigms. Many studies have shown that correlated variability improves stimulus coding compared to a null model with no correlations. However, such results do not shed light on whether neural populations’ correlated variability achieves optimal coding. Here, we assess optimality of noise correlations in diverse datasets by developing two novel null models each with a unique biological interpretation: a uniform correlations null model and a factor analysis null model. We show that across datasets, the correlated variability in neural populations leads to highly suboptimal coding performance according to these null models. We demonstrate that biological constraints prevent many subsets of the neural populations from achieving optimality according to these null models, and that subselecting based on biological criteria leaves coding performance suboptimal. Finally, we show that the optimal subpopulation is exponentially small as a function of neural dimensionality. Together, these results show that the geometry of correlated variability leads to highly suboptimal sensory coding.
- 1 July 2020
- Published by MIT Press in Neural Computation
- Vol. 32 (7) , 1239-1276
Heterogeneous Synaptic Weighting Improves Neural Coding in the Presence of Common Noise
Simultaneous recordings from the cortex have revealed that neural activity is highly variable and that some variability is shared across neurons in a population. Further experimental work has demonstrated that the shared component of a neuronal population's variability is typically comparable to or larger than its private component. Meanwhile, an abundance of theoretical work has assessed the impact that shared variability has on a population code. For example, shared input noise is understood to have a detrimental impact on a neural population's coding fidelity. However, other contributions to variability, such as common noise, can also play a role in shaping correlated variability. We present a network of linear-nonlinear neurons in which we introduce a common noise input to model—for instance, variability resulting from upstream action potentials that are irrelevant to the task at hand. We show that by applying a heterogeneous set of synaptic weights to the neural inputs carrying the common noise, the network can improve its coding ability as measured by both Fisher information and Shannon mutual information, even in cases where this results in amplification of the common noise. With a broad and heterogeneous distribution of synaptic weights, a population of neurons can remove the harmful effects imposed by afferents that are uninformative about a stimulus. We demonstrate that some nonlinear networks benefit from weight diversification up to a certain population size, above which the drawbacks from amplified noise dominate over the benefits of diversification. We further characterize these benefits in terms of the relative strength of shared and private variability sources. Finally, we studied the asymptotic behavior of the mutual information and Fisher information analytically in our various networks as a function of population size. We find some surprising qualitative changes in the asymptotic behavior as we make seemingly minor changes in the synaptic weight distributions.
- 1 July 2020
- Published by MIT Press in Neural Computation
- Vol. 32 (7) , 1239-1276
Heterogeneous Synaptic Weighting Improves Neural Coding in the Presence of Common Noise
Simultaneous recordings from the cortex have revealed that neural activity is highly variable and that some variability is shared across neurons in a population. Further experimental work has demonstrated that the shared component of a neuronal population's variability is typically comparable to or larger than its private component. Meanwhile, an abundance of theoretical work has assessed the impact that shared variability has on a population code. For example, shared input noise is understood to have a detrimental impact on a neural population's coding fidelity. However, other contributions to variability, such as common noise, can also play a role in shaping correlated variability. We present a network of linear-nonlinear neurons in which we introduce a common noise input to model—for instance, variability resulting from upstream action potentials that are irrelevant to the task at hand. We show that by applying a heterogeneous set of synaptic weights to the neural inputs carrying the common noise, the network can improve its coding ability as measured by both Fisher information and Shannon mutual information, even in cases where this results in amplification of the common noise. With a broad and heterogeneous distribution of synaptic weights, a population of neurons can remove the harmful effects imposed by afferents that are uninformative about a stimulus. We demonstrate that some nonlinear networks benefit from weight diversification up to a certain population size, above which the drawbacks from amplified noise dominate over the benefits of diversification. We further characterize these benefits in terms of the relative strength of shared and private variability sources. Finally, we studied the asymptotic behavior of the mutual information and Fisher information analytically in our various networks as a function of population size. We find some surprising qualitative changes in the asymptotic behavior as we make seemingly minor changes in the synaptic weight distributions.
- Open Access
Deep learning approaches for neural decoding: from CNNs to LSTMs and spikes to fMRI
Decoding behavior, perception, or cognitive state directly from neural signals has applications in brain-computer interface research as well as implications for systems neuroscience. In the last decade, deep learning has become the state-of-the-art method in many machine learning tasks ranging from speech recognition to image segmentation. The success of deep networks in other domains has led to a new wave of applications in neuroscience. In this article, we review deep learning approaches to neural decoding. We describe the architectures used for extracting useful features from neural recording modalities ranging from spikes to EEG. Furthermore, we explore how deep learning has been leveraged to predict common outputs including movement, speech, and vision, with a focus on how pretrained deep networks can be incorporated as priors for complex decoding targets like acoustic speech or images. Deep learning has been shown to be a useful tool for improving the accuracy and flexibility of neural decoding across a wide range of tasks, and we point out areas for future scientific development.
Open AccessDeep learning approaches for neural decoding: from CNNs to LSTMs and spikes to fMRI
Decoding behavior, perception, or cognitive state directly from neural signals has applications in brain-computer interface research as well as implications for systems neuroscience. In the last decade, deep learning has become the state-of-the-art method in many machine learning tasks ranging from speech recognition to image segmentation. The success of deep networks in other domains has led to a new wave of applications in neuroscience. In this article, we review deep learning approaches to neural decoding. We describe the architectures used for extracting useful features from neural recording modalities ranging from spikes to EEG. Furthermore, we explore how deep learning has been leveraged to predict common outputs including movement, speech, and vision, with a focus on how pretrained deep networks can be incorporated as priors for complex decoding targets like acoustic speech or images. Deep learning has been shown to be a useful tool for improving the accuracy and flexibility of neural decoding across a wide range of tasks, and we point out areas for future scientific development.
- Open Access
Accurate inference in parametric models reshapes neuroscientific interpretation and improves data-driven discovery
A central goal of systems neuroscience is to understand the relationships amongst constituent units in neural populations and their modulation by external factors using high-dimensional and stochastic neural recordings. Statistical models, particularly parametric models, play an instrumental role in accomplishing this goal, because their fitted parameters can provide insight into the underlying biological processes that generated the data. However, extracting conclusions from a parametric model requires that it is fit using an inference procedure capable of selecting the correct parameters and properly estimating their values. Traditional approaches to parameter inference have been shown to suffer from failures in both selection and estimation. Recent development of algorithms that ameliorate these deficiencies raises the question of whether past work relying on such inference procedures have produced inaccurate systems neuroscience models, thereby impairing their interpretation. Here, we used the Union of Intersections, a statistical inference framework capable of state-of-the-art selection and estimation performance, to fit functional coupling, encoding, and decoding models across a battery of neural datasets. We found that, compared to baseline procedures, UoI inferred models with increased sparsity, improved stability, and qualitatively different parameter distributions, while maintaining predictive performance across recording modality, brain region, and task. Specifically, we obtained highly sparse functional coupling networks with substantially different community structure, more parsimonious encoding models, and decoding models that rely on fewer single-units. Together, these results demonstrate that accurate parameter inference reshapes interpretation in diverse neuroscience contexts. The ubiquity of model-based data-driven discovery in biology suggests that analogous results would be seen in other fields.
Open AccessAccurate inference in parametric models reshapes neuroscientific interpretation and improves data-driven discovery
A central goal of systems neuroscience is to understand the relationships amongst constituent units in neural populations and their modulation by external factors using high-dimensional and stochastic neural recordings. Statistical models, particularly parametric models, play an instrumental role in accomplishing this goal, because their fitted parameters can provide insight into the underlying biological processes that generated the data. However, extracting conclusions from a parametric model requires that it is fit using an inference procedure capable of selecting the correct parameters and properly estimating their values. Traditional approaches to parameter inference have been shown to suffer from failures in both selection and estimation. Recent development of algorithms that ameliorate these deficiencies raises the question of whether past work relying on such inference procedures have produced inaccurate systems neuroscience models, thereby impairing their interpretation. Here, we used the Union of Intersections, a statistical inference framework capable of state-of-the-art selection and estimation performance, to fit functional coupling, encoding, and decoding models across a battery of neural datasets. We found that, compared to baseline procedures, UoI inferred models with increased sparsity, improved stability, and qualitatively different parameter distributions, while maintaining predictive performance across recording modality, brain region, and task. Specifically, we obtained highly sparse functional coupling networks with substantially different community structure, more parsimonious encoding models, and decoding models that rely on fewer single-units. Together, these results demonstrate that accurate parameter inference reshapes interpretation in diverse neuroscience contexts. The ubiquity of model-based data-driven discovery in biology suggests that analogous results would be seen in other fields.
- Open Access
- 6 December 2019
- Published by The Open Journal in Journal of Open Source Software
- Vol. 4 (44) , 1799
PyUoI: The Union of Intersections Framework in Python
- 6 December 2019
- Published by The Open Journal in Journal of Open Source Software
- Vol. 4 (44) , 1799
Open AccessPyUoI: The Union of Intersections Framework in Python
- Open Access
Unsupervised Discovery of Temporal Structure in Noisy Data with Dynamical Components Analysis
Linear dimensionality reduction methods are commonly used to extract low-dimensional structure from high-dimensional data. However, popular methods disregard temporal structure, rendering them prone to extracting noise rather than meaningful dynamics when applied to time series data. At the same time, many successful unsupervised learning methods for temporal, sequential and spatial data extract features which are predictive of their surrounding context. Combining these approaches, we introduce Dynamical Components Analysis (DCA), a linear dimensionality reduction method which discovers a subspace of high-dimensional time series data with maximal predictive information, defined as the mutual information between the past and future. We test DCA on synthetic examples and demonstrate its superior ability to extract dynamical structure compared to commonly used linear methods. We also apply DCA to several real-world datasets, showing that the dimensions extracted by DCA are more useful than those extracted by other methods for predicting future states and decoding auxiliary variables. Overall, DCA robustly extracts dynamical structure in noisy, high-dimensional data while retaining the computational efficiency and geometric interpretability of linear dimensionality reduction methods.
Open AccessUnsupervised Discovery of Temporal Structure in Noisy Data with Dynamical Components Analysis
Linear dimensionality reduction methods are commonly used to extract low-dimensional structure from high-dimensional data. However, popular methods disregard temporal structure, rendering them prone to extracting noise rather than meaningful dynamics when applied to time series data. At the same time, many successful unsupervised learning methods for temporal, sequential and spatial data extract features which are predictive of their surrounding context. Combining these approaches, we introduce Dynamical Components Analysis (DCA), a linear dimensionality reduction method which discovers a subspace of high-dimensional time series data with maximal predictive information, defined as the mutual information between the past and future. We test DCA on synthetic examples and demonstrate its superior ability to extract dynamical structure compared to commonly used linear methods. We also apply DCA to several real-world datasets, showing that the dimensions extracted by DCA are more useful than those extracted by other methods for predicting future states and decoding auxiliary variables. Overall, DCA robustly extracts dynamical structure in noisy, high-dimensional data while retaining the computational efficiency and geometric interpretability of linear dimensionality reduction methods.