Generating whole-brain neural activity and behavior through unified latent dynamics
Preprint
Abstract
Understanding how high-dimensional neural activity and behavior emerge from shared underlying dynamics remains a fundamental challenge in neuroscience. Addressing this problem is key to enabling digital twins that can faithfully reproduce and predict the multiscale brain–behavior dynamics of living systems. Here we present NEBULA (NEural and Behavioral modeling through Unified LAtent dynamics), a generative framework that jointly models whole-brain neural activity and behavior. Using brain-wide recordings from C. elegans , the model learns a unified latent dynamical structure that supports long-horizon generation of neural and behavioral trajectories, realistic simulations of behavior, and targeted virtual interventions. Perturbations of the learned dynamics reveal behaviorally relevant transition points, whereas steering interventions enable controlled manipulation of neural and behavioral states without retraining. These results establish a framework for linking brain dynamics to behavior in a living organism and provide a foundation for scalable virtual experimentation in neuroscience.Keywords
This publication has 42 references indexed in Scilit:
- Linearizing and Forecasting: A Reservoir Computing Route to Digital Twins of the BrainAdvanced Science, 2026
- Joint modelling of brain and behaviour dynamics with artificial intelligenceNature Reviews Neuroscience, 2025
- The Thermodynamics of MindTrends in Cognitive Sciences, 2024
- Personalised virtual brain models in epilepsyThe Lancet Neurology, 2023
- The quest for multiscale brain modelingTrends in Neurosciences, 2022
- Predictive Processing: A Canonical Cortical ComputationNeuron, 2018
- Hierarchical Active Inference: A Theory of Motivated ControlTrends in Cognitive Sciences, 2018
- Global Brain Dynamics Embed the Motor Command Sequence of Caenorhabditis elegansCell, 2015
- Optogenetics: 10 years of microbial opsins in neuroscienceNature Neuroscience, 2015
- The Bayesian brain: the role of uncertainty in neural coding and computationTrends in Neurosciences, 2004