Dynamic Network Plasticity and Sample Efficiency in Biological Neural Cultures: A Comparative Study with Deep Reinforcement Learning
Open Access
- 1 January 2025
- journal article
- Published by American Association for the Advancement of Science (AAAS) in Cyborg and Bionic Systems
- Vol. 6, 0336
Abstract
In this study, we investigate the complex network dynamics of in vitro neural systems using DishBrain, which integrates live neural cultures with high-density multi-electrode arrays in real-time, closed-loop game environments. By embedding spiking activity into lower-dimensional spaces, we distinguish between spontaneous activity (Rest) and Gameplay conditions, revealing underlying patterns crucial for real-time monitoring and manipulation. Our analysis highlights dynamic changes in connectivity during Gameplay, underscoring the highly sample efficient plasticity of these networks in response to stimuli. To explore whether this was meaningful in a broader context, we compared the learning efficiency of these biological systems with state-of-the-art deep reinforcement learning (RL) algorithms (Deep Q Network, Advantage Actor-Critic, and Proximal Policy Optimization) in a simplified Pong simulation. Through this, we introduce a meaningful comparison between biological neural systems and deep RL. We find that when samples are limited to a real-world time course, even these very simple biological cultures outperformed deep RL algorithms across various game performance characteristics, implying a higher sample efficiency.Keywords
This publication has 91 references indexed in Scilit:
- A theory of cortical responsesPhilosophical Transactions of the Royal Society B: Biological Sciences, 2005
- Toward the Neurocomputer: Image Processing and Pattern Recognition With Neuronal CulturesIEEE Transactions on Biomedical Engineering, 2005
- Sparse coding of sensory inputsCurrent Opinion in Neurobiology, 2004
- Learning in Networks of Cortical NeuronsThe Journal of Neuroscience, 2001
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effectsNature Neuroscience, 1999
- Strengthening of synchronized activity by tetanic stimulation in cortical cultures: application of planar electrode arraysIEEE Transactions on Biomedical Engineering, 1998
- Distributed Hierarchical Processing in the Primate Cerebral CortexCerebral Cortex, 1991
- Neural networks and physical systems with emergent collective computational abilities.Proceedings of the National Academy of Sciences of the United States of America, 1982
- DYNAMIC PROGRAMMING AND STATISTICAL COMMUNICATION THEORYProceedings of the National Academy of Sciences of the United States of America, 1957