Shaping Embodied Neural Networks for Adaptive Goal-directed Behavior
Authors:
Open Access
- 28 March 2008
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 4 (3) , e1000042
Abstract
The acts of learning and memory are thought to emerge from the modifications of synaptic connections between neurons, as guided by sensory feedback during behavior. However, much is unknown about how such synaptic processes can sculpt and are sculpted by neuronal population dynamics and an interaction with the environment. Here, we embodied a simulated network, inspired by dissociated cortical neuronal cultures, with an artificial animal (an animat) through a sensory-motor loop consisting of structured stimuli, detailed activity metrics incorporating spatial information, and an adaptive training algorithm that takes advantage of spike timing dependent plasticity. By using our design, we demonstrated that the network was capable of learning associations between multiple sensory inputs and motor outputs, and the animat was able to adapt to a new sensory mapping to restore its goal behavior: move toward and stay within a user-defined area. We further showed that successful learning required proper selections of stimuli to encode sensory inputs and a variety of training stimuli with adaptive selection contingent on the animat's behavior. We also found that an individual network had the flexibility to achieve different multi-task goals, and the same goal behavior could be exhibited with different sets of network synaptic strengths. While lacking the characteristic layered structure of in vivo cortical tissue, the biologically inspired simulated networks could tune their activity in behaviorally relevant manners, demonstrating that leaky integrate-and-fire neural networks have an innate ability to process information. This closed-loop hybrid system is a useful tool to study the network properties intermediating synaptic plasticity and behavioral adaptation. The training algorithm provides a stepping stone towards designing future control systems, whether with artificial neural networks or biological animats themselves. The ability of a brain to learn has been studied at various levels. However, a large gap exists between behavioral studies of learning and memory and studies of cellular plasticity. In particular, much remains unknown about how cellular plasticity scales to affect network population dynamics. In previous studies, we have addressed this by growing mammalian brain cells in culture and creating a long-term, two-way interface between a cultured network and a robot or an artificial animal. Behavior and learning could now be observed in concert with the detailed and long-term electrophysiology. In this work, we used modeling/simulation of living cortical cultures to investigate the network's capability to learn goal-directed behavior. A biologically inspired simulated network was used to determine an effective closed-loop training algorithm, and the system successfully exhibited multi-task goal-directed adaptive behavior. The results suggest that even though lacking the characteristic layered structure of a brain, the network still could be functionally shaped and showed meaningful behavior. Knowledge gained from working with such closed-loop systems could influence the design of future artificial neural networks, more effective neuroprosthetics, and even the use of living networks themselves as a biologically based control system.Keywords
This publication has 35 references indexed in Scilit:
- Precisely timed spatiotemporal patterns of neural activity in dissociated cortical culturesNeuroscience, 2007
- Region-specific network plasticity in simulated and living cortical networks: comparison of the center of activity trajectory (CAT) with other statisticsJournal of Neural Engineering, 2007
- Computational analysisin vitro: dynamics and plasticity of a neuro-robotic systemJournal of Neural Engineering, 2005
- Coding and decoding of information in a bi-directional neural interfaceNeurocomputing, 2005
- Toward the Neurocomputer: Image Processing and Pattern Recognition With Neuronal CulturesIEEE Transactions on Biomedical Engineering, 2005
- Controlling Bursting in Cortical Cultures with Closed-Loop Multi-Electrode StimulationThe Journal of Neuroscience, 2005
- Towards an embodied in vitro electrophysiology: the NeuroBIT projectNeurocomputing, 2004
- Morphological characterization ofin vitroneuronal networksPhysical Review E, 2002
- Origins of Activity Patterns in Self-Organizing Neuronal Networks in Vitro.Journal of Intelligent Material Systems and Structures, 1999
- Mutual information functions versus correlation functionsJournal of Statistical Physics, 1990