Network model with internal complexity bridges artificial intelligence and neuroscience
- 16 August 2024
- journal article
- research article
- Published by Springer Nature in Nature Computational Science
- Vol. 4 (8) , 584-599
Abstract
Artificial intelligence (AI) researchers currently believe that the main approach to building more general model problems is the big AI model, where existing neural networks are becoming deeper, larger and wider. We term this the big model with external complexity approach. In this work we argue that there is another approach called small model with internal complexity, which can be used to find a suitable path of incorporating rich properties into neurons to construct larger and more efficient AI models. We uncover that one has to increase the scale of the network externally to stimulate the same dynamical properties. To illustrate this, we build a Hodgkin–Huxley (HH) network with rich internal complexity, where each neuron is an HH model, and prove that the dynamical properties and performance of the HH network can be equivalent to a bigger leaky integrate-and-fire (LIF) network, where each neuron is a LIF neuron with simple internal complexity.Keywords
This publication has 39 references indexed in Scilit:
- Deep learning in spiking neural networksNeural Networks, 2019
- Evolution of the neocortex: a perspective from developmental biologyNature Reviews Neuroscience, 2009
- The Blue Brain ProjectNature Reviews Neuroscience, 2006
- Functional brain development in humansNature Reviews Neuroscience, 2001
- Do neurons have a voltage or a current threshold for action potential initiation?Journal of Computational Neuroscience, 1995
- Optimization of space structures by neural dynamicsNeural Networks, 1995
- On the computational complexity of ordinary differential equationsInformation and Control, 1983
- Excitatory and Inhibitory Interactions in Localized Populations of Model NeuronsBiophysical Journal, 1972
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958
- Mathematical models of threshold phenomena in the nerve membraneBulletin of Mathematical Biology, 1955