How deep is the brain? The shallow brain hypothesis
Top Cited Papers
- 27 October 2023
- journal article
- review article
- Published by Springer Nature in Nature Reviews Neuroscience
- Vol. 24 (12) , 778-791
Abstract
Deep learning and predictive coding architectures commonly assume that inference in neural networks is hierarchical. However, largely neglected in deep learning and predictive coding architectures is the neurobiological evidence that all hierarchical cortical areas, higher or lower, project to and receive signals directly from subcortical areas. Given these neuroanatomical facts, today’s dominance of cortico-centric, hierarchical architectures in deep learning and predictive coding networks is highly questionable; such architectures are likely to be missing essential computational principles the brain uses. In this Perspective, we present the shallow brain hypothesis: hierarchical cortical processing is integrated with a massively parallel process to which subcortical areas substantially contribute. This shallow architecture exploits the computational capacity of cortical microcircuits and thalamo-cortical loops that are not included in typical hierarchical deep learning and predictive coding networks. We argue that the shallow brain architecture provides several critical benefits over deep hierarchical structures and a more complete depiction of how mammalian brains achieve fast and flexible computational capabilities.Keywords
This publication has 214 references indexed in Scilit:
- Serotonin and Prefrontal Cortex Function: Neurons, Networks, and CircuitsMolecular Neurobiology, 2011
- Cortical state and attentionNature Reviews Neuroscience, 2011
- Effects and Mechanisms of Wakefulness on Local Cortical NetworksNeuron, 2011
- Recovering sound sources from embedded repetitionProceedings of the National Academy of Sciences, 2011
- Intention and attention: different functional roles for LIPd and LIPvNature Neuroscience, 2010
- Attention improves performance primarily by reducing interneuronal correlationsNature Neuroscience, 2009
- Exploring the pulvinar path to visual cortex2008
- Prefrontal Acetylcholine Release Controls Cue Detection on Multiple TimescalesNeuron, 2007
- Layer‐ and cell‐type‐specific suprathreshold stimulus representation in rat primary somatosensory cortexThe Journal of Physiology, 2007
- Hierarchical Bayesian inference in the visual cortexJournal of the Optical Society of America A, 2003