Cortical Columns Computing Systems: Microarchitecture Model, Functional Building Blocks, and Design Tools
Authors:
- John Paul ShenJSJohn Paul Shen
- Harideep NairHNHarideep Nair
Open Access
- 15 November 2023
- book chapter
- Published by IntechOpen
Abstract
Reverse-engineering the human brain has been a grand challenge for researchers in machine learning, experimental neuroscience, and computer architecture. Current deep neural networks (DNNs), motivated by the same challenge, have achieved remarkable results in Machine Learning applications. However, despite their original inspiration from the brain, DNNs have largely moved away from biological plausibility, resorting to intensive statistical processing on huge amounts of data. This has led to exponentially increasing demand on hardware compute resources that is quickly becoming economically and technologically unsustainable. Recent neuroscience research has led to a new theory on human intelligence, that suggests Cortical Columns (CCs) as the fundamental processing units in the neocortex that encapsulate intelligence. Each CC has the potential to learn models of complete objects through continuous predict-sense-update loops. This leads to the overarching question: Can we build Cortical Columns Computing Systems (C3S) that possess brain-like capabilities as well as brain-like efficiency? This chapter presents ongoing research in the Neuromorphic Computer Architecture Lab (NCAL) at Carnegie Mellon University (CMU) focusing on addressing this question. Our initial findings indicate that designing truly intelligent and extremely energy-efficient C3S-based sensory processing units, using off-the-shelf digital CMOS technology and tools, is quite feasible and very promising, and certainly warrants further research exploration.Keywords
This publication has 43 references indexed in Scilit:
- Space-Time Computing with Temporal Neural NetworksSynthesis Lectures on Computer Architecture, 2017
- Cambricon-X: An accelerator for sparse neural networks2016
- Deep learningNature, 2015
- A million spiking-neuron integrated circuit with a scalable communication network and interfaceScience, 2014
- Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural SimulationsProceedings of the IEEE, 2014
- Wafer-scale integration of analog neural networks2008
- Neuromorphic Analogue VLSIAnnual Review of Neuroscience, 1995
- Intelligence without representationArtificial Intelligence, 1991
- Neuromorphic electronic systemsProceedings of the IEEE, 1990
- The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review, 1958