The viability of analog-based accelerators for neuromorphic computing: a survey
Open Access
- 15 July 2021
- journal article
- review article
- Published by IOP Publishing in Neuromorphic Computing and Engineering
- Vol. 1 (1) , 012001
Abstract
Focus in deep neural network hardware research for reducing latencies of memory fetches has steered in the direction of analog-based artificial neural networks (ANN). The promise of decreased latencies, increased computational parallelism, and higher storage densities with crossbar non-volatile memory (NVM) based in-memory-computing/processing-in-memory techniques is not without its caveats. This paper surveys this rich landscape and highlights the advantages and challenges of emerging NVMs as multi-level synaptic emulators in various neural network types and applications. Current and potential methods for reliably programming these devices in a crossbar matrix are discussed, as well as techniques for reliably integrating and propagating matrix products to emulate the well-known MAC-like operations throughout the neural network. This paper complements previous surveys, but most importantly uncovers further areas of ongoing research relating to the viability of analog-based ANN implementations based on state-of-the-art NVM technologies in the context of hardware accelerators. While many previous reviews of analog-based ANN focus on device characteristics, this review presents the perspective of crossbar arrays, peripheral circuitry and the required architectural and system considerations for an emerging memory crossbar neural network.Keywords
This publication has 74 references indexed in Scilit:
- Deep learning in neural networks: An overviewNeural Networks, 2015
- A million spiking-neuron integrated circuit with a scalable communication network and interfaceScience, 2014
- Nanoscale electronic synapses using phase change devicesACM Journal on Emerging Technologies in Computing Systems, 2013
- Interference and memory capacity effects in memristive systemsApplied Physics Letters, 2013
- Short-Term Memory to Long-Term Memory Transition in a Nanoscale MemristorACS Nano, 2011
- On Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a Self-Learning Visual CortexFrontiers in Neuroscience, 2011
- A six-port 30-GB/s nonblocking router component using point-to-point simultaneous bidirectional signaling for high-bandwidth interconnectsIEEE Journal of Solid-State Circuits, 2001
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- An analog neural network processor with programmable topologyIEEE Journal of Solid-State Circuits, 1991
- Speech database development at MIT: Timit and beyondSpeech Communication, 1990