Energy Scaling Advantages of Resistive Memory Crossbar Based Computation and Its Application to Sparse Coding
Open Access
- 6 January 2016
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Neuroscience
- Vol. 9, 484
Abstract
The exponential increase in data over the last decade presents a significant challenge to analytics efforts that seek to process and interpret such data for various applications. Neural-inspired computing approaches are being developed in order to leverage the computational advantages of the analog, low-power data processing observed in biological systems. Analog resistive memory crossbars can perform a parallel read or a vector-matrix multiplication as well as a parallel write or a rank-1 update with high computational efficiency. For an NxN crossbar, these two kernels are at a minimum O(N) more energy efficient than a digital memory-based architecture. If the read operation is noise limited, the energy to read a column can be independent of the crossbar size (O(1)). These two kernels form the basis of many neuromorphic algorithms such as image, text, and speech recognition. For instance, these kernels can be applied to a neural sparse coding algorithm to give an O(N) reduction in energy for the entire algorithm. Sparse coding is a rich problem with a host of applications including computer vision, object tracking, and more generally unsupervised learning.Keywords
Funding Information
- Sandia National Laboratories (DE-AC04-94AL85000)
This publication has 29 references indexed in Scilit:
- A Functional Hybrid Memristor Crossbar-Array/CMOS System for Data Storage and Neuromorphic ApplicationsNano Letters, 2011
- Nanoscale Memristor Device as Synapse in Neuromorphic SystemsNano Letters, 2010
- High-Density Crossbar Arrays Based on a Si Memristive SystemNano Letters, 2009
- The missing memristor foundNature, 2008
- Nanoionics-based resistive switching memoriesNature Materials, 2007
- Efficient supervised learning in networks with binary synapsesProceedings of the National Academy of Sciences, 2007
- Sparse coding with an overcomplete basis set: A strategy employed by V1?Vision Research, 1997
- Emergence of simple-cell receptive field properties by learning a sparse code for natural imagesNature, 1996
- Processing in memory: the Terasys massively parallel PIM arrayComputer, 1995
- Density of neurons and synapses in the cerebral cortex of the mouseJournal of Comparative Neurology, 1989