Memristor-based Deep Spiking Neural Network with a Computing-In-Memory Architecture
Authors:
- 6 April 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
Spiking Neural Networks (SNNs) are artificial neural network models that show significant advantages in terms of power and energy when realizing deep learning applications. However, the data-intensive nature of machine learning applications imposes a challenging problem to neural network implementations in terms of latency, energy efficiency and memory bottleneck. Therefore, we introduce a scalable deep SNN to address the problem of latency and energy efficiency. We integrate a Computing-In-Memory (CIM) architecture built with a fabricated memristor crossbar array to reduce the memory bandwidth in vector-matrix multiplication, a key operation in deep learning. By applying an inter-spike interval (ISI) encoding scheme to the input signals, we demonstrate the spatiotemporal information processing capability of our designed architecture. The memristor crossbar array has an enhanced heat dissipation layer that reduces the resistance variation of the memristors by ~30%. We further develop a time-to-first-spike (TTFS) method to classify the outputs. The designed circuits and architecture can achieve very high accuracies with both digit recognition and the MNIST dataset. Our architecture can classify handwritten digits while consuming merely 2.9mW of power with an inference speed of 2μs/image. Only 2.51pJ of energy per synaptic connection makes it suitable to apply in deep learning accelerators.Keywords
Funding Information
- National Science Foundation
This publication has 26 references indexed in Scilit:
- A survey of deep neural network architectures and their applicationsNeurocomputing, 2017
- Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural NetworksIEEE Journal of Solid-State Circuits, 2016
- Neuromorphic architectures for spiking deep neural networks2015
- Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing2015
- A brain-inspired spiking neural network model with temporal encoding and learningNeurocomputing, 2014
- Minimum Energy of Computing, Fundamental Considerations2014
- SPIKING NEURAL NETWORKSInternational Journal of Neural Systems, 2009
- Temporal precision in the neural code and the timescales of natural visionNature, 2007
- Networks of spiking neurons: The third generation of neural network modelsNeural Networks, 1997
- The impulses produced by sensory nerve endingsThe Journal of Physiology, 1926