Neural Synaptic Plasticity-Inspired Computing: A High Computing Efficient Deep Convolutional Neural Network Accelerator
- 1 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems I: Regular Papers
- Vol. 68 (2) , 728-740
Abstract
Deep convolutional neural networks DCNNs have achieved state-of-the-art performance in classification, natural language processing NLP, and regression tasks. However, there is still a great gap between DCNNs and the human brain in terms of computation efficiency. Inspired by neural synaptic plasticity and stochastic computing SC, we propose neural synaptic plasticity-inspired computing NSPC to simulate the human brain's neural network activity for inference tasks with simple logic gates. The multiplication and accumulation MAC is transformed by the wire connectivity in NSPC, which only requires bundles of wires and small width adders. To this end, the NSPC imitates the structure of neural synaptic plasticity from a circuit wires connection perspective. Furthermore, from the principle of NSPC, we use a data mapping method to convert the convolution operations to matrix multiplications. Based on the methodology of NSPC, fully-pipelined and low latency architecture is designed. The proposed NSPC accelerator exhibits high hardware efficiency while maintaining a comparable network accuracy level. The NSPC based DCNN accelerator NSPC-CNN processes DCNN at 1.5625M images/s with a power dissipation of 15.42 W and an area of 36.4 mm². The NSPC based deep neural network DNN accelerator NSPC-DNN that implements three fully connected layers DNN consumes only 6.6 mm² area and 2.93 W power, and achieves a throughput of 400M images/s. Compared with conventional fixed-point implementations, the NSPC-CNN achieves 2.77 x area efficiency, 2.25 x power efficiency; the proposed NSPC-DNN exhibits 2.31 x area efficiency and 2.09 x power efficiency.Keywords
Funding Information
- National Key Research and Development Program of China (2020YFB2205503)
This publication has 51 references indexed in Scilit:
- Deep learningNature, 2015
- A million spiking-neuron integrated circuit with a scalable communication network and interfaceScience, 2014
- Two‐Terminal Protonic Devices with Synaptic‐Like Short‐Term Depression and Device MemoryAdvanced Materials, 2014
- Short-term plasticity and long-term potentiation mimicked in single inorganic synapsesNature Materials, 2011
- Artificial neural networks in hardware: A survey of two decades of progressNeurocomputing, 2010
- Synaptic stability and plasticity in a floating worldCurrent Opinion in Neurobiology, 2010
- Nanoscale Memristor Device as Synapse in Neuromorphic SystemsNano Letters, 2010
- Synaptic plasticity, memory and the hippocampus: a neural network approach to causalityNature Reviews Neuroscience, 2008
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Stochastic Computing Systems1969