Enhance the Robustness to Time Dependent Variability of ReRAM-Based Neuromorphic Computing Systems with Regularization and 2R Synapse
Authors:
- 1 May 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21581525,p. 1-5
Abstract
Time Dependent Variability (TDV) is one of the major concerns in implementing a Neuromorphic Computing System (NCS) with Resistive Random Access Memory (ReRAM). In this work, we propose a variation-distribution aware training algorithm to enhance the robustness of NCS to TDV without incurring extra hardware overhead by leveraging algorithm-level regularization and hardware-level 2R synapse structure. Simulation results on image recognition tasks show that our method improves the system accuracy by up to ~4% and ~10% under the worst-case TDV condition for MNIST and CIFAR-10, respectively. Detailed analysis also shows that our method allows the NCS to use synapses with higher resistance than conventional design for the same accuracy requirement, introducing potential energy saving.Keywords
This publication has 9 references indexed in Scilit:
- A Quantized Training Method to Enhance Accuracy of ReRAM-based Neuromorphic Systems2018
- Challenges and opportunities toward online training acceleration using RRAM-based hardware neural network2017
- Random sparse adaptation for accurate inference with inaccurate multi-level RRAM arrays2017
- Time-dependent variability in RRAM-based analog neuromorphic system for pattern recognition2017
- A quantization-aware regularized learning method in multilevel memristor-based neuromorphic computing system2017
- ISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars2016
- PRIME: A Novel Processing-in-Memory Architecture for Neural Network Computation in ReRAM-Based Main Memory2016
- A low power selector-less crossbar array with complementary resistive-switching memory2016
- Improved Synaptic Behavior Under Identical Pulses Using AlOx/HfO2Bilayer RRAM Array for Neuromorphic SystemsIEEE Electron Device Letters, 2016