Mask Technique for Fast and Efficient Training of Binary Resistive Crossbar Arrays
- 15 July 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Nanotechnology
- Vol. 18 (1536125X) , 704-716
Abstract
Resistive crossbar arrays, despite their advantages such as parallel processing, low power, and high density, suffer from the sneak path problem created by IR voltage drops. The crossbar non-idealities considerably degrade the accuracy of matrix multiplication operation, which is the cornerstone of hardware accelerated neural networks. In this paper, we propose a novel technique to capture the sneak path problem to enable off-chip learning and weight transfer. The proposed technique can be easily integrated into any neural network training framework. Performance results show a significant improvement after retraining the network with the proposed mask technique. Two mask solutions have been proposed and studied to capture the sneak path problem in resistive crossbar arrays. Both mask solutions were successfully able to achieve classification accuracy close to the baseline accuracy. The tradeoffs between the two solutions are discussed and compared in terms of accuracy, power, and area.Keywords
Funding Information
- National Science Foundation (1710746)
- National Research Foundation of Korea
- Ministry of Science, ICT and Future Planning (2016M3A7B4909668)
- Basic Science Research Program through NRF
- Ministry of Education (NRF-2017R1D1A1B03033591)
- Free Innovative Research Fund (1.170067.01)
This publication has 25 references indexed in Scilit:
- Modeling and Analysis of Passive Switching Crossbar ArraysIEEE Transactions on Circuits and Systems I: Regular Papers, 2017
- An Energy-Efficient Digital ReRAM-Crossbar-Based CNN With Bitwise ParallelismIEEE Journal on Exploratory Solid-State Computational Devices and Circuits, 2017
- Binary convolutional neural network on RRAM2017
- Binary neural network with 16 Mb RRAM macro chip for classification and online training2016
- ISAACACM SIGARCH Computer Architecture News, 2016
- EyerissACM SIGARCH Computer Architecture News, 2016
- Voltage divider effect for the improvement of variability and endurance of TaOx memristorScientific Reports, 2016
- SneakPath compensation circuit for programming and read operations in RRAM-based CrossPoint architectures2015
- Training and operation of an integrated neuromorphic network based on metal-oxide memristorsNature, 2015
- Size-Dependent Resistivity in Nanoscale InterconnectsAnnual Review of Materials Research, 2009