Computational Failure Analysis of In-Memory RRAM Architecture for Pattern Classification CNN Circuits
Open Access
- 16 December 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 168093-168106
Abstract
Power-efficient data processing subsystems performing millions of complex concurrent arithmetic operations per second form part of today’s essential solution required to meet the growing demand of edge computing applications, given the volume of data collected by real-time Internet-Of-Things (IoT) sensors. Adding to it, the in-memory computation designed as memory and processing elements on a single wafer has enabled promising performance improvement in terms of computational power savings by avoiding the memory wall created while accessing the memory array. The Resistive RAM (RRAM), with its simple metal-insulator-metal (MIM) structure, proves to be a very appealing candidate for in-memory computation given its ultralow switching power and its Complementary Metal Oxide Semiconductor (CMOS) process fabrication compatibility. However, despite all advantages, the resistive switching phenomenon in RRAM has an inherent stochastic variability. On the algorithmic side, convolution neural networks (CNN) have gained popularity in image classification applications, and the network’s architecture is memory-intense in nature for memorizing the trained weights. Hence, an RRAM-based CNN system will pave way for a power-efficient image classification system on the edge. Accounting however for the inherent variability in RRAM (inter-device and intra-device), the accuracy of CNN’s prediction is surely expected to drop. This motivates us to quantify the impact of RRAM variability on the CNN trained weights and classification accuracy (prediction loss). In this study, we have constructed a Look-Up-Table (LUT) based model for encoding wide current compliance (2μA to 250μA) 65nm CMOS 1T1R OxRAM’s (TiN/HfO2/Hf/TiN) resistive variability into CNN’s trained weight in a digital regime. The RRAM resistance encoded trained weights are in turn used here to simulate the two extreme CNN architectures, namely, Fully Serial System (FSS) and Fully Parallel System (FPS). The architectures’ prediction variability trends are quantified given its current compliance, RRAM resistive variability, CNN’s convolution matrix sizes (5×5, 3×3, 1×1, and 1×1 max pool), the total number of layers in the CNN as well as the input image pixel size.Keywords
Funding Information
- Agency for Science, Technology and Research (A*STAR) Brain Efficient Nanomechanical Artificial Intelligence Computing (BRENAIC) Programmatic Research (A18A5b0056)
This publication has 35 references indexed in Scilit:
- Edge Cloud Offloading AlgorithmsACM Computing Surveys, 2019
- Embedded Deep Learning2019
- CONV-SRAM: An Energy-Efficient SRAM With In-Memory Dot-Product Computation for Low-Power Convolutional Neural NetworksIEEE Journal of Solid-State Circuits, 2018
- SPARE: Spiking Neural Network Acceleration Using ROM-Embedded RAMs as In-Memory-Computation PrimitivesIEEE Transactions on Computers, 2018
- Overview of Current Compliance Effect on Reliability of Nano Scaled Metal Oxide Resistive Random Access Memory Device2018
- Oxide-based RRAM materials for neuromorphic computingJournal of Materials Science, 2018
- Neural Networks and Deep Learning2018
- RRAM variability and its mitigation schemes2017
- Going deeper with convolutions2015
- Metal–Oxide RRAMProceedings of the IEEE, 2012