Heterogeneous Manycore Architectures Enabled by Processing-in-Memory for Deep Learning: From CNNs to GNNs: (ICCAD Special Session Paper)
Authors:
- 1 November 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
Resistive random-access memory (ReRAM)-based processing-in-memory (PIM) architectures have recently become a popular architectural choice for deep-learning applications. ReRAM-based architectures can accelerate inferencing and training of deep learning algorithms and are more energy efficient compared to traditional GPUs. However, these architectures have various limitations that affect the model accuracy and performance. Moreover, the choice of the deep-learning application also imposes new design challenges that must be addressed to achieve high performance. In this paper, we present the advantages and challenges associated with ReRAM-based PIM architectures by considering Convolutional Neural Networks (CNNs) and Graph Neural Networks (GNNs) as important application domains. We also outline methods that can be used to address these challenges.Keywords
This publication has 26 references indexed in Scilit:
- ReGAN: A pipelined ReRAM-based accelerator for generative adversarial networks2018
- In-memory Data Flow Processor2017
- Device Instability of ReRAM and a Novel Reference Cell Design for Wide Temperature Range OperationIEEE Electron Device Letters, 2017
- On-chip training of recurrent neural networks with limited numerical precision2017
- PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning2017
- ISAACACM SIGARCH Computer Architecture News, 2016
- Dot-product engine for neuromorphic computing2016
- Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification2015
- Overcoming the challenges of crossbar resistive memory architectures2015
- Writing to and reading from a nano-scale crossbar memory based on memristorsNanotechnology, 2009