ZARA
Authors:
Open Access
- 2 June 2019
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Abstract
Generative Adversarial Networks (GANs) recently demonstrated a great opportunity toward unsupervised learning with the intention to mitigate the massive human efforts on data labeling in supervised learning algorithms. GAN combines a generative model and a discriminative model to oppose each other in an adversarial situation to refine their abilities. Existing nonvolatile memory based machine learning accelerators, however, could not support the computational needs required by GAN training. Specifically, the generator utilizes a new operator, called transposed convolution, which introduces significant resource underutilization when executed on conventional neural network accelerators as it inserts massive zeros in its input before a convolution operation. In this work, we propose a novel computational deformation technique that synergistically optimizes the forward and backward functions in transposed convolution to eliminate the large resource underutilization. In addition, we present dedicated control units - a dataflow mapper and an operation scheduler, to support the proposed execution model with high parallelism and low energy consumption. ZARA is implemented with commodity ReRAM chips, and experimental results show that our design can improve GAN's training performance by averagely 1.6× ~23× over CMOS-based GAN accelerators. Compared to state-of-the-art ReRAM-based accelerator designs, ZARA also provides 1.15 × ~2.1× performance improvement.Keywords
Funding Information
- National Science Foundation (1725456, 1744082)
- U.S. Department of Energy (DE-SC0017030)
This publication has 17 references indexed in Scilit:
- Speeding up crossbar resistive memory by exploiting in-memory data patterns2017
- PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning2017
- ISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars2016
- 14.5 Eyeriss: An energy-efficient reconfigurable accelerator for deep convolutional neural networks2016
- Fully convolutional networks for semantic segmentation2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research GroupsIEEE Signal Processing Magazine, 2012
- NVSim: A Circuit-Level Performance, Energy, and Area Model for Emerging Nonvolatile MemoryIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2012
- A unified architecture for natural language processing2008
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998