LTNN: An energy-efficient machine learning accelerator on 3D CMOS-RRAM for layer-wise tensorized neural network
Authors:
- 1 September 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 280-285
Abstract
An energy efficient machine learning requires an effective construction of neural network during training. This paper introduces a tensorized formulation of neural network during training such that weight matrix can be significantly compressed. The tensorized neural network can be further naturally mapped to a 3D CMOS-RRAM based accelerator with significant bandwidth boosting from vertical I/O connections. As such, high throughput and low power can be achieved simultaneously. Simulation results using the benchmark MNIST show that the proposed accelerator has 1.294x speed-up, 2.393× energy-efficiency and 7.59× area saving compared to 3D CMOS-ASIC implementation. Moreover, our proposed accelerator can achieve 370.64 GOPS throughput and 1055.95 GOPS/W energy efficiency, which is equivalent to 7.661 TOPS/W for uncompressed neural network. In addition, 142× model compression can be achieved by tensorization with acceptable accuracy loss.Keywords
This publication has 12 references indexed in Scilit:
- ESE2017
- 14.5 Eyeriss: An energy-efficient reconfigurable accelerator for deep convolutional neural networks2016
- Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks2015
- Technology-design Co-optimization of Resistive Cross-point Array for Accelerating Learning Algorithms on Chip2015
- DESTINY: A Tool for Modeling Emerging 3D NVM and eDRAM caches2015
- Solution of Linear Systems and Matrix Inversion in the TT-FormatSIAM Journal on Scientific Computing, 2012
- A Functional Hybrid Memristor Crossbar-Array/CMOS System for Data Storage and Neuromorphic ApplicationsNano Letters, 2011
- Design Exploration of Hybrid CMOS and Memristor Circuit by New Modified Nodal AnalysisIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2011
- Tensor-Train DecompositionSIAM Journal on Scientific Computing, 2011
- A Fast Learning Algorithm for Deep Belief NetsNeural Computation, 2006