Accelerating Deep Neural Network Computation on a Low Power Reconfigurable Architecture
- 1 October 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
Recent work on neural network architectures has focused on bridging the gap between performance/efficiency and programmability. We consider implementations of three popular neural networks, ResNet, AlexNet and ASGD weight-dropped Recurrent Neural Network (AWD RNN) on a low power programmable architecture, Transformer. The architecture consists of light-weight cores interconnected by caches and crossbars that support run-time reconfiguration between shared and private cache mode operations. We present efficient implementations of key neural network kernels and evaluate the performance of each kernel when operating in different cache modes. The best-performing cache modes are then used in the implementation of the end-to-end network. Simulation results show superior performance with ResNet, AlexNet and AWD RNN achieving 188.19 GOPS/W, 150.53 GOPS/W and 120.68 GOPS/W, respectively, in the 14 nm technology node.Keywords
This publication has 19 references indexed in Scilit:
- CACTI 7ACM Transactions on Architecture and Code Optimization, 2017
- Deep Convolutional Neural Network Architecture With Reconfigurable Computation PatternsIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2017
- Deep Residual Learning for Image Recognition2016
- Going Deeper with Embedded FPGA Platform for Convolutional Neural Network2016
- High performance deep neural network on low cost mobile GPU2016
- ShiDianNaoACM SIGARCH Computer Architecture News, 2015
- Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks2015
- DaDianNao: A Machine-Learning Supercomputer2014
- NeuroCGRA: A CGRA with support for neural networks2014
- The gem5 simulatorACM SIGARCH Computer Architecture News, 2011