FLightNNs
Authors:
Open Access
- 2 June 2019
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Abstract
To improve the throughput and energy efficiency of Deep Neural Networks (DNNs) on customized hardware, lightweight neural networks constrain the weights of DNNs to be a limited combination (denoted as k ϵ {1, 2}) of powers of 2. In such networks, the multiply-accumulate operation can be replaced with a single shift operation, or two shifts and an add operation. To provide even more design flexibility, the k for each convolutional filter can be optimally chosen instead of being fixed for every filter. In this paper, we formulate the selection of k to be differentiable, and describe model training for determining k-based weights on a per-filter basis. Over 46 FPGA-design experiments involving eight configurations and four data sets reveal that lightweight neural networks with a flexible k value (dubbed FLightNNs) fully utilize the hardware resources on Field Programmable Gate Arrays (FPGAs), our experimental results show that FLightNNs can achieve 2× speedup when compared to lightweight NNs with k = 2, with only 0.1% accuracy degradation. Compared to a 4-bit fixed-point quantization, FLightNNs achieve higher accuracy and up to 2× inference speedup, due to their lightweight shift operations. In addition, our experiments also demonstrate that FLightNNs can achieve higher computational energy efficiency for ASIC implementation.Keywords
Funding Information
- National Science Foundation (1815899)
This publication has 6 references indexed in Scilit:
- Lightening the Load with Highly Accurate Storage- and Energy-Efficient LightNNsACM Transactions on Reconfigurable Technology and Systems, 2018
- Designing Energy-Efficient Convolutional Neural Networks Using Energy-Aware Pruning2017
- Hardware-Software Codesign of Accurate, Multiplier-free Deep Neural Networks2017
- LightNN2017
- Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural NetworksIEEE Journal of Solid-State Circuits, 2016
- Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks2015