Mobile or FPGA? A Comprehensive Evaluation on Energy Efficiency and a Unified Optimization Framework
Open Access
- 30 September 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 21 (5) , 1-22
Abstract
Efficient deployment of Deep Neural Networks (DNNs) on edge devices (i.e., FPGAs and mobile platforms) is very challenging, especially under a recent witness of the increasing DNN model size and complexity. Model compression strategies, including weight quantization and pruning, are widely recognized as effective approaches to significantly reduce computation and memory intensities, and have been implemented in many DNNs on edge devices. However, most state-of-the-art works focus on ad hoc optimizations, and there lacks a thorough study to comprehensively reveal the potentials and constraints of different edge devices when considering different compression strategies. In this article, we qualitatively and quantitatively compare the energy efficiency of FPGA-based and mobile-based DNN executions using mobile GPU and provide a detailed analysis. Based on the observations obtained from the analysis, we propose a unified optimization framework using block-based pruning to reduce the weight storage and accelerate the inference speed on mobile devices and FPGAs, achieving high hardware performance and energy-efficiency gain while maintaining accuracy.Keywords
This publication has 54 references indexed in Scilit:
- Angel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGAIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2018
- Optimizing CNN-Based Object Detection Algorithms on Embedded FPGA Platforms2017
- Optimizing Loop Operation and Dataflow in FPGA Acceleration of Deep Convolutional Neural Networks2017
- Frequency Domain Acceleration of Convolutional Neural Networks on CPU-FPGA Shared Memory System2017
- Improving the Performance of OpenCL-based FPGA Accelerator for Convolutional Neural Network2017
- Julia: A Fresh Approach to Numerical ComputingSIAM Review, 2017
- XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks2016
- Going Deeper with Embedded FPGA Platform for Convolutional Neural Network2016
- On optimizing machine learning workloads via kernel fusionACM SIGPLAN Notices, 2015
- Microsoft COCO: Common Objects in Context2014