How to Obtain and Run Light and Efficient Deep Learning Networks
- 1 November 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
As the model size of deep neural networks (DNNs) grows for better performance, the increase in computational cost associated with training and testing makes it extremely difficulty to deploy DNNs on end/edge devices with limited resources while also satisfying the response time requirement. To address this challenge, model compression which compresses model size and thus reduces computation cost is widely adopted in deep learning society. However, the practical impacts of hardware design are often ignored in these algorithm-level solutions, such as the increase of the random accesses to memory hierarchy and the constraints of memory capacity. On the other side, limited understanding about the computational needs at algorithm level may lead to unrealistic assumptions during the hardware designs. In this work, we will discuss this mismatch and provide how our approach addresses it through an interactive design practice across both software and hardware levels.Keywords
This publication has 19 references indexed in Scilit:
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- A novel zero weight/activation-aware hardware architecture of convolutional neural network2017
- PipeLayer: A Pipelined ReRAM-Based Accelerator for Deep Learning2017
- CnvlutinACM SIGARCH Computer Architecture News, 2016
- Deep Residual Learning for Image Recognition2016
- Learning the Structure of Deep Convolutional Networks2015
- Caffe2014
- Speeding up Convolutional Neural Networks with Low Rank Expansions2014
- Model Selection and Estimation in Regression with Grouped VariablesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998