Open Access
- 13 May 2019
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 81-86
Abstract
Deep learning that utilizes large-scale deep neural networks (DNNs) is effective in automatic high-level feature extraction but also computation and memory intensive. Constructing DNNs using block-circulant matrices can simultaneously achieve hardware acceleration and model compression while maintaining high accuracy. This paper proposes HSIM-DNN, an accurate hardware simulator on the C++ platform, to simulate the exact behavior of DNN hardware implementations and thereby facilitate the block-circulant matrix-based design of DNN training and inference procedures in hardware. Real FPGA implementations validate the simulator with various circulant block sizes and data bit lengths taking into account accuracy, compression ratio and power consumption, which provides excellent insights for hardware design.Keywords
Funding Information
- National Science Foundation (CCF-1733701)
This publication has 13 references indexed in Scilit:
- C ir CNN2017
- In-Datacenter Performance Analysis of a Tensor Processing Unit2017
- Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural NetworksIEEE Journal of Solid-State Circuits, 2016
- EIE: Efficient Inference Engine on Compressed Deep Neural Network2016
- Quantized Convolutional Neural Networks for Mobile Devices2016
- Going Deeper with Embedded FPGA Platform for Convolutional Neural Network2016
- An Exploration of Parameter Redundancy in Deep Networks with Circulant Projections2015
- DaDianNao: A Machine-Learning Supercomputer2014
- Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research GroupsIEEE Signal Processing Magazine, 2012
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998