LACS: A High-Computational-Efficiency Accelerator for CNNs
Open Access
- 27 December 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 6045-6059
Abstract
Convolutional neural networks (CNNs) have become continually deeper. With the increasing depth of CNNs, the invalid calculations caused by padding-zero operations, filling-zero operations and stride length (stride length>1) represent an increasing proportion of all calculations. To adapt to different CNNs and to eliminate the influences of padding-zero operations, filling-zero operations and stride length on the computational efficiency of the accelerator, we draw upon the computation pattern of CPUs to design an efficient and versatile CNN accelerator, LACS (Loading-Addressing-Computing-Storing). We reduce the amount of data movements between registers and the on-chip buffer from O(k×k) to O(k) by a bypass buffer mechanism. Finally, we deploy LACS on a field-programmable gate array (FPGA) chip and analyze the factors that affect the computational efficiency of LACS. We also run popular CNNs on LACS. The results show that LACS achieves an extremely high computational efficiency, 98.51% when executing AlexNet and 99.66% when executing VGG-16, significantly exceeding state-of-the-art accelerators.Keywords
This publication has 22 references indexed in Scilit:
- An Energy-Efficient Architecture for Binary Weight Convolutional Neural NetworksIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2018
- Angel-Eye: A Complete Design Flow for Mapping CNN Onto Embedded FPGAIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2018
- G-CNN: Object Detection via Grid Convolutional Neural NetworkIEEE Access, 2017
- Accelerating low bit-width convolutional neural networks with embedded FPGA2017
- Optimizing Loop Operation and Dataflow in FPGA Acceleration of Deep Convolutional Neural Networks2017
- Frequency Domain Acceleration of Convolutional Neural Networks on CPU-FPGA Shared Memory System2017
- CnvlutinACM SIGARCH Computer Architecture News, 2016
- EyerissACM SIGARCH Computer Architecture News, 2016
- Going Deeper with Embedded FPGA Platform for Convolutional Neural Network2016
- Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks2015