ALSCA: A Large-Scale Sparse CNN Accelerator Using Position-First Dataflow and Input Channel Merging Approach
- 29 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems II: Express Briefs
- Vol. 71 (7) , 3473-3477
Abstract
The customization of accelerators for sparse convolutional neural networks (SCNN) has been demonstrated to be a promising approach to enhance the computational efficiency of CNNs. However, current sparse-based works always employ reduced-scale convolutional engines (CEs), resulting in limited performance compared to previous dense-based accelerators. It is found that the deployment of large-scale CEs to sparse-based works encounters three challenges: inadequate utilization of CEs, unstable workload of CEs and complex interconnections between CEs and accumulators. Therefore, in this paper, first, a novel position-first dataflow is proposed to streamline the interconnections between the CEs and accumulators of the architecture. In addition, an input channel merging method is devised to improve the inadequate utilization and unstable workload of CEs. With the assistance of the above two schemes, a sparse-based acceleration architecture with an expanded-scale convolution array is designed and implemented on Xilinx VCU118 platform, achieving a runtime frequency of 300MHz. The comparison results demonstrate that compared with current sparse-based works, our proposed architecture can achieve 1.10×-3.95× speedup on actual performance and 1.10×-2.52× speedup on DSP efficiency, respectively, when VGG16 is applied.Keywords
Funding Information
- National Natural Science Foundation of China (62176206)
This publication has 19 references indexed in Scilit:
- C-DNN: A 24.5-85.8TOPS/W Complementary-Deep-Neural-Network Processor with Heterogeneous CNN/SNN Core Architecture and Forward-Gradient-Based Sparsity Generation2023
- An Efficient Unstructured Sparse Convolutional Neural Network Accelerator for Wearable ECG Classification DeviceIEEE Transactions on Circuits and Systems I: Regular Papers, 2022
- A Mixed-Pruning Based Framework for Embedded Convolutional Neural Network AccelerationIEEE Transactions on Circuits and Systems I: Regular Papers, 2021
- SNAP: An Efficient Sparse Neural Acceleration Processor for Unstructured Sparse Deep Neural Network InferenceIEEE Journal of Solid-State Circuits, 2020
- WinoNN: Optimizing FPGA-Based Convolutional Neural Network Accelerators Using Sparse Winograd AlgorithmIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2020
- High Performance CNN Accelerators Based on Hardware and Algorithm Co-OptimizationIEEE Transactions on Circuits and Systems I: Regular Papers, 2020
- OMNI: A Framework for Integrating Hardware and Software Optimizations for Sparse CNNsIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2020
- 7.1 A 3.4-to-13.3TOPS/W 3.6TOPS Dual-Core Deep-Learning Accelerator for Versatile AI Applications in 7nm 5G Smartphone SoC2020
- STICKER: An Energy-Efficient Multi-Sparsity Compatible Accelerator for Convolutional Neural Networks in 65-nm CMOSIEEE Journal of Solid-State Circuits, 2019
- WRA: A 2.2-to-6.3 TOPS Highly Unified Dynamically Reconfigurable Accelerator Using a Novel Winograd Decomposition Algorithm for Convolutional Neural NetworksIEEE Transactions on Circuits and Systems I: Regular Papers, 2019