Towards Resource Efficient and Low Latency CNN Accelerator for FPGAs: Review and Evaluation
Authors:
- 19 December 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-10
Abstract
Convolutional Neural Networks (CNNs) have seen widespread adoption in various domains, including speech recognition, image classification, and segmentation. However, their computational demands necessitate dedicated and reconfigurable hardware architectures, such as FieldProgrammable Gate Arrays (FPGAs). Despite the numerous advantages of CNN accelerators including enhanced efficiency within diverse application contexts, their deployment on FPGAs must address challenges related to energy consumption, computational demands, and resource optimization. Both academia and industries are actively engaged in research and development aimed at designing resource-efficient and lowlatency CNN accelerators for FPGAs. However, there has been relatively little attention paid to the dynamic comprehensive analysis and evaluation in which CNN accelerators equipped with FPGAs operate. This paper aims to bridge this gap by conducting a comprehensive survey and evaluation of CNN accelerator techniques for FPGAs, focusing on resource utilization, latency, and power consumption. This study investigates the performance of CNN accelerators for FPGAs, considering a range of hardware architectures and optimization techniques, from multiplier designs to complex heterogeneous pipelining. Furthermore, the paper highlights the challenges faced by FPGA-based CNN accelerators, particularly the tradeoffs between resource utilization and latency, based on the characteristics of the data and devices involved. The insights gleaned from this review can offer valuable guidance and inspiration to researchers, engineers, and students working in these domains, facilitating further advancements in FPGAbased CNN accelerator technology.Keywords
This publication has 51 references indexed in Scilit:
- FPGA-Based Real-Time Object Detection and Classification System Using YOLO for Edge ComputingIEEE Access, 2024
- Survey of convolutional neural network accelerators on field-programmable gate array platforms: architectures and optimization techniquesJournal of Real-Time Image Processing, 2024
- A Reconfigurable CNN-Based Accelerator Design for Fast and Energy-Efficient Object Detection System on Mobile FPGAIEEE Access, 2023
- An FPGA-based online reconfigurable CNN edge computing device for object detectionMicroelectronics Journal, 2023
- A fast and scalable architecture to run convolutional neural networks in low density FPGAsMicroprocessors and Microsystems, 2020
- Hamamu: Specializing FPGAs for ML Applications by Adding Hard Matrix Multiplier Blocks2020
- A survey of FPGA-based accelerators for convolutional neural networksNeural Computing and Applications, 2018
- A fast digit based Montgomery multiplier designed for FPGAs with DSP resourcesMicroprocessors and Microsystems, 2018
- FP-BNN: Binarized neural network on FPGANeurocomputing, 2018
- Deep learningNature, 2015