An FPGA-Based YOLOv6 Accelerator for High-Throughput and Energy-Efficient Object Detection
Authors:
Open Access
- 1 March 2025
- journal article
- Published by Institute of Electronics, Information and Communications Engineers (IEICE) in IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
- Vol. E108.A (3) , 473-481
Abstract
Fast, accurate, and energy-efficient object detection is increasingly important for edge applications, such as Internet of Things (IoT) devices. Among various convolutional neural network (CNN)-based methods, the You-Only-Look-Once (YOLO) algorithm series is regarded as one of the promising methods for real-time object detection due to its optimal balance between speed and accuracy. However, deploying YOLO on resource and power-constrained devices like field-programmable gate arrays (FPGAs) poses significant challenges due to the high demand for multiply-and-accumulate (MAC) operations and the corresponding significant off-chip memory accesses. This paper introduces an FPGA-based accelerator for the YOLOv6 algorithm, implemented on a VC707 FPGA board with a Virtex-7 VX485T chip, achieving satisfying throughput, accuracy, and energy efficiency. To our knowledge, this is the first FPGA implementation of YOLOv6. Unlike previous works that utilized early YOLO versions, our design deploys the hardware-friendly YOLOv6, achieving a mean average precision (mAP) of 84.9% on the PASCAL VOC2007 dataset at a 352*352 resolution - significantly outperforming most existing object detection implementations. Through model optimizations for FPGA deployment, such as changing from SiLU to ReLU activation, lowering input resolution, and applying quantization-aware training, we are able to greatly reduce computational cost with minimal accuracy loss. Furthermore, these optimizations allow for the entire YOLOv6 model to be stored in on-chip memory, eliminating the need for energy-intensive DRAM access. The proposed accelerator design and the convolution lowering technique also contribute to high processing speed and energy efficiency. Experimental results demonstrate that our accelerator can process 364.5 frames per second (fps) at 150 MHz on the Virtex-7 VX485T FPGA, achieving excellent power efficiency of 19.75 fps/W.Keywords
This publication has 16 references indexed in Scilit:
- YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors2023
- Low Latency YOLOv3-Tiny Accelerator for Low-Cost FPGA Using General Matrix Multiplication PrincipleIEEE Access, 2021
- FPGA Implementation of Object Detection Accelerator Based on Vitis-AI2021
- Sparse-YOLO: Hardware/Software Co-Design of an FPGA Accelerator for YOLOv2IEEE Access, 2020
- Hardware and Software Optimizations for Accelerating Deep Neural Networks: Survey of Current Trends, Challenges, and the Road AheadIEEE Access, 2020
- Sigmoid-weighted linear units for neural network function approximation in reinforcement learningNeural Networks, 2018
- YOLO9000: Better, Faster, Stronger2017
- You Only Look Once: Unified, Real-Time Object Detection2016
- Fast R-CNN2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014