High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System
Open Access
- 9 November 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 22 (6) , 1-20
Abstract
Deep convolutional neural networks (DNNs) have been widely used in many applications, particularly in machine vision. It is challenging to accelerate DNNs on embedded systems because real-world machine vision applications should reserve a lot of external memory bandwidth for other tasks, such as video capture and display, while leaving little bandwidth for accelerating DNNs. In order to solve this issue, in this study, we propose a high-throughput accelerator, called reconfigurable tiny neural network accelerator (ReTiNNA), for the bandwidth-limited system and present a real-time object detection system for the high-resolution video image. We first present a dedicated computation engine that takes different data mapping methods for various filter types to improve data reuse and reduce hardware resources. We then propose an adaptive layer-wise tiling strategy that tiles the feature maps into strips to reduce the control complexity of data transmission dramatically and to improve the efficiency of data transmission. Finally, a design space exploration (DSE) approach is presented to explore design space more accurately in the case of insufficient bandwidth to improve the performance of the low-bandwidth accelerator. With a low bandwidth of 2.23 GB/s and a low hardware consumption of 90.261K LUTs and 448 DSPs, ReTiNNA can still achieve a high performance of 155.86 GOPS on VGG16 and 68.20 GOPS on ResNet50, which is better than other state-of-the-art designs implemented on FPGA devices. Furthermore, the real-time object detection system can achieve a high object detection speed of 19 fps for high-resolution video.Keywords
Funding Information
- Key-Area Research and Development Program of Guangdong Province (#2021B0101410004, 2019B010140002)
This publication has 29 references indexed in Scilit:
- A High Throughput Acceleration for Hybrid Neural Networks With Efficient Resource Management on FPGAIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 2018
- Bit-width Adaptive Accelerator Design for Convolution Neural Network2018
- Snowflake: An efficient hardware accelerator for convolutional neural networks2017
- Deep Convolutional Neural Network Architecture With Reconfigurable Computation PatternsIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2017
- A Resource-Limited Hardware Accelerator for Convolutional Neural Networks in Embedded Vision ApplicationsIEEE Transactions on Circuits and Systems II: Express Briefs, 2017
- Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural NetworksIEEE Journal of Solid-State Circuits, 2016
- Neural-Dynamics-Driven Complete Area Coverage Navigation Through Cooperation of Multiple Mobile RobotsIEEE Transactions on Industrial Electronics, 2016
- Going Deeper with Embedded FPGA Platform for Convolutional Neural Network2016
- Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech RecognitionIEEE Transactions on Audio, Speech, and Language Processing, 2011
- Neural-Network-Based Low-Speed-Damping Controller for Stepper Motor With an FPGAIEEE Transactions on Industrial Electronics, 2009