Mask-Net: A Hardware-efficient Object Detection Network with Masked Region Proposals
Authors:
- 1 July 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 131-138
Abstract
Object detection on embedded systems is challenging because it is hard to achieve real-time inference with low energy consumption and limited hardware resources. Another challenge is to find hardware-friendly methods to avoid redundant computation. To address these challenges, in this work, we propose Mask-Net, a hardware-efficient object detection network with masked region proposals in regular shapes. First, we propose a hardware-friendly region proposal method to avoid redundant computation as much as possible and as early as possible, with slight or no accuracy loss. Second, we demonstrate that our method is generalizable by applying it to several detection backbones including SkyNet, ResNet-18 and UltraNet. Our method performs well in different scenarios, including DAC-SDC dataset, UAV123 dataset and OTB100 dataset. We choose SkyNet as our base model to design an accelerator and verify our design on Xilinx ZCU106 FPGA. We observe a speedup of 1.3× and about 30% energy consumption reduction when the FPGA runs at different frequencies from 124 MHz to 214 MHz with only a slight accuracy loss. We also conduct a design space exploration and demonstrate that our accelerator can achieve a theoretical speedup of 1.76× with masked region proposals. This is achieved by optimally allocating DSPs to different parts of the accelerator to balance the computations before and after the mask.Keywords
This publication has 30 references indexed in Scilit:
- A Benchmark and Simulator for UAV Tracking2016
- Quantized Convolutional Neural Networks for Mobile Devices2016
- 14.5 Eyeriss: An energy-efficient reconfigurable accelerator for deep convolutional neural networks2016
- Fast R-CNN2015
- What Makes for Effective Detection Proposals?IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Low-rank matrix factorization for Deep Neural Network training with high-dimensional output targets2013
- Selective Search for Object RecognitionInternational Journal of Computer Vision, 2013
- Measuring the Objectness of Image WindowsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Detection of objects on the image using a sliding window modeOptics & Laser Technology, 1995