Hardware Acceleration of Satellite Remote Sensing Image Object Detection Based on Channel Pruning
Open Access
- 8 September 2023
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 13 (18) , 10111
Abstract
Real-time detection of satellite remote sensing images is one of the key technologies in the field of remote sensing, which requires not only high-efficiency algorithms, but also low-power and high-performance hardware deployment platforms. At present, the image processing hardware acceleration platform mainly uses an image processing unit (GPU), but the GPU has the problem of large power consumption, and it is difficult to apply to micro-nano satellites and other devices with limited volume, weight, computing power, and power consumption. At the same time, the deep learning algorithm model has the problem of too many parameters, and it is difficult to directly deploy it on embedded devices. In order to solve the above problems, we propose a YOLOv4-MobileNetv3 field programmable gate array (FPGA) deployment scheme based on channel layer pruning. Experiments show that the acceleration strategy proposed by us can reduce the number of model parameters by 91.11%, and on the aerial remote sensing dataset DIOR, the average accuracy of the design scheme in this paper reaches 82.61%, the FPS reaches 48.14, and the average power consumption is 7.2 W, which is 317.88% FPS higher than the CPU and reduces the power consumption by 81.91%. Compared to the GPU, it reduces power consumption by 91.85% and improves FPS by 8.50%. Compared with CPUs and GPUs, our proposed lightweight algorithm model is more energy-efficient and more real-time, and is suitable for application in spaceborne remote sensing image processing systems.Keywords
Funding Information
- Natural Science Foundation of Heilongjiang Province (LH2023F003)
This publication has 40 references indexed in Scilit:
- ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design2018
- Glacial lake outburst floods as drivers of fluvial erosion in the HimalayaScience, 2018
- Learning Efficient Convolutional Networks through Network Slimming2017
- Mask R-CNN2017
- SSD: Single Shot MultiBox Detector2016
- XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks2016
- A survey on object detection in optical remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2016
- You Only Look Once: Unified, Real-Time Object Detection2016
- Energy budgeting for CubeSats with an integrated FPGA2012
- FPGA vs. ASIC for low power applicationsMicroelectronics Journal, 2006