Masked Feature Compression for Object Detection
Open Access
- 14 June 2024
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 12 (12) , 1848
Abstract
Deploying high-accuracy detection models on lightweight edge devices (e.g., drones) is challenging due to hardware constraints. To achieve satisfactory detection results, a common solution is to compress and transmit the images to a cloud server where powerful models can be used. However, the image compression process for transmission may lead to a reduction in detection accuracy. In this paper, we propose a feature compression method tailored for object detection tasks, and it can be easily integrated with existing learned image compression models. In the method, the encoding process consists of two steps. Firstly, we use a feature extractor to obtain the low-level feature, and then use a mask generator to obtain an object mask to select regions containing objects. Secondly, we use a neural network encoder to compress the masked feature. As for decoding, a neural network decoder is used to restore the compressed representation into the feature that can be directly inputted into the object detection model. The experimental results demonstrate that our method surpasses existing compression techniques. Specifically, when compared to one of the leading methods—TCM2023—our approach achieves a 25.3% reduction in compressed file size and a 6.9% increase in mAP0.5.Keywords
Funding Information
- National Natural Science Foundation of China (62236007)
This publication has 32 references indexed in Scilit:
- Towards real-time practical image compression with lightweight attentionExpert Systems with Applications, 2024
- A survey of model compression strategies for object detectionMultimedia Tools and Applications, 2023
- Dense Attentive Feature Enhancement for Salient Object DetectionIEEE Transactions on Circuits and Systems for Video Technology, 2021
- UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation2020
- Feature Consistency Training With JPEG Compressed ImagesIEEE Transactions on Circuits and Systems for Video Technology, 2019
- Image and Video Compression With Neural Networks: A ReviewIEEE Transactions on Circuits and Systems for Video Technology, 2019
- CNN for saliency detection with low-level feature integrationNeurocomputing, 2017
- Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standardIEEE Transactions on Circuits and Systems for Video Technology, 2003
- Discrete Cosine TransformIEEE Transactions on Computers, 1974
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948