Context Feature Integration and Balanced Sampling Strategy for Small Weak Object Detection in Remote Sensing Imagery
- 22 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 21 (1545598X) , 1-5
Abstract
Deep learning has made significant achievements in remote sensing object detection tasks. However, small weak objects located in complex scenes are still not effectively addressed. The lack of feature information and negligible contributions during the optimization stage are the main reasons. To solve the indicated issues, a novel remote-sensing object detection method is proposed in this letter. Firstly, the context feature integration module (CFIM) is designed to extract implicit clues co-occurring with the object to compensate for the lack of features in small weak objects. The receptive field expansive deformable convolution (RFConv) constructed in CFIM can adaptively adjust the information extraction range based on the object’s characteristics, thereby capturing suitable context features. Secondly, to make small weak objects competitive during the optimization process, we propose tailored optimization functions: the balanced sampling strategy (BSS) and the modulated loss function (MLF). BSS makes up for the sample deficiency of small weak objects by balancing sampling. More specifically, BSS dynamically mines potential positive samples from the ignored set in order to increase the chances of matching. MLF progressively adjusts the loss proportion of the object and pushes the detector to be more sensitive to small weak objects during the training stage. Our proposed method achieves 94.79% and 71.23% mAP on the NWPU VHR-10 and DIOR datasets, which also proves the effectiveness.Keywords
This publication has 24 references indexed in Scilit:
- Object Detection in 20 Years: A SurveyProceedings of the IEEE, 2023
- EDTER: Edge Detection with Transformer2022
- OTA: Optimal Transport Assignment for Object Detection2021
- Methods for Small, Weak Object Detection in Optical High-Resolution Remote Sensing Images: A survey of advances and challengesIEEE Geoscience and Remote Sensing Magazine, 2021
- Object detection in optical remote sensing images: A survey and a new benchmarkISPRS Journal of Photogrammetry and Remote Sensing, 2020
- RepPoints: Point Set Representation for Object Detection2019
- Path Aggregation Network for Instance Segmentation2018
- Focal Loss for Dense Object Detection2017
- Feature Pyramid Networks for Object Detection2017
- Multi-class geospatial object detection and geographic image classification based on collection of part detectorsISPRS Journal of Photogrammetry and Remote Sensing, 2014