A Task-Balanced Multiscale Adaptive Fusion Network for Object Detection in Remote Sensing Images
- 27 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 61 (01962892) , 1-15
Abstract
Object detection is essential in the interpretation of remote sensing images. However, the blurred background and objects with vast variances are identified as the two main challenges of the task. We propose a novel detector adapted to complicated background and multi-scale objects, namely, task-balanced multi-scale adaptive fusion network (TMAFNet), targeting directly on the above two challenges. Firstly, a depth separable global context module (DSGC) is constructed to understand contextual relations among pixels from a global perspective, which is extraordinarily necessary to distinguish objects from the environment. Most importantly, DSGC reduces the computational cost by decoupling the acquisition of global information into single-channel global interaction and multi-channel single-point interaction. Secondly, in order to eliminate disturbance and enhance representation ability of objects, hidden recursive feature pyramid network (HRFPN) is explored, which encodes the information of difference before and after using the multi-scale fusion. HRFPN is proven to enhance the target features by reducing the background noise. Thirdly, a semi-coupling task-balanced head (SCTB) is presented to guarantee the consistency of detection. We have conducted comprehensive experiments on several publicly available datasets, and the results illustrate that our modules improve adaptability and robustness of the network, leading to a new state-of-the-art.Keywords
Funding Information
- National Key Research and Development Program of China (2019YFE0108300)
- National Natural Science Foundation of China (52172379, 62001058, U1864204)
- Special Funds for Fundamental Research Funds of the Central Universities of Chang’an University (300102242901)
This publication has 58 references indexed in Scilit:
- Crafting GBD-Net for Object DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship DetectionRemote Sensing, 2017
- A Joint Convolutional Neural Networks and Context Transfer for Street Scenes LabelingIEEE Transactions on Intelligent Transportation Systems, 2017
- Unsupervised Deep Feature Learning for Urban Village Detection from High-Resolution Remote Sensing ImagesPhotogrammetric Engineering & Remote Sensing, 2017
- Feature Pyramid Networks for Object Detection2017
- YOLO9000: Better, Faster, Stronger2017
- Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing ImagesIEEE Transactions on Geoscience and Remote Sensing, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Deep Residual Learning for Image Recognition2016
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014