Multilevel Interactive Reverse-Guided Network for Salient Object Detection in Optical Remote Sensing Images
Open Access
- 3 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 12983-12999
Abstract
Salient object detection in optical remote sensing images (ORSI-SOD) is a challenging and relatively novel research field. While many convolutional neural networks (CNNs) have been employed for salient object detection in natural scenes, they often overlook the unique properties of optical remote sensing images. These images typically lack clear edges and sharp details, posing challenges in capturing essential features. To address these issues, we propose a new method for ORSI-SOD called the Multi-level Interactive Reverse Guided network (MIRGNet), which coordinates high- and low-level features in a synchronized manner. The model consists of two key components: Global-Pixel Coordination Module (GPC) and the Multi-Level Feature Interactive Module (MFI), which facilitate coordination between the encoder and decoder. Specifically, GPC extracts low-level features and fully mobilizes them to refine detection, while MFI captures high-level features and enhances the representation of salient regions through multi-level interaction. And, we present a Multi-Scale Receptive Field Module (MRF), which strengthens feature representation through the hierarchical combination of various unbalance dilated convolutions, while reducing adverse grid effects and enhancing inter-pixel continuity. Additionally, to promote feature interaction, a Reverse Guided Module (RG) is introduced to compensate for the insufficient information in shallow features by leveraging deep features more effectively. Extensive experiments on two public datasets employing eight evaluation metrics demonstrate that MIRGNet outperforms 30 state-of-the-art methods. The code and results of our method could be found at https://github.com/JieZzzoo/MIRGNet.Keywords
Funding Information
- Yantai Science and Technology Innovation Development Plan (2022XDRH031)
This publication has 68 references indexed in Scilit:
- Suppress and Balance: A Simple Gated Network for Salient Object Detection2020
- A parallel down-up fusion network for salient object detection in optical remote sensing imagesNeurocomputing, 2020
- U2-Net: Going deeper with nested U-structure for salient object detectionPattern Recognition, 2020
- X-ModalNet: A semi-supervised deep cross-modal network for classification of remote sensing dataISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Non-rigid object tracking via deep multi-scale spatial-temporal discriminative saliency mapsPattern Recognition, 2020
- Constrained fixation point based segmentation via deep neural networkNeurocomputing, 2019
- Saliency detection based on self-adaptive multiple feature fusion for remote sensing imagesInternational Journal of Remote Sensing, 2019
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Frequency-tuned salient region detection2009
- A model of saliency-based visual attention for rapid scene analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998