JRVSNet: Joint Representation of Visual and Scattering Features for Ship Detection in Complex-Valued SAR Images
Open Access
- 22 October 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 18 (19391404) , 28343-28357
Abstract
Recently, synthetic aperture radar (SAR) target detection methods have attracted extensive attention in the field of remote sensing and achieved impressive progress. Some existing methods primarily focus on the intuitive visual signatures in SAR images, such as contour and texture. However, due to the unique imaging mechanism of SAR, certain false alarms may exhibit visual similarities to real targets, making them difficult to distinguish in complex scenarios. Fortunately, features that appear indistinguishable in the spatial modality may exhibit significant spectrum differences. In this paper, we propose a multi-modality fusion method based on joint representation of visual and scattering features (JRVSNet) for ship detection in complex-valued SAR images. By learning the backscattering characteristics of high-resolution targets vary across sub-bands in the range and azimuth directions, incremental frequency information beyond the spatial modality can be obtained. Capturing and unifying the complementary information between the two modalities enables a more comprehensive feature representation. First, we introduce a scattering-aware dual-branch extractor (SDE) that encodes spatial modality visual features while simultaneously perceiving frequency modality backscattering variations from the complex-valued SAR data. Next, we create an optimal transport-based feature transformation module (OTFT), which transforms frequency modality features to align with spatial modality features, thus reducing discrepancies between the two heterogeneous modalities. Finally, we devise a bidirectional interactive fusion module (BIFM) that integrates incremental information from the frequency modality and fundamental visual features from the spatial modality in a bidirectional interactive manner. It fully explores the complementary clues between different modalities to assist the detector in obtaining more beneficial information. Experimental results show that, compared to other methods, our JRVSNet achieves state-of-the-art detection performance.Keywords
Funding Information
- National Natural Science Foundation of China (62271159, 62071136, 62002083, 61971153, 62371153)
- Heilongjiang Outstanding Youth Foundation
- Fundamental Research Funds for the Central Universities (3072024XX0805)
- Heilongjiang Province Key Research and Development Project (GA23B003)
- Key Laboratory of Target Cognition and Application Technology (2023-CXPT-LC-005)
This publication has 59 references indexed in Scilit:
- Physics inspired hybrid attention for SAR target recognitionISPRS Journal of Photogrammetry and Remote Sensing, 2023
- TINYCD: a (not so) deep learning model for change detectionNeural Computing and Applications, 2022
- Physically explainable CNN for SAR image classificationISPRS Journal of Photogrammetry and Remote Sensing, 2022
- Deep SAR-Net: Learning objects from signalsISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Deep High-Resolution Representation Learning for Human Pose Estimation2019
- Grid R-CNN2019
- Path Aggregation Network for Instance Segmentation2018
- Cascade R-CNN: Delving Into High Quality Object Detection2018
- Time–frequency analysis for synthetic aperture radar and feature extractionIEE Proceedings - Radar, Sonar and Navigation, 2003
- Analysis of SAR images by multidimensional wavelet transformIEE Proceedings - Radar, Sonar and Navigation, 2003