Abstract
Recently, synthetic aperture radar (SAR) target detection methods have attracted extensive attention in the field of remote sensing and achieved impressive progress. Some existing methods primarily focus on the intuitive visual signatures in SAR images, such as contour and texture. However, due to the unique imaging mechanism of SAR, certain false alarms may exhibit visual similarities to real targets, making them difficult to distinguish in complex scenarios. Fortunately, features that appear indistinguishable in the spatial modality may exhibit significant spectrum differences. In this paper, we propose a multi-modality fusion method based on joint representation of visual and scattering features (JRVSNet) for ship detection in complex-valued SAR images. By learning the backscattering characteristics of high-resolution targets vary across sub-bands in the range and azimuth directions, incremental frequency information beyond the spatial modality can be obtained. Capturing and unifying the complementary information between the two modalities enables a more comprehensive feature representation. First, we introduce a scattering-aware dual-branch extractor (SDE) that encodes spatial modality visual features while simultaneously perceiving frequency modality backscattering variations from the complex-valued SAR data. Next, we create an optimal transport-based feature transformation module (OTFT), which transforms frequency modality features to align with spatial modality features, thus reducing discrepancies between the two heterogeneous modalities. Finally, we devise a bidirectional interactive fusion module (BIFM) that integrates incremental information from the frequency modality and fundamental visual features from the spatial modality in a bidirectional interactive manner. It fully explores the complementary clues between different modalities to assist the detector in obtaining more beneficial information. Experimental results show that, compared to other methods, our JRVSNet achieves state-of-the-art detection performance.
Funding Information
  • National Natural Science Foundation of China (62271159, 62071136, 62002083, 61971153, 62371153)
  • Heilongjiang Outstanding Youth Foundation
  • Fundamental Research Funds for the Central Universities (3072024XX0805)
  • Heilongjiang Province Key Research and Development Project (GA23B003)
  • Key Laboratory of Target Cognition and Application Technology (2023-CXPT-LC-005)

This publication has 59 references indexed in Scilit: