Semantic-Anchored Cross-Modal Distillation Framework With Foundation Models for SAR Ship Recognition
- 25 December 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Aerospace and Electronic Systems
- Vol. 62 (00189251) , 3509-3521
Abstract
Synthetic Aperture Radar (SAR) offers day-and-night capability for ship recognition, but its scattering mechanism results in limited textural and spectral detail compared to optical imagery, hindering fine-grained semantic interpretation and recognition. Existing cross-modal transfer methods mainly align features or pixels between SAR and optical imagery, yet they fail to guarantee semantic consistency across modalities. To address this, we propose a Semantic-anchored Cross-modal Distillation Framework (SCDF) with foundation models. SCDF introduces textual semantic descriptors for each ship category as semantic anchors to ensure cross-modal semantic consistency, while incorporating scattering topology maps into SAR images, thus enabling effective transfer without sacrificing modality-specific discriminability. Within this framework, a language foundation model encodes semantic anchors into text embeddings as class references, formulating ship recognition as aligning visual features with semantic anchors. To enhance the alignment between SAR features and anchors, a scattering-aware student model integrates scattering topology maps with SAR imagery, emphasizing key ship structures. This alignment is further guided by a vision foundation model acting as the optical teacher, which provides reliable optical-semantic similarity for distillation. Instead of simply transferring labels or features, the semantic-anchored distillation transfers semantic discriminability from the optical domain to SAR while preserving SAR-specific scattering topology features. Extensive experiments on the FUSAR-Ship dataset and fine-grained optical datasets (FGSC-23 and FGSCR-42) demonstrate that SCDF effectively bridges SAR and optical imagery and enhances SAR ship recognition.Keywords
Funding Information
- National Natural Science Foundation of China (62425308)
- National Natural Science Foundation of China (U24B20178)
- Natural Science Foundation of Shaanxi Province (2024JC-TBZC-03)
This publication has 38 references indexed in Scilit:
- A new progressive open-set recognition method with adaptive probability thresholdChinese Journal of Aeronautics, 2023
- Masked Autoencoders Are Scalable Vision Learners2022
- Mitigation of vibration of ship structure via local structural modificationsShips and Offshore Structures, 2021
- FUSAR-Ship: building a high-resolution SAR-AIS matchup dataset of Gaofen-3 for ship detection and recognitionScience China Information Sciences, 2020
- Xception: Deep Learning with Depthwise Separable Convolutions2017
- Deep Residual Learning for Image Recognition2016
- Dynamic analysis of ship structuresShips and Offshore Structures, 2013
- ImageNet: A large-scale hierarchical image database2009
- A parametric model for synthetic aperture radar measurementsIEEE Transactions on Antennas and Propagation, 1999
- Attributed scattering centers for SAR ATRIEEE Transactions on Image Processing, 1997