CAGMC-Defence: A Cross-Attention-Guided Multimodal Collaborative Defence Method for Multimodal Remote Sensing Image Target Recognition
Open Access
- 25 September 2025
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 17 (19) , 3300
Abstract
With the increasing diversity of remote sensing modalities, multimodal image fusion improves target recognition accuracy but also introduces new security risks. Adversaries can inject small, imperceptible perturbations into a single modality to mislead model predictions, which undermines system reliability. Most existing defences are designed for single-modal inputs and face two key challenges in multimodal settings: 1. vulnerability to perturbation propagation due to static fusion strategies, and 2. the lack of collaborative mechanisms that limit overall robustness according to the weakest modality. To address these issues, we propose CAGMC-Defence, a cross-attention-guided multimodal collaborative defence framework for multimodal remote sensing. It contains two main modules. The Multimodal Feature Enhancement and Fusion (MFEF) module adopts a pseudo-Siamese network and cross-attention to decouple features, capture intermodal dependencies, and suppress perturbation propagation through weighted regulation and consistency alignment. The Multimodal Adversarial Training (MAT) module jointly generates optical and SAR adversarial examples and optimizes network parameters under consistency loss, enhancing robustness and generalization. Experiments on the WHU-OPT-SAR dataset show that CAGMC-Defence maintains stable performance under various typical adversarial attacks, such as FGSM, PGD, and MIM, retaining 85.74% overall accuracy even under the strongest white-box MIM attack (), significantly outperforming existing multimodal defence baselines.
Keywords
Funding Information
- National Natural Science Foundation of China (42271481)
- Natural Science Foundation of Hainan Province (2024JJ6496)
This publication has 32 references indexed in Scilit:
- STDCformer: A transformer-based model with a spatial–temporal causal de-confounding strategy for crowd flow predictionInformation Fusion, 2025
- Causal invariant geographic network representations with feature and structural distribution shiftsFuture Generation Computer Systems, 2025
- Securing Vision-Language Models with a Robust Encoder Against Jailbreak and Adversarial Attacks2024
- Adversarial Deep Learning based Dampster–Shafer data fusion model for intelligent transportation systemInformation Fusion, 2023
- Using artificial intelligence and data fusion for environmental monitoring: A review and future perspectivesInformation Fusion, 2022
- Adversary-Aware Multimodal Neural Networks for Cancer Susceptibility Prediction From Multiomics DataIEEE Access, 2022
- Multi-source Multimodal Data and Deep Learning for Disaster Response: A Systematic ReviewSN Computer Science, 2021
- Boosting Adversarial Attacks with Momentum2018
- Deep Residual Learning for Image Recognition2016
- An introduction to multisensor data fusionProceedings of the IEEE, 1997