Yanjie Xu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Yanjie Xu has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Gangyao Kuang
College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, China
5 shared publications - Hao Sun
College of Electronic Science and Technology, National University of Defense Technology, Changsha, China
5 shared publications - Chenfang Liu
College of Electronic Science and Technology, National University of Defense Technology, Changsha, China
3 shared publications - Lin Lei
National University of Defense Technology
3 shared publications - Yuli Sun
College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
3 shared publications - Hui Chen
State Key Laboratory of Millimeter Waves, Southeast University, Nanjing, China
1 shared publication
Latest Publications
- 29 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-20
DiffDual-AD: Diffusion-Based Dual-Stage Adversarial Defense Framework in Remote Sensing With Denoiser Constraint
Deep neural networks (DNNs), though highly effective in various Earth observation tasks with remote sensing images (RSIs), are vulnerable to adversarial attacks, threatening their reliability. Each maliciously attacked RSI potentially contains unique and critical information, but current defenses lack a unified framework for rapidly detecting adversarial RSIs and accurately restoring them to their natural state. To bridge this research gap, we propose a diffusion-based dual-stage adversarial defense (DiffDual-AD) framework. In the first stage, we propose a novel adversarial detection method based on the score expectation (AD-SE), which is integrated into the forward process of diffusion model with an improved denoiser constrained for adversarial defense. During the reverse process, the second stage introduces the distance and label-guided adversarial purification (DL-GAP) to restore adversarial RSIs to natural ones. With the help of two proposed guidelines and the specific denoiser, the DL-GAP effectively smooths out the adversarial perturbations from the detected adversarial RSIs while preserving semantic information and local key features. Finally, DL-GAP yields nonadversarial purified RSIs based on the results of AD-SE. Both stages are integrated within the diffusion models, complementing each other to form a pipelined operational mode. Extensive experiments across three RSI scene classification datasets have proven its efficacy in resisting adversarial RSIs in both whitebox and black-box scenarios, achieving an average adversarial detection accuracy of 87.02% with AD-SE and an average final classification accuracy of 81.50% with the entire DiffDual-AD. The performances of our proposed AD-SE and DL-GAP have surpassed other advanced adversarial detection and purification methods when applied to RSIs. Therefore, DiffDual-AD provides a unified and universal solution to preserve the utility and security of processing the adversarial RSIs, which advances the adversarial defense research in remote sensing.
- 29 April 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-20
DiffDual-AD: Diffusion-Based Dual-Stage Adversarial Defense Framework in Remote Sensing With Denoiser Constraint
Deep neural networks (DNNs), though highly effective in various Earth observation tasks with remote sensing images (RSIs), are vulnerable to adversarial attacks, threatening their reliability. Each maliciously attacked RSI potentially contains unique and critical information, but current defenses lack a unified framework for rapidly detecting adversarial RSIs and accurately restoring them to their natural state. To bridge this research gap, we propose a diffusion-based dual-stage adversarial defense (DiffDual-AD) framework. In the first stage, we propose a novel adversarial detection method based on the score expectation (AD-SE), which is integrated into the forward process of diffusion model with an improved denoiser constrained for adversarial defense. During the reverse process, the second stage introduces the distance and label-guided adversarial purification (DL-GAP) to restore adversarial RSIs to natural ones. With the help of two proposed guidelines and the specific denoiser, the DL-GAP effectively smooths out the adversarial perturbations from the detected adversarial RSIs while preserving semantic information and local key features. Finally, DL-GAP yields nonadversarial purified RSIs based on the results of AD-SE. Both stages are integrated within the diffusion models, complementing each other to form a pipelined operational mode. Extensive experiments across three RSI scene classification datasets have proven its efficacy in resisting adversarial RSIs in both whitebox and black-box scenarios, achieving an average adversarial detection accuracy of 87.02% with AD-SE and an average final classification accuracy of 81.50% with the entire DiffDual-AD. The performances of our proposed AD-SE and DL-GAP have surpassed other advanced adversarial detection and purification methods when applied to RSIs. Therefore, DiffDual-AD provides a unified and universal solution to preserve the utility and security of processing the adversarial RSIs, which advances the adversarial defense research in remote sensing.
- Top Cited PapersOpen Access
- 9 July 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 12910-12930
A Review of Optical and SAR Image Deep Feature Fusion in Semantic Segmentation
With the advent of the era of high-resolution remote sensing, semantic segmentation methods for solving pixel-level classification have been widely studied. Deep learning has significantly advanced deep feature extraction methods, becoming widely employed in remote sensing image analysis. Deep feature fusion methods is able to effectively combine features from different sources. Optical and synthetic aperture radar (SAR) images stand out as primary data sources in remote sensing, offering complementary and consistent information. Fusion of deep semantic features of optical and SAR images can alleviate the limitations of single-source images in application and improve semantic segmentation accuracy. Therefore, this article reviews the research on deep fusion of optical and SAR images in semantic segmentation tasks from four aspects. Firstly, we provide a summary of challenges and research methods pertinent to semantic segmentation of remote sensing images. Then the challenges and urgent needs of deep feature fusion of optical and SAR images are analyzed, and current research is summarized from the perspective of structural design by studying various feature fusion strategies. Additionally, the compilation and in-depth analysis of open-source optical and SAR datasets suitable for semantic segmentation are undertaken, serving as fundamental resources for future research endeavors. Finally, the article identifies the major challenges summarized from the literature review in this field, outlining expectations and potential future directions for researchers.
- 9 July 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 12910-12930
Top Cited PapersOpen AccessA Review of Optical and SAR Image Deep Feature Fusion in Semantic Segmentation
With the advent of the era of high-resolution remote sensing, semantic segmentation methods for solving pixel-level classification have been widely studied. Deep learning has significantly advanced deep feature extraction methods, becoming widely employed in remote sensing image analysis. Deep feature fusion methods is able to effectively combine features from different sources. Optical and synthetic aperture radar (SAR) images stand out as primary data sources in remote sensing, offering complementary and consistent information. Fusion of deep semantic features of optical and SAR images can alleviate the limitations of single-source images in application and improve semantic segmentation accuracy. Therefore, this article reviews the research on deep fusion of optical and SAR images in semantic segmentation tasks from four aspects. Firstly, we provide a summary of challenges and research methods pertinent to semantic segmentation of remote sensing images. Then the challenges and urgent needs of deep feature fusion of optical and SAR images are analyzed, and current research is summarized from the perspective of structural design by studying various feature fusion strategies. Additionally, the compilation and in-depth analysis of open-source optical and SAR datasets suitable for semantic segmentation are undertaken, serving as fundamental resources for future research endeavors. Finally, the article identifies the major challenges summarized from the literature review in this field, outlining expectations and potential future directions for researchers.
- 27 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-17
Simulated Data Feature Guided Evolution and Distillation for Incremental SAR ATR
Deep neural network (DNN) based Synthetic aperture radar automatic target recognition (SAR ATR) methods have made great progress in recent years. However, the performance of DNN models relies on a large number of independent and identically distributed measured SAR images, which is contrary to the SAR ATR in practice. Furthermore, DNN models also suffer from catastrophic forgetting when learning a sequence of new classes. To tackle these problems, we introduce simulated data into the class incremental learning of SAR ATR for the first time. Specifically, we aim to continuously learn a sequence of new classes with a small amount of measured data and a large amount of simulated data. We first investigate the properties of incremental learning using simulated data, and the main observation is that simulated data can achieve good performance in short-term incremental learning rather than long-term incremental learning. A novel class incremental learning method, namely, feature guided evolution and distillation (FGED), is then presented. On the one hand, FGED encourages simulated data to have the same feature relationship structure as the corresponding measured data to reduce their distribution discrepancy in short-term incremental learning. On the other hand, FGED adopts a feature distillation strategy to simultaneously reduce the distribution discrepancy accumulation of previous incremental classes and alleviate the catastrophic forgetting in long-term incremental learning. Experimental results obtained on the MSTAR benchmark dataset and two simulated datasets demonstrate the effectiveness of FGED.
- 27 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-17
Simulated Data Feature Guided Evolution and Distillation for Incremental SAR ATR
Deep neural network (DNN) based Synthetic aperture radar automatic target recognition (SAR ATR) methods have made great progress in recent years. However, the performance of DNN models relies on a large number of independent and identically distributed measured SAR images, which is contrary to the SAR ATR in practice. Furthermore, DNN models also suffer from catastrophic forgetting when learning a sequence of new classes. To tackle these problems, we introduce simulated data into the class incremental learning of SAR ATR for the first time. Specifically, we aim to continuously learn a sequence of new classes with a small amount of measured data and a large amount of simulated data. We first investigate the properties of incremental learning using simulated data, and the main observation is that simulated data can achieve good performance in short-term incremental learning rather than long-term incremental learning. A novel class incremental learning method, namely, feature guided evolution and distillation (FGED), is then presented. On the one hand, FGED encourages simulated data to have the same feature relationship structure as the corresponding measured data to reduce their distribution discrepancy in short-term incremental learning. On the other hand, FGED adopts a feature distillation strategy to simultaneously reduce the distribution discrepancy accumulation of previous incremental classes and alleviate the catastrophic forgetting in long-term incremental learning. Experimental results obtained on the MSTAR benchmark dataset and two simulated datasets demonstrate the effectiveness of FGED.
- Open Access
- 25 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 13602-13615
Simulated Data-Guided Incremental SAR ATR Through Feature Aggregation
Applying synthetic aperture radar automatic target recognition (SAR ATR) in open scenario based on deep learning (DL) is challenging due to the difficulty in incrementally recognizing new targets with limited samples. To address this challenge, we introduce simulated data that reflects the structure and scattering features of the new target to supplement measured data for better performance, and then, we propose a novel class incremental SAR ATR method guided by simulated data through feature aggregation (SGFA). Due to the gap between simulated and measured data, DL-model prefers extracting simulated-specific features in incremental learning, resulting in misclassification of new targets. In order to avoid the bias learning of simulated data, SGFA utilizes feature aggregation to extract scattering and structural features that are present in both simulated and measured images, which consists of measured data-anchored mini-batch construction strategy (MDA) and feature-level contrastive loss. Specifically, the MDA can reduce the high sampling probability of a large number of simulated samples in each mini-batch. The feature-level contrastive loss can aggregate the feature distributions of simulated and measured data, which is obtained by automatically constructing sample pairs through cyclic shifts of feature vectors in the mini-batch. In addition, a small amount portion of simulated data is retained to resist severe forgetting caused by the difficulty of adequately representing the data distribution with limited measured data. The experiments on SAMPLE dataset demonstrate the effectiveness of the proposed method.
- 25 June 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 13602-13615
Open AccessSimulated Data-Guided Incremental SAR ATR Through Feature Aggregation
Applying synthetic aperture radar automatic target recognition (SAR ATR) in open scenario based on deep learning (DL) is challenging due to the difficulty in incrementally recognizing new targets with limited samples. To address this challenge, we introduce simulated data that reflects the structure and scattering features of the new target to supplement measured data for better performance, and then, we propose a novel class incremental SAR ATR method guided by simulated data through feature aggregation (SGFA). Due to the gap between simulated and measured data, DL-model prefers extracting simulated-specific features in incremental learning, resulting in misclassification of new targets. In order to avoid the bias learning of simulated data, SGFA utilizes feature aggregation to extract scattering and structural features that are present in both simulated and measured images, which consists of measured data-anchored mini-batch construction strategy (MDA) and feature-level contrastive loss. Specifically, the MDA can reduce the high sampling probability of a large number of simulated samples in each mini-batch. The feature-level contrastive loss can aggregate the feature distributions of simulated and measured data, which is obtained by automatically constructing sample pairs through cyclic shifts of feature vectors in the mini-batch. In addition, a small amount portion of simulated data is retained to resist severe forgetting caused by the difficulty of adequately representing the data distribution with limited measured data. The experiments on SAMPLE dataset demonstrate the effectiveness of the proposed method.
- Open Access
- 8 June 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (12) , 3007
Adversarial Robustness Enhancement of UAV-Oriented Automatic Image Recognition Based on Deep Ensemble Models
Deep neural networks (DNNs) have been widely utilized in automatic visual navigation and recognition on modern unmanned aerial vehicles (UAVs), achieving state-of-the-art performances. However, DNN-based visual recognition systems on UAVs show serious vulnerability to adversarial camouflage patterns on targets and well-designed imperceptible perturbations in real-time images, which poses a threat to safety-related applications. Considering a scenario in which a UAV is suffering from adversarial attack, in this paper, we investigate and construct two ensemble approaches with CNN and transformer for both proactive (i.e., generate robust models) and reactive (i.e., adversarial detection) adversarial defense. They are expected to be secure under attack and adapt to the resource-limited environment on UAVs. Specifically, the probability distributions of output layers from base DNN models in the ensemble are combined in the proactive defense, which mainly exploits the weak adversarial transferability between the CNN and transformer. For the reactive defense, we integrate the scoring functions of several adversarial detectors with the hidden features and average the output confidence scores from ResNets and ViTs as a second integration. To verify their effectiveness in the recognition task of remote sensing images, we conduct experiments on both optical and synthetic aperture radar (SAR) datasets. We find that the ensemble model in proactive defense performs as well as three popular counterparts, and both of the ensemble approaches can achieve much more satisfactory results than a single base model/detector, which effectively alleviates adversarial vulnerability without extra re-training. In addition, we establish a one-stop platform for conveniently evaluating adversarial robustness and performing defense on recognition models called AREP-RSIs, which is beneficial for the future research of the remote sensing field.
- 8 June 2023
- Published by MDPI AG in Remote Sensing
- Vol. 15 (12) , 3007
Open AccessAdversarial Robustness Enhancement of UAV-Oriented Automatic Image Recognition Based on Deep Ensemble Models
Deep neural networks (DNNs) have been widely utilized in automatic visual navigation and recognition on modern unmanned aerial vehicles (UAVs), achieving state-of-the-art performances. However, DNN-based visual recognition systems on UAVs show serious vulnerability to adversarial camouflage patterns on targets and well-designed imperceptible perturbations in real-time images, which poses a threat to safety-related applications. Considering a scenario in which a UAV is suffering from adversarial attack, in this paper, we investigate and construct two ensemble approaches with CNN and transformer for both proactive (i.e., generate robust models) and reactive (i.e., adversarial detection) adversarial defense. They are expected to be secure under attack and adapt to the resource-limited environment on UAVs. Specifically, the probability distributions of output layers from base DNN models in the ensemble are combined in the proactive defense, which mainly exploits the weak adversarial transferability between the CNN and transformer. For the reactive defense, we integrate the scoring functions of several adversarial detectors with the hidden features and average the output confidence scores from ResNets and ViTs as a second integration. To verify their effectiveness in the recognition task of remote sensing images, we conduct experiments on both optical and synthetic aperture radar (SAR) datasets. We find that the ensemble model in proactive defense performs as well as three popular counterparts, and both of the ensemble approaches can achieve much more satisfactory results than a single base model/detector, which effectively alleviates adversarial vulnerability without extra re-training. In addition, we establish a one-stop platform for conveniently evaluating adversarial robustness and performing defense on recognition models called AREP-RSIs, which is beneficial for the future research of the remote sensing field.
- Open Access
- 16 September 2022
- Published by MDPI AG in Remote Sensing
- Vol. 14 (18) , 4632
Multi-Source Remote Sensing Pretraining Based on Contrastive Self-Supervised Learning
SAR-optical images from different sensors can provide consistent information for scene classification. However, the utilization of unlabeled SAR-optical images in deep learning-based remote sensing image interpretation remains an open issue. In recent years, contrastive self-supervised learning (CSSL) methods have shown great potential for obtaining meaningful feature representations from massive amounts of unlabeled data. This paper investigates the effectiveness of CSSL-based pretraining models for SAR-optical remote-sensing classification. Firstly, we analyze the contrastive strategies of single-source and multi-source SAR-optical data augmentation under different CSSL architectures. We find that the CSSL framework without explicit negative sample selection naturally fits the multi-source learning problem. Secondly, we find that the registered SAR-optical images can guide the Siamese self-supervised network without negative samples to learn shared features, which is also the reason why the CSSL framework outperforms the CSSL framework with negative samples. Finally, we apply the CSSL pretrained network without negative samples that can learn the shared features of SAR-optical images to the downstream domain adaptation task of optical transfer to SAR images. We find that the choice of a pretrained network is important for downstream tasks.
- 16 September 2022
- Published by MDPI AG in Remote Sensing
- Vol. 14 (18) , 4632
Open AccessMulti-Source Remote Sensing Pretraining Based on Contrastive Self-Supervised Learning
SAR-optical images from different sensors can provide consistent information for scene classification. However, the utilization of unlabeled SAR-optical images in deep learning-based remote sensing image interpretation remains an open issue. In recent years, contrastive self-supervised learning (CSSL) methods have shown great potential for obtaining meaningful feature representations from massive amounts of unlabeled data. This paper investigates the effectiveness of CSSL-based pretraining models for SAR-optical remote-sensing classification. Firstly, we analyze the contrastive strategies of single-source and multi-source SAR-optical data augmentation under different CSSL architectures. We find that the CSSL framework without explicit negative sample selection naturally fits the multi-source learning problem. Secondly, we find that the registered SAR-optical images can guide the Siamese self-supervised network without negative samples to learn shared features, which is also the reason why the CSSL framework outperforms the CSSL framework with negative samples. Finally, we apply the CSSL pretrained network without negative samples that can learn the shared features of SAR-optical images to the downstream domain adaptation task of optical transfer to SAR images. We find that the choice of a pretrained network is important for downstream tasks.
- Open Access
- 17 October 2021
- Published by MDPI AG in Remote Sensing
- Vol. 13 (20) , 4158
Adversarial Self-Supervised Learning for Robust SAR Target Recognition
Synthetic aperture radar (SAR) can perform observations at all times and has been widely used in the military field. Deep neural network (DNN)-based SAR target recognition models have achieved great success in recent years. Yet, the adversarial robustness of these models has received far less academic attention in the remote sensing community. In this article, we first present a comprehensive adversarial robustness evaluation framework for DNN-based SAR target recognition. Both data-oriented metrics and model-oriented metrics have been used to fully assess the recognition performance under adversarial scenarios. Adversarial training is currently one of the most successful methods to improve the adversarial robustness of DNN models. However, it requires class labels to generate adversarial attacks and suffers significant accuracy dropping on testing data. To address these problems, we introduced adversarial self-supervised learning into SAR target recognition for the first time and proposed a novel unsupervised adversarial contrastive learning-based defense method. Specifically, we utilize a contrastive learning framework to train a robust DNN with unlabeled data, which aims to maximize the similarity of representations between a random augmentation of a SAR image and its unsupervised adversarial example. Extensive experiments on two SAR image datasets demonstrate that defenses based on adversarial self-supervised learning can obtain comparable robust accuracy over state-of-the-art supervised adversarial learning methods.
- 17 October 2021
- Published by MDPI AG in Remote Sensing
- Vol. 13 (20) , 4158
Open AccessAdversarial Self-Supervised Learning for Robust SAR Target Recognition
Synthetic aperture radar (SAR) can perform observations at all times and has been widely used in the military field. Deep neural network (DNN)-based SAR target recognition models have achieved great success in recent years. Yet, the adversarial robustness of these models has received far less academic attention in the remote sensing community. In this article, we first present a comprehensive adversarial robustness evaluation framework for DNN-based SAR target recognition. Both data-oriented metrics and model-oriented metrics have been used to fully assess the recognition performance under adversarial scenarios. Adversarial training is currently one of the most successful methods to improve the adversarial robustness of DNN models. However, it requires class labels to generate adversarial attacks and suffers significant accuracy dropping on testing data. To address these problems, we introduced adversarial self-supervised learning into SAR target recognition for the first time and proposed a novel unsupervised adversarial contrastive learning-based defense method. Specifically, we utilize a contrastive learning framework to train a robust DNN with unlabeled data, which aims to maximize the similarity of representations between a random augmentation of a SAR image and its unsupervised adversarial example. Extensive experiments on two SAR image datasets demonstrate that defenses based on adversarial self-supervised learning can obtain comparable robust accuracy over state-of-the-art supervised adversarial learning methods.