Generative Artificial Intelligence Meets Synthetic Aperture Radar: A survey
- 13 November 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Magazine
- Vol. 14 (1) , 6-48
Abstract
SAR images possess unique attributes that present challenges for both human observers and vision AI models to interpret, owing to their electromagnetic characteristics. The interpretation of SAR images encounters various hurdles, with one of the primary obstacles being the data itself, which includes issues related to both the quantity and quality of the data. The challenges can be addressed using generative AI technologies. Generative AI, often known as GenAI, is a very advanced and powerful technology in the field of artificial intelligence that has gained significant attention. The advancement has created possibilities for the creation of texts, photorealistic pictures, videos, and material in various modalities. This paper aims to comprehensively investigate the intersection of GenAI and SAR. First, we illustrate the common data generation-based applications in SAR field and compare them with computer vision tasks, analyzing the similarity, difference, and general challenges of them. Then, an overview of the latest GenAI models is systematically reviewed, including various basic models and their variations targeting the general challenges. Additionally, the corresponding applications in SAR domain are also included. Specifically, we propose to summarize the physical model based simulation approaches for SAR, and analyze the hybrid modeling methods that combine the GenAI and interpretable models. The evaluation methods that have been or could be applied to SAR, are also explored. Finally, the potential challenges and future prospects are discussed. To our best knowledge, this survey is the first exhaustive examination of the interdiscipline of SAR and GenAI, encompassing a wide range of topics, including deep neural networks, physical models, computer vision, and SAR images.Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62101459)
This publication has 263 references indexed in Scilit:
- SAR Image Authentic Assessment with Bayesian Deep Learning and Counterfactual Explanations2023
- SAR image generation method for oriented ship detection via generative adversarial networksSignal, Image and Video Processing, 2023
- Application of deep generative networks for SAR/ISAR: a reviewArtificial Intelligence Review, 2023
- DeltaGAN: Towards Diverse Few-Shot Image Generation with Sample-Specific Delta2022
- A deep translation (GAN) based change detection network for optical and SAR remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Reciprocal translation between SAR and optical remote sensing images with cascaded-residual adversarial networksScience China Information Sciences, 2021
- FUSAR-Ship: building a high-resolution SAR-AIS matchup dataset of Gaofen-3 for ship detection and recognitionScience China Information Sciences, 2020
- Deep SAR-Net: Learning objects from signalsISPRS Journal of Photogrammetry and Remote Sensing, 2020
- A residual convolutional neural network for polarimetric SAR image super-resolutionISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Potentials and limitations of SAR image simulators – A comparative study of three simulation approachesISPRS Journal of Photogrammetry and Remote Sensing, 2015