Mask Approximation Net: Merging Feature Extraction and Distribution Learning for Remote Sensing Change Captioning
Authors:
- Dongwei SunDSDongwei Sun
- Xiangyong CaoXCXiangyong Cao
Preprint
Abstract
Remote sensing image change description, as a novel multimodal task in the field of remote sensing processing, not only enables the detection of changes in surface conditions but also provides detailed descriptions of these changes, thereby enhancing human interpretability and interactivity. However, previous methods mainly employed Convolutional Neural Network (CNN) architectures to extract bitemporal image features. This approach often leads to an overemphasis on designing specific network architectures and limits the captured feature distributions to the current dataset, resulting in poor generalizability and robustness when applied to other datasets or real-world scenarios. To address these limitations, this paper proposes a novel approach for remote sensing image change detection and description that integrates diffusion models, aiming to shift the focus from conventional feature learning paradigms to data distribution learning. The proposed method primarily includes a simple multi-scale change detection module, whose output features are subsequently refined using a diffusion model. Additionally, we introduce a frequency-guided complex filter module to handle high-frequency noise during the diffusion process, which helps to maintain model performance. Finally, we validate the effectiveness of our proposed method on several remote sensing change detection description datasets, demonstrating its superior performance. The code available at MaskApproxNet.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- A Lightweight Sparse Focus Transformer for Remote Sensing Image Change CaptioningIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024
- Change-Agent: Toward Interactive Comprehensive Remote Sensing Change Interpretation and AnalysisIEEE Transactions on Geoscience and Remote Sensing, 2024
- Single-Stream Extractor Network With Contrastive Pre-Training for Remote-Sensing Change CaptioningIEEE Transactions on Geoscience and Remote Sensing, 2024
- GCD-DDPM: A Generative Change Detection Model Based on Difference-Feature-Guided DDPMIEEE Transactions on Geoscience and Remote Sensing, 2024
- CD-GAN: A robust fusion-based generative adversarial network for unsupervised remote sensing change detection with heterogeneous sensorsInformation Fusion, 2024
- A Decoupling Paradigm With Prompt Learning for Remote Sensing Image Change CaptioningIEEE Transactions on Geoscience and Remote Sensing, 2023
- Remote Sensing Image Change Captioning With Dual-Branch Transformers: A New Method and a Large Scale DatasetIEEE Transactions on Geoscience and Remote Sensing, 2022
- Change Captioning: A New Paradigm for Multitemporal Remote Sensing Image AnalysisIEEE Transactions on Geoscience and Remote Sensing, 2022
- Unsupervised Change Detection in Satellite Images With Generative Adversarial NetworkIEEE Transactions on Geoscience and Remote Sensing, 2020
- Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data SetIEEE Transactions on Geoscience and Remote Sensing, 2018