MapFormer: Boosting Change Detection by Using Pre-change Information
Preprint
Abstract
Change detection in remote sensing imagery is essential for a variety of applications such as urban planning, disaster management, and climate research. However, existing methods for identifying semantically changed areas overlook the availability of semantic information in the form of existing maps describing features of the earth's surface. In this paper, we leverage this information for change detection in bi-temporal images. We show that the simple integration of the additional information via concatenation of latent representations suffices to significantly outperform state-of-the-art change detection methods. Motivated by this observation, we propose the new task of *Conditional Change Detection*, where pre-change semantic information is used as input next to bi-temporal images. To fully exploit the extra information, we propose *MapFormer*, a novel architecture based on a multi-modal feature fusion module that allows for feature processing conditioned on the available semantic information. We further employ a supervised, cross-modal contrastive loss to guide the learning of visual representations. Our approach outperforms existing change detection methods by an absolute 11.7\% and 18.4\% in terms of binary change IoU on DynamicEarthNet and HRSCD, respectively. Furthermore, we demonstrate the robustness of our approach to the quality of the pre-change semantic information and the absence pre-change imagery. The code is available at https://github.com/mxbh/mapformer.Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Changer: Feature Interaction is What You Need for Change DetectionIEEE Transactions on Geoscience and Remote Sensing, 2023
- Feature Hierarchical Differentiation for Remote Sensing Image Change DetectionIEEE Geoscience and Remote Sensing Letters, 2022
- A Divided Spatial and Temporal Context Network for Remote Sensing Change DetectionIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022
- SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR ImagesIEEE Geoscience and Remote Sensing Letters, 2021
- A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Deep Learning for Change Detection in Remote Sensing Images: Comprehensive Review and Meta-AnalysisIEEE Access, 2020
- A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change DetectionRemote Sensing, 2020
- Pervasive human-driven decline of life on Earth points to the need for transformative changeScience, 2019
- Semantic Segmentation-Based Building Footprint Extraction Using Very High-Resolution Satellite Images and Multi-Source GIS DataRemote Sensing, 2019
- Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data SetIEEE Transactions on Geoscience and Remote Sensing, 2018