A Divided Spatial and Temporal Context Network for Remote Sensing Change Detection
Open Access
- 23 May 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 15 (19391404) , 4897-4908
Abstract
In recent days, change detection has become one of the central tasks for remote sensing image analyses. Due to the powerful discriminative abilities, various convolutional based approaches have been applied and shown favorable performance in change detection. However, these approaches either require numerous parameters to obtain refined features or cannot make full use of the global context information, which is crucial for change detection. Motivated by the recently proposed visual transformers, we introduce a divided spatial and temporal context modeling network to tackle such shortcomings, which is tokens-based and passes the global context by well modeled tokens. Specifically, to model the spatial context, we first use a spatial self-attention to make each token implicitly incorporate the spatial information of the corresponding image. Then a followed temporal selfattention is used to model the temporal context. Together with the spatial self-attention, it makes the learned tokens contain the global context and become more representational and suitable for change detection. Finally, a prediction head is used to output change detection results over the token space without additional transformer decoder or skip connections between features and tokens, thus reducing the model parameters and computational costs. Thanks to the superior global context modeling capabilities of the proposed method, we further develop a simplified variant with much smaller parameters but only a slight drop in F1 and IoU scores. Our proposed method has shown competitive performance and surpasses several state-of-the-art methods according to our experiments. Our model and code will be available at https://github.com/shinianzhihou/ChangeDetection.Keywords
This publication has 31 references indexed in Scilit:
- Street-view change detection with deconvolutional networksAutonomous Robots, 2018
- Change Detection Based on Deep Siamese Convolutional Network for Optical Aerial ImagesIEEE Geoscience and Remote Sensing Letters, 2017
- Zoom out CNNs features for optical remote sensing change detection2017
- Deep Residual Learning for Image Recognition2016
- Toward a Generalizable Image Representation for Large-Scale Change Detection: Application to Generic Damage AnalysisIEEE Transactions on Geoscience and Remote Sensing, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Change Detection from a Street Image Pair using CNN Features and Superpixel Segmentation2015
- Continuous change detection and classification of land cover using all available Landsat dataRemote Sensing of Environment, 2014
- Land-cover change detection using multi-temporal MODIS NDVI dataRemote Sensing of Environment, 2006
- Review Article Digital change detection techniques using remotely-sensed dataInternational Journal of Remote Sensing, 1989