A New Semisupervised Method for Detecting Semantic Changes in Remote Sensing Images
Authors:
- 1 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Geoscience and Remote Sensing Letters
- Vol. 20 (1545598X) , 1-5
Abstract
The growing availability of high-quality remote sensing imagery has led to increased interest in semantic change detection. Supervised methods for this task have shown significant performance improvements, but acquiring labeled data is often challenging and expensive. To confront this challenge, we propose a semi-supervised approach for semantic change detection in remote sensing images using an innovative teacher-student model. We use a convolutional neural network (CNN) in the teacher model and a fusion design combining CNN and vision transformer in the student model, with the rationale that CNN require fewer training samples compared to vision transformer and fusion network allows us to leverage the advantages of both. To further enhance the model’s performance, we propose a novel data augmentation approach by interchanging bitemporal images as well as their labels. The principle for that is the change from one moment to another and vice versa are two different changes and can therefore be used to augment the training dataset. More importantly, this method does not reduce its reliability because no noise is brought to the remote sensing images. By adopting this approach, we are able to better utilize the small labeled dataset to increase the precision of the model while maintaining the robustness. According to the experimental results, the proposed method outperforms several state-of-the-art methods and achieves an improvement compared to Bi-SRNet in mIoU/SeK/OA of 3.25/4.42/1.78, 6.37/11.72/2.91 on the SECOND and Landsat-SCD dataset, respectively.Keywords
Funding Information
- National Natural Science Foundation of China (62076065)
- Natural Science Foundation of Fujian Province (2021J01611)
- Development Program of Fuzhou University (GXRC-21007)
- Development Program of Fuzhou University (XRC-18080)
This publication has 16 references indexed in Scilit:
- A transformer-based Siamese network and an open optical dataset for semantic change detection of remote sensing imagesInternational Journal of Digital Earth, 2022
- SemiSANet: A Semi-Supervised High-Resolution Remote Sensing Image Change Detection Model Using Siamese Networks with Graph AttentionRemote Sensing, 2022
- Spatially and Semantically Enhanced Siamese Network for Semantic Change Detection in High-Resolution Remote Sensing ImagesIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022
- Bi-Temporal Semantic Reasoning for the Semantic Change Detection in HR Remote Sensing ImagesIEEE Transactions on Geoscience and Remote Sensing, 2022
- ChangeMask: Deep multi-task encoder-transformer-decoder architecture for semantic change detectionISPRS Journal of Photogrammetry and Remote Sensing, 2022
- Asymmetric Siamese Networks for Semantic Change Detection in Aerial ImagesIEEE Transactions on Geoscience and Remote Sensing, 2021
- Dual-Task Semantic Change Detection for Remote Sensing Images Using the Generative Change Field ModuleRemote Sensing, 2021
- More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2020
- Graph Convolutional Networks for Hyperspectral Image ClassificationIEEE Transactions on Geoscience and Remote Sensing, 2020
- An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral UnmixingIEEE Transactions on Image Processing, 2018