Integrating Segment Anything Model With Instance-Level Change Generation for Single-Temporal Unsupervised Change Detection
- 4 July 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-17
Abstract
Implementing change detection (CD) with bi-temporal remote sensing images (RSIs) is essential for gaining insights into the dynamic evolution of the Earth’s surface. Recent advancements in deep learning methodologies have demonstrated considerable success in CD applications. However, the efficacy of supervised CD networks is significantly constrained by their dependence on high-quality change labels and precisely registered bi-temporal RSIs, which imposes significant limitations in real-world scenarios. To address this issue, we propose a novel single-temporal unsupervised CD method, STU-SAMI, which integrates the Segment Anything Model (SAM) with instance-level change generation. This method aims to facilitate the training of high-performance CD networks using unpaired and unlabeled single-temporal RSIs. The proposed approach comprises three main steps. First, the SAM is introduced to extract morphologically complete object instances from single-temporal RSIs. Second, an online instance-level change generation method is proposed, which transforms single-temporal RSIs into bi-temporal pseudo change samples based on the object instances obtained by SAM. Third, a streamlined and efficient deep Siamese CD network is constructed to support the training and inference processes. Extensive experiments conducted on three benchmark datasets demonstrate that the proposed method outperforms the existing state-of-the-art unsupervised CD methods. The code is available at https://github.com/IceStreams/STU-SAMI.Keywords
Funding Information
- National Natural Science Foundation of China (42201443)
This publication has 56 references indexed in Scilit:
- Unsupervised change detection based on image reconstruction loss with segment anythingRemote Sensing Letters, 2024
- A building change detection framework with patch-pairing single-temporal supervised learning and metric guided attention mechanismInternational Journal of Applied Earth Observation and Geoinformation, 2024
- Exchange means change: An unsupervised single-temporal change detection framework based on intra- and inter-image patch exchangeISPRS Journal of Photogrammetry and Remote Sensing, 2023
- The Segment Anything Model (SAM) for remote sensing applications: From zero to one shotInternational Journal of Applied Earth Observation and Geoinformation, 2023
- A multiscale graph convolutional network for change detection in homogeneous and heterogeneous remote sensing imagesInternational Journal of Applied Earth Observation and Geoinformation, 2021
- A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Empirical Risk Minimization2017
- Unsupervised change detection in VHR remote sensing imagery – an object-based clustering approach in a dynamic urban environmentInternational Journal of Applied Earth Observation and Geoinformation, 2017
- Deep Residual Learning for Image Recognition2016
- Automatic analysis of the difference image for unsupervised change detectionIEEE Transactions on Geoscience and Remote Sensing, 2000