MSCD-Net: From Unimodal to Multimodal Semantic Change Detection
- 23 July 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 63 (01962892) , 1-17
Abstract
Semantic change detection (SCD) involves temporal changes and spatial semantics. Its working principle and processing flow usually include land semantic segmentation (LSS) and binary change detection (BCD). Due to its significant impact and practical value, SCD has received consistently wide attention in Earth observation. Nowadays, remote sensing data in various modalities are proliferating, calling for an urgent need to develop intelligent algorithms for multimodal remote sensing data. However, no efficient multimodal SCD methods exist currently. To address this limitation, this work proposes the first deep learning-based multimodal SCD method: MSCD-Net. MSCD-Net extracts multi-scale semantic and difference features after fusing multimodal features, and then aggregates and refines these features to output high-quality semantic segmentation and change maps. Additionally, a semantic difference decoder (SDD) module is designed to model semantic and difference features jointly. It can be integrated with existing methods to increase accuracy. Experimental results demonstrate that MSCD-Net achieves state-of-the-art performance on both multimodal and unimodal SCD datasets, and SDD has strong feature learning ability and compatibility. These findings imply that MSCD-Net is expected to promote the development and application of multimodal SCD.Keywords
Funding Information
- Open Fund of Hubei Luojia Laboratory (220100053)
- State Scholarship Fund of China
- Science and Technology Major Project of Hubei Province (2021AAA010)
- National Natural Science Foundation of China (42371451, 42394061)
This publication has 81 references indexed in Scilit:
- TSTD:A Cross-modal Two Stages Network with New Trans-decoder for Point Cloud Semantic Segmentation2023
- A 2D/3D multimodal data simulation approach with applications on urban semantic segmentation, building extraction and change detectionISPRS Journal of Photogrammetry and Remote Sensing, 2023
- Temporal-agnostic change region proposal for semantic change detectionISPRS Journal of Photogrammetry and Remote Sensing, 2023
- Building Instance Change Detection from High Spatial Resolution Remote Sensing Images Using Improved Instance Segmentation ArchitectureJournal of the Indian Society of Remote Sensing, 2022
- FCCDN: Feature constraint network for VHR image change detectionISPRS Journal of Photogrammetry and Remote Sensing, 2022
- Structured graph based image regression for unsupervised multimodal change detectionISPRS Journal of Photogrammetry and Remote Sensing, 2022
- ChangeMask: Deep multi-task encoder-transformer-decoder architecture for semantic change detectionISPRS Journal of Photogrammetry and Remote Sensing, 2022
- Robust unsupervised small area change detection from SAR imagery using deep learningISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Multitask learning for large-scale semantic change detectionComputer Vision and Image Understanding, 2019
- Robust Change Vector Analysis (RCVA) for multi-sensor very high resolution optical satellite dataInternational Journal of Applied Earth Observation and Geoinformation, 2016