Dual-Dimension Feature Interaction for Semantic Change Detection in Remote Sensing Images
Open Access
- 29 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 17 (19391404) , 9595-9605
Abstract
Remote sensing semantic change detection (SCD) involves extracting information about changes in land cover/land use (LCLU) within the same area at different times. This issue is of crucial significance in many Earth observation tasks, such as precise urban planning and natural resource management. However, the current methods primarily focus on spatial feature extraction, lacking awareness of temporal features. Consequently, there are challenges in extracting change features, making distinguishing intraclass and interclass differences difficult. This also contributes to pseudochange, posing challenges for SCD tasks. To overcome the limitations of existing methods, we present a dual-dimension feature interaction network (DFINet) for SCD. First, to enhance the assessment and perceptual abilities related to intraclass and interclass differences, we introduce a temporal difference feature enhancement (TDFE) module. This module comprehensively captures features from the temporal dimension. Then, to address the interrelation between multitemporal and multilevel features, we investigate the feature selection interaction (FSIA) and interaction attention modules (IAM), which enable multidimensional deep fusion and interaction of change features. This enhances the capacity for information transfer and integration among the features within multitemporal remote sensing images (RSIs). The experimental results demonstrate that, compared to existing methods, the proposed architecture achieves a significant improvement in accuracy. Additionally, the design enhancements added to DFINet boost the practicality of remote sensing SCD, underscoring its substantial research value.Keywords
Funding Information
- National Natural Science Foundation of China (41901282, 42101381, 41971311)
- International Science and Technology Cooperation Special (202104b11020022)
- Natural Science Foundation of Anhui Province (2308085MD126)
- Hefei Municipal Natural Science Foundation (202323)
- Natural Resources Science and Technology Program of Anhui Province (2023-K-7)
This publication has 50 references indexed in Scilit:
- FCCDN: Feature constraint network for VHR image change detectionISPRS Journal of Photogrammetry and Remote Sensing, 2022
- SCDNET: A novel convolutional network for semantic change detection in high resolution optical remote sensing imageryInternational Journal of Applied Earth Observation and Geoinformation, 2021
- Object-level change detection with a dual correlation attention-guided detectorISPRS Journal of Photogrammetry and Remote Sensing, 2021
- CLNet: Cross-layer convolutional neural network for change detection in optical remote sensing imageryISPRS Journal of Photogrammetry and Remote Sensing, 2021
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based LocalizationInternational Journal of Computer Vision, 2019
- Multitask learning for large-scale semantic change detectionComputer Vision and Image Understanding, 2019
- A Framework for the Long-term Monitoring of Urban Green Volume Based on Multi-temporal and Multi-sensoral Remote Sensing DataJournal of Geovisualization and Spatial Analysis, 2019
- BiSeNet: Bilateral Segmentation Network for Real-Time Semantic Segmentation2018
- UNet++: A Nested U-Net Architecture for Medical Image Segmentation2018
- Change Detection Using Adaptive Fuzzy Neural NetworksRemote Sensing of Environment, 1999