DS-HyFA-Net: A Deeply Supervised Hybrid Feature Aggregation Network With Multiencoders for Change Detection in High-Resolution Imagery
- 8 October 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-17
Abstract
With the advancement of deep learning (DL) technologies, remarkable progress has been achieved in change detection (CD). Existing DL-based methods primarily focus on the discrepancy in bitemporal images, while overlooking the commonality in bitemporal images. However, one of the reasons hindering the improvement of CD performance is the inadequate utilization of image information. To address the above issue, we propose a Deeply Supervised Hybrid Feature Aggregation Network (DS-HyFA-Net). This network predicts changes by integrating the distinctness and the commonality in bitemporal images. Specifically, the DS-HyFA-Net primarily consists of a set of encoders and a Hybrid Feature Aggregation (HyFA) module. It uses a Siamese encoder (or Encoder I) and a specialized encoder (or Encoder II) to extract distinct and common features in bitemporal images, respectively. The HyFA module efficiently aggregates distinct and common features (or hybrid features) and generates a change map using a predictor. In addition, a common feature learning strategy (CFLS) is introduced, based on deeply supervised (DS) techniques, to guide Encoder II in learning common features. Experimental results on three well-recognized datasets demonstrate the effectiveness of the innovative DS-HyFA-Net, achieving F1-Scores of 93.33% on WHU-CD, 90.98% on LEVIR-CD, and 81.14% on SYSU-CD. Our code is available at https://github.com/yikuizhai/DS-HyFA-Net.Keywords
Funding Information
- Guangdong Basic and Applied Basic Research Foundation (2021A1515011576)
- Guangdong Science and Technology Planning Project (2021A0505030080, 2021A0505060011)
- Guangdong Higher Education Innovation and Strengthening School Project (2020ZDZX3031, 2022ZDZX1032, 2023ZDZX1029, 2024ZDZX1009)
- Wuyi University Hong Kong and Macao Joint Research and Development Fund (2022WGALH19)
- Guangdong Jiangmen Science and Technology Research Project (2220002000246, 2023760300070008390)
This publication has 60 references indexed in Scilit:
- Change detection on multi-sensor imagery using mixed interleaved group convolutional networkEngineering Applications of Artificial Intelligence, 2024
- Double U-Net (W-Net): A change detection network with two heads for remote sensing imageryInternational Journal of Applied Earth Observation and Geoinformation, 2023
- DSA-Net: A novel deeply supervised attention-guided network for building change detection in high-resolution remote sensing imagesInternational Journal of Applied Earth Observation and Geoinformation, 2021
- A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2020
- CBAM: Convolutional Block Attention Module2018
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017
- A post-classification change detection method based on iterative slow feature analysis and Bayesian soft fusionRemote Sensing of Environment, 2017
- Deep Residual Learning for Image Recognition2016
- Multi-metric learning for multi-sensor fusion based classificationInformation Fusion, 2013
- Comparison of time series tasseled cap wetness and the normalized difference moisture index in detecting forest disturbancesRemote Sensing of Environment, 2005