Adaptive Fusion NestedUNet for Change Detection Using Optical Remote Sensing Images
Open Access
- 7 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 16 (19391404) , 5374-5386
Abstract
Change detection (CD) is a major topic in remote sensing research. Deep learning (DL) based CD methods have made great progress. However, existing CD methods have difficulty in exploiting the different semantic and detailed information in deep and shallow features, which often leads to blurred target boundaries of identified changes. In addition, most CD methods based on the NestedUNet structure focus on improving accuracy, ignoring the importance of efficiency. Therefore, in this paper, an adaptive fusion NestedUNet for CD (AFNUNet) is proposed. AFNUNet compresses the model parameters and computational cost by using the encoder based on the inverted bottleneck structure and the decoder based on the depthwise convolution. The correlation between the final multi-level feature maps extracted by NestedUNet is difficult to model by summation or concatenation. Therefore, an attention mechanism-based adaptive fusion module (AFM) is proposed. The AFM allows the network to adaptively select feature information from the final different layers of features extracted from NestedUNet in both channel and spatial dimensions so that the fused features capture deep rich semantic information while retaining detailed information at shallow boundaries. Finally, a loss function based on the Bray-Curtis distance is introduced for suppressing the sample imbalance problem. Extensive experiments on the WHU-CD, LEVIR-CD, and SYSU-CD datasets demonstrate that AFNUNet surpasses several state-of-the-art (SOTA) CD methods in terms of effectiveness. Moreover, the proposed AFNUNet remarkably reduces Params and FLOPs by 63% and 70% compared to other NestedUNet-based CD models.Keywords
Funding Information
- Programs for Science and Technology Development of Henan Province, China (222102210004)
- Key Research Projects of the University in Henan Province, China (20B510001)
- Weinan Science and Technology (ZDYF-JCYJ-196)
This publication has 50 references indexed in Scilit:
- A new change-detection method in high-resolution remote sensing images based on a conditional random field modelInternational Journal of Remote Sensing, 2016
- Change Detection in Synthetic Aperture Radar Images Based on Deep Neural NetworksIEEE Transactions on Neural Networks and Learning Systems, 2015
- Building Change Detection in Multitemporal Very High Resolution SAR ImagesIEEE Transactions on Geoscience and Remote Sensing, 2014
- Multi-Decadal Mangrove Forest Change Detection and Prediction in Honduras, Central America, with Landsat Imagery and a Markov Chain ModelRemote Sensing, 2013
- Change detection from remotely sensed images: From pixel-based to object-based approachesISPRS Journal of Photogrammetry and Remote Sensing, 2013
- Supervised change detection in VHR images using contextual information and support vector machinesInternational Journal of Applied Earth Observation and Geoinformation, 2013
- Forest change detection by statistical object-based methodRemote Sensing of Environment, 2006
- A Tutorial on the Cross-Entropy MethodAnnals of Operations Research, 2005
- Automatic analysis of the difference image for unsupervised change detectionIEEE Transactions on Geoscience and Remote Sensing, 2000
- Bray-Curtis Ordination: An Effective Strategy for Analysis of Multivariate Ecological Data1984