A Change Detection Method Based on Multi-Scale Adaptive Convolution Kernel Network and Multimodal Conditional Random Field for Multi-Temporal Multispectral Images
Open Access
- 26 October 2022
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 14 (21) , 5368
Abstract
Multispectral image change detection is an important application in the field of remote sensing. Multispectral images usually contain many complex scenes, such as ground objects with diverse scales and proportions, so the change detection task expects the feature extractor is superior in adaptive multi-scale feature learning. To address the above-mentioned problems, a multispectral image change detection method based on multi-scale adaptive kernel network and multimodal conditional random field (MSAK-Net-MCRF) is proposed. The multi-scale adaptive kernel network (MSAK-Net) extends the encoding path of the U-Net, and designs a weight-sharing bilateral encoding path, which simultaneously extracts independent features of bi-temporal multispectral images without introducing additional parameters. A selective convolution kernel block (SCKB) that can adaptively assign weights is designed and embedded in the encoding path of MSAK-Net to extract multi-scale features in images. MSAK-Net retains the skip connections in the U-Net, and embeds an upsampling module (UM) based on the attention mechanism in the decoding path, which can give the feature map a better expression of change information in both the channel dimension and the spatial dimension. Finally, the multimodal conditional random field (MCRF) is used to smooth the detection results of the MSAK-Net. Experimental results on two public multispectral datasets indicate the effectiveness and robustness of the proposed method when compared with other state-of-the-art methods.Keywords
Funding Information
- National Natural Science Foundation of China (62002083, 61971153, 62071136)
- Open Fund of State Key Laboratory of Remote Sensing Science (OFSLRSS202210)
- Natural Science Foundation of Heilongjiang Province (LH2021F012)
- Fundamental Research Funds for the Central Universities (3072021CFT0801, 3072022QBZ0805, 3072022CF0808)
This publication has 42 references indexed in Scilit:
- Road Extraction by Deep Residual U-NetIEEE Geoscience and Remote Sensing Letters, 2018
- Change Detection Based on Deep Features and Low RankIEEE Geoscience and Remote Sensing Letters, 2017
- Detecting Changes Between Optical Images of Different Spatial and Spectral Resolutions: A Fusion-Based ApproachIEEE Transactions on Geoscience and Remote Sensing, 2017
- High-Resolution Image Classification Integrating Spectral-Spatial-Location Cues by Conditional Random FieldsIEEE Transactions on Image Processing, 2016
- Going deeper with convolutions2015
- Unsupervised Change Detection in Multitemporal Multispectral Satellite Images Using Parallel Particle Swarm OptimizationIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015
- Conditional Random Fields for Multitemporal and Multiscale Classification of Optical Satellite ImageryIEEE Transactions on Geoscience and Remote Sensing, 2014
- Slow Feature Analysis for Change Detection in Multispectral ImageryIEEE Transactions on Geoscience and Remote Sensing, 2013
- A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar DomainIEEE Transactions on Geoscience and Remote Sensing, 2006
- Multivariate Alteration Detection (MAD) and MAF Postprocessing in Multispectral, Bitemporal Image Data: New Approaches to Change Detection StudiesRemote Sensing of Environment, 1998