SDCAFNet: A Deep Convolutional Neural Network for Land-Cover Semantic Segmentation With the Fusion of PolSAR and Optical Images
Open Access
- 11 October 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 15 (19391404) , 8928-8942
Abstract
Due to the different imaging mechanisms between optical and polarimetric synthetic aperture radar (PolSAR) images, determining how to effectively use such complementary information has become an interesting and challenging problem. Convolutional neural networks (CNNs) and other deep neural networks have achieved good experimental results in remote sensing land-cover semantic segmentation. However, the CNN convolution structure can extract only the features within the receptive field in the spatial dimension without focusing on the relationship between multiple channels; therefore, it is impossible to realize fusion and complementarity between multiple channels. In this article, we propose a novel spatial dense channel attention fusion network (SDCAFNet), which takes optical and PolSAR images as different inputs and completes feature fusion and semantic segmentation within a neural network. First, SDCAFNet uses a two-stream siamese CNN network to realize the preliminary feature coding of optical and PolSAR images. Then, a spatial dense channel attention module (SDCAM) is proposed. The channel activation values obtained at different positions are combined in the spatial dense matrix, which can describe the attention in the feature fusion process. Finally, we introduce the fused features into the symmetric skip-connection decoder composed of multiple symmetric decoder blocks to realize end-to-end land-cover semantic segmentation. Experimental results show that SDCAFNet can effectively learn the correlation between optical and PolSAR channels and has a better segmentation accuracy than other methods.Keywords
Funding Information
- S&T Program of Hebei (21340302D)
- Foundation of the CETC Key Laboratory of Aerospace Information Applications (SCX20629T007)
This publication has 46 references indexed in Scilit:
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Multimodal Classification of Remote Sensing Images: A Review and Future DirectionsProceedings of the IEEE, 2015
- Learning acoustic frame labeling for speech recognition with recurrent neural networks2015
- Improved differential box counting with multi-scale and multi-direction: A new palmprint recognition methodOptik, 2014
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Optical and SAR sensor synergies for forest and land cover mapping in a tropical site in West AfricaInternational Journal of Applied Earth Observation and Geoinformation, 2013
- Assessment of spectral, polarimetric, temporal, and spatial dimensions for urban and peri-urban land cover classification using Landsat and SAR dataRemote Sensing of Environment, 2012
- Fusion of Quickbird MS and RADARSAT SAR data for urban land-cover mapping: object-based and knowledge-based approachInternational Journal of Remote Sensing, 2010
- Fusing high-resolution SAR and optical imagery for improved urban land cover study and classificationInternational Journal of Image and Data Fusion, 2010
- Polarimetric SAR characterization of man-made structures in urban areas using normalized circular-pol correlation coefficientsRemote Sensing of Environment, 2008