SPNet: Dual-Branch Network with Spatial Supplementary Information for Building and Water Segmentation of Remote Sensing Images
Open Access
- 27 August 2024
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 16 (17) , 3161
Abstract
Semantic segmentation is primarily employed to generate accurate prediction labels for each pixel of the input image, and then classify the images according to the generated labels. Semantic segmentation of building and water in remote sensing images helps us to conduct reasonable land planning for a city. However, many current mature networks face challenges in simultaneously attending to both contextual and spatial information when performing semantic segmentation on remote sensing imagery. This often leads to misclassifications and omissions. Therefore, this paper proposes a Dual-Branch Network with Spatial Supplementary Information (SPNet) to address the aforementioned issues. We introduce a Context-aware Spatial Feature-Extractor Unit (CSF) to extract contextual and spatial information, followed by the Feature-Interaction Module (FIM) to supplement contextual semantic information with spatial details. Additionally, incorporating the Goal-Oriented Attention Mechanism helps in handling noise. Finally, to obtain more detailed branches, a Multichannel Deep Feature-Extraction Module (MFM) is introduced to extract features from shallow-level network layers. This branch guides the fusion of low-level semantic information with high-level semantic information. Experiments were conducted on building and water datasets, respectively. The results indicate that the segmentation accuracy of the model proposed in this paper surpasses that of other existing mature models. On the building dataset, the mIoU reaches 87.57, while on the water dataset, the mIoU achieves 96.8, which means that the model introduced in this paper demonstrates strong generalization capabilities.Keywords
Funding Information
- National Natural Science Foundation of China (42075130)
This publication has 51 references indexed in Scilit:
- Multi-granularity siamese transformer-based change detection in remote sensing imageryEngineering Applications of Artificial Intelligence, 2024
- Dual-Attention-Guided Multiscale Feature Aggregation Network for Remote Sensing Image Change DetectionIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024
- Dual Encoder–Decoder Network for Land Cover Segmentation of Remote Sensing ImageIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2023
- MANet: a multi-level aggregation network for semantic segmentation of high-resolution remote sensing imagesInternational Journal of Remote Sensing, 2022
- SPANet: Successive Pooling Attention Network for Semantic Segmentation of Remote Sensing ImagesIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2022
- Semantic segmentation of high-resolution remote sensing images based on a class feature attention mechanism fused with Deeplabv3+Computers & Geosciences, 2022
- Integrating remote sensing and geospatial big data for urban land use mapping: A reviewInternational Journal of Applied Earth Observation and Geoinformation, 2021
- TSLRLN: Tensor subspace low-rank learning with non-local prior for hyperspectral image mixed denoisingSignal Processing, 2021
- Optimized HRNet for image semantic segmentationExpert Systems with Applications, 2021
- Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imageryRemote Sensing of Environment, 2018