Negative Class Guided Spatial Consistency Network for Sparsely Supervised Semantic Segmentation of Remote Sensing Images
- 10 September 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 35 (1) , 657-669
Abstract
Deep neural networks (DNNs) have been successfully applied in the remote sensing semantic segmentation. However, training DNNs requires a large number of densely labeled samples, which is laborious and time-consuming. Sparsely supervised semantic segmentation (SSSS) can train deep segmentation networks using only sparse annotations. In this paper, we propose a negative class guided spatial consistency network (NCG-SCNet) for semantic segmentation with sparse annotations. Specifically, we introduce a spatial consistency enhancement module (SCEM) to enhance network features by non-linearly combining spatially similar features. Thus, it could provide better representations of the boundaries and the shape of the target. Additionally, a channel compression module (CCM) is proposed to reduce channel redundancy while preserving the network’s feature extraction capability. A negative class guided loss function (NCG Loss) is constructed to provide extra supervisory information, where the negative classes are defined as the classes with lower probability in the prediction. Extensive experiments on two widely used remote sensing datasets show that the proposed NCG-SCNet outperforms the comparison methods.Keywords
Funding Information
- National Natural Science Foundation of China (62171357)
- National Natural Science Foundation of China (U22B2018)
- National Natural Science Foundation of China (62276205)
This publication has 43 references indexed in Scilit:
- Position-based anchor optimization for point supervised dense nuclei detectionNeural Networks, 2023
- Large-scale road extraction from high-resolution remote sensing images based on a weakly-supervised structural and orientational consistency constraint networkISPRS Journal of Photogrammetry and Remote Sensing, 2022
- A coarse-to-fine weakly supervised learning method for green plastic cover segmentation using high-resolution remote sensing imagesISPRS Journal of Photogrammetry and Remote Sensing, 2022
- ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed dataISPRS Journal of Photogrammetry and Remote Sensing, 2020
- On Regularized Losses for Weakly-supervised CNN Segmentation2018
- Learning Random-Walk Label Propagation for Weakly-Supervised Semantic Segmentation2017
- Aggregated Residual Transformations for Deep Neural Networks2017
- Learning Deep Features for Discriminative Localization2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Fully convolutional networks for semantic segmentation2015