Weakly Supervised Remote Sensing Segmentation via Decoupled Cross-Modal Distillation and Semantic-Guided Refinement
Open Access
- 21 August 2026
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 18 (16) , 2843
Abstract
Pixel-level annotation of remote sensing imagery is costly, motivating weakly supervised semantic segmentation (WSSS) using only image-level labels. However, class activation maps (CAMs) often highlight only discriminative sub-regions and fail to separate adjacent land-cover regions, particularly in remote sensing scenes characterized by densely co-occurring land-cover classes and substantial variations in object scale. To address these limitations, we propose a three-stage framework that integrates complementary priors from Contrastive Language–Image Pre-training (CLIP), Self-Distillation with No Labels version 2 (DINOv2), and the Segment Anything Model (SAM). First, a lightweight CLIP adapter aligns vision–language priors with remote sensing imagery, while sigmoid-based multi-label decoupled distillation replaces class-competitive distillation with independent class-wise supervision, producing more complete CAMs. Second, DINOv2-guided feature clustering decomposes large merged regions before SAM prompt generation, while Spatial–Semantic Constraints are used to construct confidence-guided point-and-box prompts and reject excessively expanded or semantically inconsistent masks, thereby generating reliable pseudo-labels. Finally, a compact segmentation network is initialized with the weights learned in Stage 1 and retrained using the refined pseudo-labels generated in Stage 2, eliminating the need for foundation models during inference. Experiments on the Potsdam, LoveDA, and DeepGlobe datasets show that the proposed method achieves mean intersection over union (mIoU) scores of 53.16%, 52.66%, and 62.98%, respectively, outperforming state-of-the-art WSSS baselines by 6.55, 1.16, and 1.27 percentage points, respectively. These results demonstrate the effectiveness and generalizability of the proposed framework across diverse remote sensing scenarios under image-level supervision.Keywords
Funding Information
- Qinghai Province Key Research and Development and Transformation Program Special Project (2026-SF-147)
- National Natural Science Foundation of China (62262056)
- College Students’ Innovation and Entrepreneurship Training Program of Qinghai Normal University (qhnucxcy2026042)
This publication has 36 references indexed in Scilit:
- UNet with multibranch prior information encoding for building segmentation in remote sensing imagesAdvances In Space Research, 2025
- SARFormer: Segmenting Anything Guided Transformer for semantic segmentationNeurocomputing, 2025
- Extract Free Dense Labels from CLIP2022
- UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imageryISPRS Journal of Photogrammetry and Remote Sensing, 2022
- Recurrently exploring class-wise attention in a hybrid convolutional and bidirectional LSTM network for multi-label aerial image classificationISPRS Journal of Photogrammetry and Remote Sensing, 2019
- A brief introduction to weakly supervised learningNational Science Review, 2017
- Learning Deep Features for Discriminative Localization2016
- Special issue on weakly supervised learningJournal of Visual Communication and Image Representation, 2016
- Fully convolutional networks for semantic segmentation2015
- Medical Image Computing and Computer-Assisted Intervention -- MICCAI 20152015