Abstract
Unsupervised domain adaptation (UDA) has become an important technique for cross-domain semantic segmentation (SS) in remote sensing community and obtained remarkable results. However, when transferring from high-resolution (HR) remote sensing images to low-resolution (LR) images, the existing UDA frameworks always fail to segment the LR target images, especially for small objects (e.g., cars), due to the severe spatial resolution shift problem. In this paper, to improve the segmentation ability of UDA models for LR target images and small objects, we propose a novel multi-task domain adaptation network (DASRSNet) for SS of remote sensing images with the aid of super-resolution (SR). The proposed DASRSNet contains domain adaptation for semantic segmentation (DASS) branch, domain adaptation for super-resolution (DASR) branch and feature affinity (FA) module. Specifically, the DASS and DASR branches share the same encoder to extract the domain-invariant features for the target and source domains, and these two branches utilize different decoders and discriminators to conduct cross-domain SS task and SR task, which align the domain shift in output space and image space respectively. Finally, FA module, which involves the proposed FA loss, is applied to enhance the affinity of SS features and SR features for both source and target domains. The experimental results on the cross-city aerial datasets demonstrate the effectiveness and superiority of our DASRSNet against the recent UDA models.
Funding Information
  • National Natural Science Foundation of China (61825205)
  • Key Research and Development Program of Zhejiang Province, China (2021C01017)

This publication has 48 references indexed in Scilit: