Abstract
Deep learning techniques are widely used for land cover classification in remote sensing, primarily because they can effectively extract complex features from imagery data, which is essential for accurate land cover classification. However, the heterogeneity of data can pose a challenge to the generalizability of deep models. To address this issue, we propose a novel transfer learning framework for land cover classification using teacher-student structure. The proposed framework utilizes the knowledge acquired by the teacher model from large datasets to facilitate fine-tuning of the student model on small datasets, which prevents problems such as overfitting resulting from training large models on small datasets and inferior performance arising from the limited learning capacity of small models. To achieve this goal, we design a loss function base on central moment discrepancy and high-temperature softmax. In addition, we conducted experiments on three distinct pairs of datasets and found that our proposed framework outperforms both training the student model from scratch on the target domain and simply fine-tuning the teacher and student models from the source domain to the target domain. Specifically, we observed an average increase in mIoU of 9.9%, 2.1%, and 4.3%. These results demonstrate the effectiveness and generalizability of our proposed framework for remote sensing land cover classification.
Funding Information
  • National Natural Science Foundation of China (42101346)
  • Natural Resources Science and Technology Project of Hubei Province (ZRZY2023KJ10)
  • Science and Technology Commission of Shanghai Municipality (22DZ1100800)
  • China Postdoctoral Science Foundation (2020M680109)

This publication has 17 references indexed in Scilit: