A Unified Deep Learning Network for Remote Sensing Image Registration and Change Detection
- 19 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 62 (01962892) , 1-16
Abstract
Image registration and change detection are crucial for multi-temporal remote sensing image analysis. The images should be registered before the change information detection. Existing deep learning methods have shown significant advantages in image registration and change detection tasks. They usually design two independent task-specific deep networks for image registration and change detection, respectively. These independent deep networks will learn from scratch and rely on many task-specific labeled training datasets. This paper finds that image registration and change detection have similar learning mechanisms, which focus on extracting discriminative features. Inspired by this, we propose a unified deep learning network, URCNet, that can perform image alignment and change information detection through a single network. Additionally, this paper proposes various deep collaborative learning methods for URCNet optimization, which enforce that the URCNet can effectively support remote sensing image registration and change detection simultaneously. Extensive experiments demonstrate the effectiveness of the proposed URCNet for image registration and change detection, which can achieve comparable and better results with task-specific and more complex deep networks. The proposed URCNet can support multi-tasks based on the same scene images, different scene images, and even multi-modal images. Moreover, URCNet shows significant advantages over other deep networks in change detection under limited labeled datasets.Keywords
Funding Information
- National Natural Science Foundation of China (62201407, 62271377, 62171347)
- National Key Research and Development Program of China (2021ZD0110400)
- Key Research and Development Program of Shannxi (2021ZDLGY0106, 2022ZDLGY0112)
- Key Scientific Technological Innovation Research Project by Ministry of Education
This publication has 54 references indexed in Scilit:
- 3.10 Remote Sensing and GIS for Natural Hazards Assessment and Disaster Risk Management2013
- Modifications in the SIFT operator for effective SAR image matchingInternational Journal of Image and Data Fusion, 2010
- Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and $k$-Means ClusteringIEEE Geoscience and Remote Sensing Letters, 2009
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Satellite remote sensing of earthquake, volcano, flood, landslide and coastal inundation hazardsISPRS Journal of Photogrammetry and Remote Sensing, 2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Mutual-information-based registration of medical images: a surveyIEEE Transactions on Medical Imaging, 2003
- Automatic analysis of the difference image for unsupervised change detectionIEEE Transactions on Geoscience and Remote Sensing, 2000
- Digital change detection in forest ecosystems with remote sensing imageryRemote Sensing Reviews, 1996
- A TM Tasseled Cap equivalent transformation for reflectance factor dataRemote Sensing of Environment, 1985