A Novel Approach for SAR to Optical Image Registration using Deep Learning
Authors:
- 27 January 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1, 1-4
Abstract
Image registration is one of the essential pre-processing steps in remote sensing data applications. Since Synthetic Aperture Radar (SAR) and optical images give complementary information, they are used simultaneously for several applications. However, they differ in their geometric and radiometric properties; hence, SAR to optical image registration is challenging. An image registration approach based on Conditional Generative Adversarial Network (cGAN) to synthesize optical-like SAR images and Fast Fourier Transform (FFT) based correlation is proposed in this work. cGAN does the image translation of the SAR patch and generates a corresponding optical-like patch. The optical-like SAR image is used as a reference to register the optical image. Sentinel-l SAR and Sentine1-2 optical patch pairs are used for this work. When registered with optical-like patches using FFTbased correlation, optical patches could give a sub-pixel accuracy.Keywords
This publication has 11 references indexed in Scilit:
- Robust registration of SAR and optical images based on deep learning and improved Harris algorithmScientific Reports, 2022
- OS-PC: Combining Feature Representation and 3-D Phase Correlation for Subpixel Optical and SAR Image RegistrationIEEE Transactions on Geoscience and Remote Sensing, 2020
- Image Registration With Fourier-Based Image Correlation: A Comprehensive Review of Developments and ApplicationsIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2019
- THE SEN1-2 DATASET FOR DEEP LEARNING IN SAR-OPTICAL DATA FUSIONISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2018
- Exploring the Potential of Conditional Adversarial Networks for Optical and SAR Image MatchingIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2018
- Identifying Corresponding Patches in SAR and Optical Images With a Pseudo-Siamese CNNIEEE Geoscience and Remote Sensing Letters, 2018
- Image-to-Image Translation with Conditional Adversarial Networks2017
- An Efficient SIFT-Based Mode-Seeking Algorithm for Sub-Pixel Registration of Remotely Sensed ImagesIEEE Geoscience and Remote Sensing Letters, 2014
- Image Registration for Remote Sensing2011
- Efficient subpixel image registration algorithmsOptics Letters, 2008