UTSFANet: Unsupervised Two-Stage Fine Adjustment Network for Infrared Remote Sensing Image Stitching
Open Access
- 1 July 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
- Vol. 18 (19391404) , 17476-17489
Abstract
Image stitching aims to align two images from different perspectives. For infrared remote sensing images, the low resolution, lack of strong feature points, and the presence of large texture-less regions make it difficult to achieve effective feature matching and high-quality image stitching results. In the field of remote sensing stitching, the primary challenge is how to effectively extract features, reduce the influence of parallax, and improve registration accuracy. To improve the image stitching performance and obtain parallax-tolerant fine registration results, we propose a two-stage image stitching method based on unsupervised learning. Firstly, in the first stage, we use a multi-level feature extraction network to effectively extract image correlation features, progressively refining the registration from coarse to fine, thus ensuring performance under large-baseline conditions. Secondly, by utilizing a discrete feature detection module in the multi-level network, we remove anomalous feature regions and recombine effective local feature regions, enabling the fusion of detailed features with global features and improving registration accuracy. Finally, in the second stage, an image fine adjustment module is applied to process the image background and foreground, further eliminating parallax artifacts and improving registration accuracy. Compared with existing methods, our method has advantages in both registration accuracy and parallax tolerance. Extensive experiments demonstrate that our method effectively registers and stitches infrared remote sensing images on both the self-built infrared remote sensing dataset and the publicly available UDIS-D dataset, outperforming current state-of-the-art (SoTA) methods in terms of performance. The code is available at https://github.com/Shamfeeding/Image-Stitching.Keywords
Funding Information
- National Natural Science Foundation of China (62305086)
- China Postdoctoral Science Foundation (2023M740901)
- Natural Science Foundation of Heilongjiang Province (LH2024F032)
- National Key Laboratory of Air-based Information Perception and Fusion (20220001077001)
This publication has 50 references indexed in Scilit:
- Weakly-Supervised Stitching Network for Real-World Panoramic Image Generation2022
- Learning edge-preserved image stitching from multi-scale deep homographyNeurocomputing, 2022
- Content-Aware Unsupervised Deep Homography Estimation2020
- A view-free image stitching network based on global homographyJournal of Visual Communication and Image Representation, 2020
- X-ModalNet: A semi-supervised deep cross-modal network for classification of remote sensing dataISPRS Journal of Photogrammetry and Remote Sensing, 2020
- Handbook of Applied Spatial Analysis2010
- Fast Normalized Cross-CorrelationCircuits, Systems, and Signal Processing, 2009
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Automatic Panoramic Image Stitching using Invariant FeaturesInternational Journal of Computer Vision, 2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004