Near Real-Time Automatic Sub-Pixel Registration of Panchromatic and Multispectral Images for Pan-Sharpening
Open Access
- 14 September 2021
- journal article
- research article
- Published by MDPI AG in Remote Sensing
- Vol. 13 (18) , 3674
Abstract
This paper presents a near real-time automatic sub-pixel registration method of high-resolution panchromatic (PAN) and multispectral (MS) images using a graphics processing unit (GPU). In the first step, the method uses differential geo-registration to enable accurate geographic registration of PAN and MS images. Differential geo-registration normalizes PAN and MS images to the same direction and scale. There are also some residual misalignments due to the geometrical configuration of the acquisition instruments. These residual misalignments mean the PAN and MS images still have deviations after differential geo-registration. The second step is to use differential rectification with tiny facet primitive to eliminate possible residual misalignments. Differential rectification corrects the relative internal geometric distortion between PAN and MS images. The computational burden of these two steps is large, and traditional central processing unit (CPU) processing takes a long time. Due to the natural parallelism of the differential methods, these two steps are very suitable for mapping to a GPU for processing, to achieve near real-time processing while ensuring processing accuracy. This paper used GaoFen-6, GaoFen-7, ZiYuan3-02 and SuperView-1 satellite data to conduct an experiment. The experiment showed that our method’s processing accuracy is within 0.5 pixels. The automatic processing time of this method is about 2.5 s for 1 GB output data in the NVIDIA GeForce RTX 2080Ti, which can meet the near real-time processing requirements for most satellites. The method in this paper can quickly achieve high-precision registration of PAN and MS images. It is suitable for different scenes and different sensors. It is extremely robust to registration errors between PAN and MS.Keywords
This publication has 48 references indexed in Scilit:
- A survey of classical methods and new trends in pansharpening of multispectral imagesEURASIP Journal on Advances in Signal Processing, 2011
- Survey of Multispectral Image Fusion Techniques in Remote Sensing Applications2011
- A fast and fully automatic registration approach based on point features for multi-source remote-sensing imagesComputers & Geosciences, 2008
- Multispectral and Panchromatic Data Fusion Assessment Without ReferencePhotogrammetric Engineering & Remote Sensing, 2008
- Multi-spectral remote image registration based on SIFTElectronics Letters, 2008
- Sensor orientation via RPCsISPRS Journal of Photogrammetry and Remote Sensing, 2006
- Block Adjustment of High-Resolution Satellite Images Described by Rational PolynomialsPhotogrammetric Engineering & Remote Sensing, 2003
- Liu 'Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details'International Journal of Remote Sensing, 2002
- Smoothing Filter-based Intensity Modulation: A spectral preserve image fusion technique for improving spatial detailsInternational Journal of Remote Sensing, 2000
- Perspective TransformationAdult Education, 1978