Parallax Estimation for Push-Frame Satellite Imagery: Application to Super-Resolution and 3D Surface Modeling from Skysat Products
Open Access
- 11 July 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2679-2682
Abstract
Recent constellations of satellites, including the Skysat constellation, are able to acquire burst of images. This new acquisition mode allows for modern image restoration techniques, including multi-frame super-resolution. As the satellite moves during the acquisition of the burst, elevation changes in the scene translate into noticeable parallax. This parallax hinders the results of the restoration. To cope with this issue, we propose a novel parallax estimation method. The method is composed of a linear $\text{Plane}+\text{Parallax}$ decomposition of the apparent motion and a multi-frame optical flow algorithm that exploits all frames simultaneously. Using SkySat L1A images, we show that the estimated per-pixel displacements are important for applying multi-frame super-resolution on scenes containing elevation changes and that can also be used to estimate a coarse 3D surface model.
Keywords
All Related Versions
Funding Information
- Office of Naval Research (N00014-17-1-2552)
This publication has 7 references indexed in Scilit:
- Improvements of the Inverse Compositional Algorithm for Parametric Motion EstimationImage Processing On Line, 2018
- 3D super resolution scene depth reconstruction based on SkySat video image sequences2016
- On stereo-rectification of pushbroom images2014
- An automatic and modular stereo pipeline for pushbroom imagesISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2014
- Small Baseline StereovisionJournal of Mathematical Imaging and Vision, 2007
- Direct recovery of planar-parallax from multiple framesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Plane + Parallax, Tensors and Factorization2000