MegaStitch: Robust Large-Scale Image Stitching
Open Access
- 11 January 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Geoscience and Remote Sensing
- Vol. 60 (01962892) , 1-9
Abstract
We address fast image stitching for large image collections while being robust to drift due to chaining transformations and minimal overlap between images. We focus on scientific applications where ground-truth accuracy is far more important than visual appearance or projection error, which can be misleading. For common large-scale image stitching use cases, transformations between images are often restricted to similarity or translation. When homography is used in these cases, the odds of being trapped in a poor local minimum and producing unnatural results increases. Thus, for transformations up to affine, we cast stitching as minimizing reprojection error globally using linear least-squares with a few, simple constraints. For homography, we observe that the global affine solution provides better initialization for bundle adjustment compared to an alternative that initializes with a homography-based scaffolding and at lower computational cost. We evaluate our methods on a very large translation dataset with limited overlap as well as four drone datasets. We show that our approach is better compared to alternative methods such as MGRAPH in terms of computational cost, scaling to large numbers of images, and robustness to drift. We also contribute ground-truth datasets for this endeavor.Keywords
All Related Versions
Funding Information
- Department of Energy Advanced Research Projects Agency–Energy (DE-AR0000594, DE-AR0001101)
- Department of Energy Biological and Environmental Research (DE-SC0020401)
- Bill & Melinda Gates Foundation (OPP1129603)
- Cotton (20-720)
This publication has 38 references indexed in Scilit:
- Camera Image Mosaicing Based on an Optimized SURF AlgorithmTELKOMNIKA Indonesian Journal of Electrical Engineering, 2012
- A Method for Building a Mosaic with UAV ImagesInternational Journal of Information Engineering and Electronic Business, 2010
- Globally optimal stitching of tiled 3D microscopic image acquisitionsBioinformatics, 2009
- Automatic Panoramic Image Stitching using Invariant FeaturesInternational Journal of Computer Vision, 2006
- Scale & Affine Invariant Interest Point DetectorsInternational Journal of Computer Vision, 2004
- An IDL/ENVI implementation of the FFT-based algorithm for automatic image registrationComputers & Geosciences, 2003
- Image mosaicing using sequential bundle adjustmentImage and Vision Computing, 2002
- Constrained delaunay triangulationsAlgorithmica, 1989
- Newton’s Method with a Model Trust Region ModificationSIAM Journal on Numerical Analysis, 1982
- Random sample consensusCommunications of the ACM, 1981