Seamless Video Stitching from Hand‐held Camera Inputs
Authors:
- 27 May 2016
- journal article
- research article
- Published by Wiley in Computer Graphics Forum
- Vol. 35 (2) , 479-487
Abstract
Images/videos captured by portable devices (e.g., cellphones, DV cameras) often have limited fields of view. Image stitching, also referred to as mosaics or panorama, can produce a wide angle image by compositing several photographs together. Although various methods have been developed for image stitching in recent years, few works address the video stitching problem. In this paper, we present the first system to stitch videos captured by hand‐held cameras. We first recover the 3D camera paths and a sparse set of 3D scene points using CoSLAM system, and densely reconstruct the 3D scene in the overlapping regions. Then, we generate a smooth virtual camera path, which stays in the middle of the original paths. Finally, the stitched video is synthesized along the virtual path as if it was taken from this new trajectory. The warping required for the stitching is obtained by optimizing over both temporal stability and alignment quality, while leveraging on 3D information at our disposal. The experiments show that our method can produce high quality stitching results for various challenging scenarios.Keywords
This publication has 33 references indexed in Scilit:
- Video stabilization using epipolar geometryACM Transactions on Graphics, 2012
- Subspace video stabilizationACM Transactions on Graphics, 2011
- Image warps for artistic perspective manipulationACM Transactions on Graphics, 2010
- A system for retargeting of streaming videoACM Transactions on Graphics, 2009
- Content-preserving warps for 3D video stabilizationACM Transactions on Graphics, 2009
- Automatic Panoramic Image Stitching using Invariant FeaturesInternational Journal of Computer Vision, 2006
- Panoramic video texturesACM Transactions on Graphics, 2005
- High-quality video view interpolation using a layered representationACM Transactions on Graphics, 2004
- Interactive digital photomontageACM Transactions on Graphics, 2004
- A multiresolution spline with application to image mosaicsACM Transactions on Graphics, 1983