Dynamic Video Stitching via Shakiness Removing
Authors:
- 7 August 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 27 (1) , 164-178
Abstract
Stitching videos captured by hand-held mobile cameras can essentially enhance entertainment experience of ordinary users. However, such videos usually contain heavy shakiness and large parallax, which are challenging to stitch. In this paper, we propose a novel approach of video stitching and stabilization for videos captured by mobile devices. The main component of our method is a unified video stitching and stabilization optimization that computes stitching and stabilization simultaneously rather than does each one individually. In this way, we can obtain the best stitching and stabilization results relative to each other without any bias to one of them. To make the optimization robust, we propose a method to identify background of input videos, and also common background of them. This allows us to apply our optimization on background regions only, which is the key to handle large parallax problem. Since stitching relies on feature matches between input videos, and there inevitably exist false matches, we thus propose a method to distinguish between right and false matches, and encapsulate the false match elimination scheme and our optimization into a loop, to prevent the optimization from being affected by bad feature matches. We test the proposed approach on videos that are causally captured by smartphones when walking along busy streets, and use stitching and stability scores to evaluate the produced panoramic videos quantitatively. Experiments on a diverse of examples show that our results are much better than (challenging cases) or at least on par with (simple cases) the results of previous approaches.Keywords
This publication has 45 references indexed in Scilit:
- MeshFlow: Minimum Latency Online Video Stabilization2016
- Simultaneous Camera Path Optimization and Distraction Removal for Improving Amateur VideoIEEE Transactions on Image Processing, 2015
- Video Stabilization Based on Feature Trajectory Augmentation and Selection and Robust Mesh Grid WarpingIEEE Transactions on Image Processing, 2015
- Stabilization of panoramic videos from mobile multi-camera platformsImage and Vision Computing, 2015
- Efficient Video Stitching Based on Fast Structure DeformationIEEE Transactions on Cybernetics, 2014
- SteadyFlow: Spatially Smooth Optical Flow for Video Stabilization2014
- Parallax-Tolerant Image Stitching2014
- As-Projective-As-Possible Image Stitching with Moving DLT2013
- Panoramic video stitching from commodity HDTV camerasMultimedia Systems, 2013
- Automatic Panoramic Image Stitching using Invariant FeaturesInternational Journal of Computer Vision, 2006