Rolling shutter bundle adjustment
- 1 June 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 1434-1441
Abstract
This paper introduces a bundle adjustment (BA) method that obtains accurate structure and motion from rolling shutter (RS) video sequences: RSBA. When a classical BA algorithm processes a rolling shutter video, the resultant camera trajectory is brittle, and complete failures are not uncommon. We exploit the temporal continuity of the camera motion to define residuals of image point trajectories with respect to the camera trajectory. We compare the camera trajectories from RSBA to those from classical BA, and from classical BA on rectified videos. The comparisons are done on real video sequences from an iPhone 4, with ground truth obtained from a global shutter camera, rigidly mounted to the iPhone 4. Compared to classical BA, the rolling shutter model requires just six extra parameters. It also degrades the sparsity of the system Jacobian slightly, but as we demonstrate, the increase in computation time is moderate. Decisive advantages are that RSBA succeeds in cases where competing methods diverge, and consistently produces more accurate results.Keywords
This publication has 21 references indexed in Scilit:
- Efficient Video Rectification and Stabilisation for Cell-PhonesInternational Journal of Computer Vision, 2011
- Subspace video stabilizationACM Transactions on Graphics, 2011
- Algorithm 891ACM Transactions on Mathematical Software, 2009
- Triangulation from Two Views Revisited: Hartley-Sturm vs. Optimal Correction2008
- Machine Learning for High-Speed Corner Detection2006
- Visual Modeling with a Hand-Held CameraInternational Journal of Computer Vision, 2004
- An efficient solution to the five-point relative pose problemIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Bundle Adjustment — A Modern Synthesis2000
- On a Distance between Two Curves1986
- Random sample consensusCommunications of the ACM, 1981