Multi-frame estimation of planar motion
Authors:
- 1 January 2000
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 22 (10) , 1105-1116
Abstract
Traditional plane alignment techniques are typically performed between pairs of frames. In this paper, we present a method for extending existing two-frame planar motion estimation techniques into a simultaneous multi-frame estimation, by exploiting multi-frame subspace constraints of planar surfaces. The paper has three main contributions: 1) we show that when the camera calibration does not change, the collection of all parametric image motions of a planar surface in the scene across multiple frames is embedded in a low dimensional linear subspace; 2) we show that the relative image motion of multiple planar surfaces across multiple frames is embedded in a yet lower dimensional linear subspace, even with varying camera calibration; and 3) we show how these multi-frame constraints can be incorporated into simultaneous multi-frame estimation of planar motion, without explicitly recovering any 3D information, or camera calibration. The resulting multi-frame estimation process is more constrained than the individual two-frame estimations, leading to more accurate alignment, even when applied to small image regions.Keywords
This publication has 16 references indexed in Scilit:
- Layered representation for motion analysis2002
- Direct recovery of shape from multiple views: a parallax based approach2002
- Robust dynamic motion estimation over time2002
- Layered representation of motion video using robust maximum-likelihood estimation of mixture models and MDL encoding2002
- Geometrically Constrained Structure from Motion: Points on Planes1998
- Recovery of ego-motion using region alignmentIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Skin and bones: multi-layer, locally affine, optical flow and regularization with transparency1996
- Recursive filters for optical flowIEEE Transactions on Pattern Analysis and Machine Intelligence, 1995
- Computing occluding and transparent motionsInternational Journal of Computer Vision, 1994
- Shape and motion from image streams under orthography: a factorization methodInternational Journal of Computer Vision, 1992