Towards ultimate motion estimation: combining highest accuracy with real-time performance
Authors:
- 1 January 2005
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 1 (15505499) , 749-755 Vol. 1
Abstract
Although variational methods are among the most accurate techniques for estimating the optical flow, they have not yet entered the field of real-time vision. Main reason is the great popularity of standard numerical schemes that are easy to implement, however, at the expense of being too slow for real-time performance. In our paper we address this problem in two ways: (i) we present an improved version of the highly accurate technique of Brox et al. (2004). Thereby we show that a separate robustification of the constancy assumptions is very useful, in particular if the I-norm is used as penalizer. As a result, a method is obtained that yields the lowest angular errors in the literature, (ii) We develop an efficient numerical scheme for the proposed approach that allows real-time performance for sequences of size 160 /spl times/ 720. To this end, we combine two hierarchical strategies: a coarse-to-fine warping strategy as implementation of a fixed point iteration for a non-convex optimisation problem and a nonlinear full multigrid method - a so called full approximation scheme (FAS) - for solving the highly nonlinear equation systems at each warping level. In the experimental section the advantage of the proposed approach becomes obvious: Outperforming standard numerical schemes by two orders of magnitude frame rates of six high quality flow fields per second are obtained on a 3.06 GHz Pentium4 PC.Keywords
This publication has 26 references indexed in Scilit:
- Lucas/Kanade Meets Horn/Schunck: Combining Local and Global Optic Flow MethodsInternational Journal of Computer Vision, 2005
- Discontinuity-Preserving Computation of Variational Optic Flow in Real-Time2005
- Nonlinear multigrid methods for total variation image denoisingComputing and Visualization in Science, 2004
- An Algebraic Multigrid Approach for Image AnalysisSIAM Journal on Scientific Computing, 2003
- A multigrid approach for hierarchical motion estimation2002
- On the Convergence of the Lagged Diffusivity Fixed Point Method in Total Variation Image RestorationSIAM Journal on Numerical Analysis, 1999
- A fast scalable algorithm for discontinuous optical flow estimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1996
- Investigations of multigrid algorithms for the estimation of optical flow fields in image sequencesComputer Vision, Graphics, and Image Processing, 1988
- Multi-Grid Methods and Applications1985
- Multilevel Relaxation in Low-Level Computer Vision1984