Multigrid solution of the optical flow system using a combined diffusion‐ and curvature‐based regularizer
Authors:
- 11 February 2008
- journal article
- research article
- Published by Wiley in Numerical Linear Algebra with Applications
- Vol. 15 (2-3) , 201-218
Abstract
Optical flow techniques are used to compute an approximate motion field in an image sequence. We apply a variational approach for the optical flow using a simple data term but introducing a combined diffusion‐ and curvature‐based regularizer. The same data term arises in image registration problems where a deformation field between two images is computed. For optical flow problems, usually a diffusion‐based regularizer should dominate, whereas for image registration a curvature‐based regularizer is more appropriate. The combined regularizer enables us to handle optical flow and image registration problems with the same solver and it improves the results of each of the two regularizers used on their own. We develop a geometric multigrid method for the solution of the resulting fourth‐order systems of partial differential equations associated with the variational approach for optical flow and image registration problems. The adequacy of using (collective) pointwise smoothers within the multigrid algorithm is demonstrated with the help of local Fourier analysis. Galerkin‐based coarse grid operators are applied for an efficient treatment of jumping coefficients. We show some multigrid convergence rates, timings and investigate the visual quality of the approximated motion or deformation field for synthetic and real‐world images. Copyright © 2008 John Wiley & Sons, Ltd.Keywords
This publication has 32 references indexed in Scilit:
- 3D optical flow computation using a parallel variational multigrid scheme with application to cardiac C-arm CT motionImage and Vision Computing, 2007
- Geometric multigrid for high-order regularizations of early vision problemsApplied Mathematics and Computation, 2007
- A Multigrid Method for a Fourth-Order Diffusion Equation with Application to Image ProcessingSIAM Journal on Scientific Computing, 2005
- Combining landmark and intensity driven registrationsProceedings in Applied Mathematics and Mechanics, 2003
- Dense estimation of fluid flowsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- On Benchmarking Optical FlowComputer Vision and Image Understanding, 2001
- Computing optical flow with physical models of brightness variationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Investigations of multigrid algorithms for the estimation of optical flow fields in image sequencesComputer Vision, Graphics, and Image Processing, 1988
- Model for the extraction of image flowJournal of the Optical Society of America A, 1987
- Determining optical flowArtificial Intelligence, 1981