FALDOI: A new minimization strategy for large displacement variational optical flow
Preprint
Abstract
We propose a large displacement optical flow method that introduces a new strategy to compute a good local minimum of any optical flow energy functional. The method requires a given set of discrete matches, which can be extremely sparse, and an energy functional which locally guides the interpolation from those matches. In particular, the matches are used to guide a structured coordinate-descent of the energy functional around these keypoints. It results in a two-step minimization method at the finest scale which is very robust to the inevitable outliers of the sparse matcher and able to capture large displacements of small objects. Its benefits over other variational methods that also rely on a set of sparse matches are its robustness against very few matches, high levels of noise and outliers. We validate our proposal using several optical flow variational models. The results consistently outperform the coarse-to-fine approaches and achieve good qualitative and quantitative performance on the standard optical flow benchmarks.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Morphologically Invariant Matching of Structures with the Complete Rank TransformInternational Journal of Computer Vision, 2015
- A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind ThemInternational Journal of Computer Vision, 2013
- Sparse Occlusion Detection with Optical FlowInternational Journal of Computer Vision, 2011
- Optic Flow in HarmonyInternational Journal of Computer Vision, 2011
- A First-Order Primal-Dual Algorithm for Convex Problems with Applications to ImagingJournal of Mathematical Imaging and Vision, 2010
- A Database and Evaluation Methodology for Optical FlowInternational Journal of Computer Vision, 2010
- Highly Accurate Optic Flow Computation with Theoretically Justified WarpingInternational Journal of Computer Vision, 2006
- Efficient Computation of Optical Flow Using the Census Transform2004
- The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow FieldsComputer Vision and Image Understanding, 1996
- Determining optical flowArtificial Intelligence, 1981