Efficient Coarse-to-Fine Patch Match for Large Displacement Optical Flow
Authors:
- Yinlin HuYHYinlin Hu
- Rui SongRSRui Song
- Yunsong LiYLYunsong Li
- 1 June 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5704-5712
Abstract
As a key component in many computer vision systems, optical flow estimation, especially with large displacements, remains an open problem. In this paper we present a simple but powerful matching method works in a coarse-to-fine scheme for optical flow estimation. Inspired by the nearest neighbor field (NNF) algorithms, our approach, called CPM (Coarse-to-fine PatchMatch), blends an efficient random search strategy with the coarse-to-fine scheme for optical flow problem. Unlike existing NNF techniques, which is efficient but the results is often too noisy for optical flow caused by the lack of global regularization, we propose a propagation step with constrained random search radius between adjacent levels on the hierarchical architecture. The resulting correspondences enjoys a built-in smoothing effect, which is more suited for optical flow estimation than NNF techniques. Furthermore, our approach can also capture the tiny structures with large motions which is a problem for traditional coarse-to-fine optical flow algorithms. Interpolated by an edge-preserving interpolation method (EpicFlow), our method outperforms the state of the art on MPI-Sintel and KITTI, and runs much faster than the competing methods.Keywords
This publication has 20 references indexed in Scilit:
- Discrete Optimization for Optical Flow2015
- Generalized Deformable Spatial Pyramid: Geometry-preserving dense correspondence estimation2015
- Efficient sparse-to-dense optical flow estimation using a learned basis and layers2015
- Optical Flow with Geometric Occlusion Estimation and Fusion of Multiple Frames2015
- Locally Affine Sparse-to-Dense Matching for Motion and Occlusion Estimation2013
- A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind ThemInternational Journal of Computer Vision, 2013
- Large Displacement Optical Flow from Nearest Neighbor Fields2013
- Deformable Spatial Pyramid Matching for Fast Dense Correspondences2013
- A Database and Evaluation Methodology for Optical FlowInternational Journal of Computer Vision, 2010
- Determining optical flowArtificial Intelligence, 1981