Accurate Optical Flow via Direct Cost Volume Processing
Authors:
- Jia XuJXJia Xu
- Rene RanftlRRRene Ranftl
- Vladlen KoltunVKVladlen Koltun
Top Cited Papers
- 1 July 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 5807-5815
Abstract
We present an optical flow estimation approach that operates on the full four-dimensional cost volume. This direct approach shares the structural benefits of leading stereo matching pipelines, which are known to yield high accuracy. To this day, such approaches have been considered impractical due to the size of the cost volume. We show that the full four-dimensional cost volume can be constructed in a fraction of a second due to its regularity. We then exploit this regularity further by adapting semi-global matching to the four-dimensional setting. This yields a pipeline that achieves significantly higher accuracy than state-of-the-art optical flow methods while being faster than most. Our approach outperforms all published general-purpose optical flow methods on both Sintel and KITTI 2015 benchmarks.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- EpicFlow: Edge-preserving interpolation of correspondences for optical flow2015
- 3D Scene Flow Estimation with a Piecewise Rigid Scene ModelInternational Journal of Computer Vision, 2015
- Fast Edge Detection Using Structured ForestsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind ThemInternational Journal of Computer Vision, 2013
- Robust Monocular Epipolar Flow Estimation2013
- An Evaluation of Data Costs for Optical Flow2013
- A Database and Evaluation Methodology for Optical FlowInternational Journal of Computer Vision, 2010
- Boundary Extraction in Natural Images Using Ultrametric Contour Maps2006
- Backpropagation Applied to Handwritten Zip Code RecognitionNeural Computation, 1989
- Random sample consensusCommunications of the ACM, 1981