Deep Rigid Instance Scene Flow
Authors:
- Wei-Chiu MaWMWei-Chiu Ma
- 1 June 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3609-3617
Abstract
In this paper we tackle the problem of scene flow estimation in the context of self-driving. We leverage deep learning techniques as well as strong priors as in our application domain the motion of the scene can be composed by the motion of the robot and the 3D motion of the actors in the scene. We formulate the problem as energy minimization in a deep structured model, which can be solved efficiently in the GPU by unrolling a Gaussian-Newton solver. Our experiments in the challenging KITTI scene flow dataset show that we outperform the state-of-the-art by a very large margin, while being 800 times faster.Keywords
All Related Versions
This publication has 33 references indexed in Scilit:
- Learning to compare image patches via convolutional neural networks2015
- Computing the stereo matching cost with a convolutional neural network2015
- 3D Scene Flow Estimation with a Piecewise Rigid Scene ModelInternational Journal of Computer Vision, 2015
- Piecewise Rigid Scene Flow2013
- Multi-view Scene Flow Estimation: A View Centered Variational ApproachInternational Journal of Computer Vision, 2012
- Multi-View Stereo Reconstruction and Scene Flow Estimation with a Global Image-Based Matching ScoreInternational Journal of Computer Vision, 2006
- Highly Accurate Optic Flow Computation with Theoretically Justified WarpingInternational Journal of Computer Vision, 2006
- A stereo matching algorithm with an adaptive window: theory and experiment2002
- The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow FieldsComputer Vision and Image Understanding, 1996
- Determining optical flowArtificial Intelligence, 1981