Temporally coherent disparity maps using CRFs with fast 4D filtering
Open Access
- 9 December 2016
- journal article
- Published by Springer Nature in IPSJ Transactions on Computer Vision and Applications
- Vol. 8 (1) , 10
Abstract
State-of-the-art methods for disparity estimation achieve good results for single stereo frames, but temporal coherence in stereo videos is often neglected. In this paper, we present a method to compute temporally coherent disparity maps. We define an energy over whole stereo sequences and optimize their conditional random field (CRF) distributions using the mean-field approximation. In addition, we introduce novel terms for smoothness and consistency between the left and right views. We perform CRF optimization by fast, iterative spatio-temporal filtering with linear complexity in the total number of pixels. We propose two CRF optimization techniques, using parallel and sequential updates, and compare them in detail. While parallel updates are not guaranteed to converge, we show that, in practice with appropriate initialization, they provide the same quality as sequential updates and they also lead to faster implementations. Finally, we demonstrate that the results of our approach rank among the state of the art while having significantly less flickering artifacts in stereo sequences.Keywords
Funding Information
- Kommission für Technologie und Innovation (15592.1 PFES-ES)
This publication has 32 references indexed in Scilit:
- Semi-Global Matching: A Principled Derivation in Terms of Message Passing2014
- Hand-held 3D light field photography and applicationsThe Visual Computer, 2014
- Filter-Based Mean-Field Inference for Random Fields with Higher-Order Terms and Product Label-SpacesInternational Journal of Computer Vision, 2014
- View-Consistent 3D Scene Flow Estimation over Multiple Frames2014
- Weighted Semi-Global Matching and Center-Symmetric Census Transform for Robust Driver Assistance2013
- Iterative Semi-Global Matching for Robust Driver Assistance Systems2013
- Practical temporal consistency for image-based graphics applicationsACM Transactions on Graphics, 2012
- Real-Time Spatiotemporal Stereo Matching Using the Dual-Cross-Bilateral Grid2010
- Fast approximate energy minimization via graph cutsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Improving the Mean Field Approximation Via the Use of Mixture Distributions1998