iGG-MBS: Iterative Guided-Gaussian Multi-Baseline Stereo Matching
Open Access
- 25 May 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 99205-99218
Abstract
This paper presents an improved dense disparity estimating technique for a collection of multi-baseline stereo (referred to as MBS in the text) images. The flow of the proposed system consists of two main frameworks: a preliminary cost calculation and initial disparity estimating framework, and an iterative cost refinement framework. The first framework implements an accurate multi-baseline stereo cost (referred to as MBSC in the text) calculation method, and a scan line optimization inspired by the Semi Global Matching (SGM) algorithm. Cost volumes of each two-view camera pair are calculated by fusing two pixel dissimilarity measures: i) weighted Census transformation and ii) sum of absolute difference color consistency term (SAD-Census). The initial disparity map between reference and the matching view with the largest baseline displacement is calculated by summing-and-interpolating SAD-Census costs of the current and all neighboring camera pairs in-between, and taking the minimum after aggregating for sixteen directions. The second framework refines the aggregated MBSC volume recursively. In each iteration, individual pair-wise disparity maps are used to warp matching views towards the reference to create binary masks that resemble overlapping differences. White locations in the mask represent incorrect correspondence matches, thus a penalty is added for costs associated with, adapting a Gaussian modulating function. This significantly reduces the selection probability of incorrect disparity minima in proceeding iterations. A Guided filter-based Rolling Guidance filter is applied to further up-vote the probability of pixels with the lowest costs, which are similar or close enough to ground truth readings. Through experimental results evaluated on the Middlebury dataset, we show that our method leads to effective and efficient multibaseline disparity estimations.Keywords
Funding Information
- National Research Foundation of Korea
- Korea government (2018M2A8A5083266)
- BK21 Plus project
- Ministry of Education, South Korea (21A20131600011)
- Cross-Ministry Giga KOREA Project
- Korea government (MSIT), Real-time 4D reconstruction of dynamic objects for ultra-realistic service (GK17P0300)
This publication has 50 references indexed in Scilit:
- Literature Survey on Stereo Vision Disparity Map AlgorithmsJournal of Sensors, 2015
- Accurate Image-Guided Stereo Matching With Efficient Matching Cost and Disparity RefinementIEEE Transactions on Circuits and Systems for Video Technology, 2015
- Enhanced disparity estimation in stereo imagesImage and Vision Computing, 2015
- Fast Global Image Smoothing Based on Weighted Least SquaresIEEE Transactions on Image Processing, 2014
- 3D entity-based stereo matching with ground control points and joint second-order smoothness priorThe Visual Computer, 2014
- On accurate dense stereo-matching using a local adaptive multi-cost approachISPRS Journal of Photogrammetry and Remote Sensing, 2014
- Hardware-Efficient Bilateral Filtering for Stereo MatchingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- A Comparative Analysis between Active and Passive Techniques for Underwater 3D Reconstruction of Close-Range ObjectsSensors, 2013
- Dense Multi-Stereo Matching for High Quality Digital Elevation ModelsPhotogrammetrie - Fernerkundung - Geoinformation, 2012
- Bilateral Filtering: Theory and ApplicationsFoundations and Trends in Computer Graphics and Vision, 2009