Occlusion-aware light field depth estimation using side window angular coherence
- 7 January 2021
- journal article
- research article
- Published by Optica Publishing Group in Applied Optics
- Vol. 60 (2) , 392-404
Abstract
Depth estimation is crucial in many light field applications. However, the accuracy of light field depth estimation is prone to be affected by occlusions. In this paper, a method of side window angular coherence is proposed to handle different types of occlusions, and the ability of the proposed method to resist occlusions is theoretically analyzed. The angular patch is divided into several discrete side window subsets. These subsets are a pure occluder-type subset, a pure object point–type subset, and a hybrid-type subset. The photo-consistency of the pure object point–type subset can reflect the true depth. Meanwhile, the occlusion edges can be detected to identify occluded points and nonoccluded points so the robustness of the algorithm can be further enhanced by processing the two types of points. Moreover, fast guided filtering is applied to cost volume for improving the accuracy of depth estimation. Experimental results demonstrate that our method outperforms the state-of-the-art depth estimation methods on both synthetic and real scenes, especially near occlusion boundaries.Keywords
Funding Information
- Western Youth Scholar A CAS
- Sichuan Science and Technology Program (2020JDRC0001)
- Youth Innovation Promotion Association of the Chinese Academy of Sciences (2017429)
- National Natural Science Foundation of China (11704382, 61805251, 61875203, 61975171)
This publication has 21 references indexed in Scilit:
- Close-range photogrammetry with light field camera: from disparity map to absolute distanceApplied Optics, 2016
- Light-Field Depth Estimation via Epipolar Plane Image Analysis and Locally Linear EmbeddingIEEE Transactions on Circuits and Systems for Video Technology, 2016
- Robust depth estimation for light field via spinning parallelogram operatorComputer Vision and Image Understanding, 2016
- Depth Estimation with Occlusion Modeling Using Light-Field CamerasIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Variational Light Field Analysis for Disparity Estimation and Super-ResolutionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Guided Image FilteringIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Fourier slice photographyACM Transactions on Graphics, 2005
- A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence AlgorithmsInternational Journal of Computer Vision, 2002
- Fast approximate energy minimization via graph cutsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Light field rendering1996