Light Field Depth Estimation via Stitched Epipolar Plane Images
- 19 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (10) , 6866-6879
Abstract
Depth estimation is a fundamental problem in light field processing. Epipolar-plane image (EPI)-based methods often encounter challenges such as low accuracy in slope computation due to discretization errors and limited angular resolution. Besides, existing methods perform well in most regions but struggle to produce sharp edges in occluded regions and resolve ambiguities in texture-less regions. To address these issues, we propose the concept of stitched-EPI (SEPI) to enhance slope computation. SEPI achieves this by shifting and concatenating lines from different EPIs that correspond to the same 3D point. Moreover, we introduce the half-SEPI algorithm, which focuses exclusively on the non-occluded portion of lines to handle occlusion. Additionally, we present a depth propagation strategy aimed at improving depth estimation in texture-less regions. This strategy involves determining the depth of such regions by progressing from the edges towards the interior, prioritizing accurate regions over coarse regions. Through extensive experimental evaluations and ablation studies, we validate the effectiveness of our proposed method. The results demonstrate its superior ability to generate more accurate and robust depth maps across all regions compared to state-of-the-art methods. The source code will be publicly available at https://github.com/PingZhou-LF/Light-Field-Depth-Estimation-Based-on-Stitched-EPIs .Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (52071075, 11572087)
- Hong Kong Research Grants Council (11218121)
- Innovation and Technology Commission (MHP/117/21)
This publication has 64 references indexed in Scilit:
- Unsupervised Depth Estimation from Light Field Using a Convolutional Neural Network2018
- Occlusion-aware depth estimation for light field using multi-orientation EPIsPattern Recognition, 2018
- A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields2017
- Depth from Gradients in Dense Light Fields for Object Reconstruction2016
- Convolutional Networks for Shape from Light Field2016
- Robust depth estimation for light field via spinning parallelogram operatorComputer Vision and Image Understanding, 2016
- Light Field Stereo Matching Using Bilateral Statistics of Surface Cameras2014
- Saliency Detection on Light Field2014
- Cross-Scale Cost Aggregation for Stereo Matching2014
- Shape measurement by a multi-view methodology based on the remote tracking of a 3D optical scannerOptics and Lasers in Engineering, 2012