Light Field Depth Estimation via Stitched Epipolar Plane Images
Preprint
Abstract
Depth estimation is a fundamental problem in light field processing. Epipolar-plane image (EPI)-based methods often encounter challenges such as low accuracy in slope computation due to discretization errors and limited angular resolution. Besides, existing methods perform well in most regions but struggle to produce sharp edges in occluded regions and resolve ambiguities in texture-less regions. To address these issues, we propose the concept of stitched-EPI (SEPI) to enhance slope computation. SEPI achieves this by shifting and concatenating lines from different EPIs that correspond to the same 3D point. Moreover, we introduce the half-SEPI algorithm, which focuses exclusively on the non-occluded portion of lines to handle occlusion. Additionally, we present a depth propagation strategy aimed at improving depth estimation in texture-less regions. This strategy involves determining the depth of such regions by progressing from the edges towards the interior, prioritizing accurate regions over coarse regions. Through extensive experimental evaluations and ablation studies, we validate the effectiveness of our proposed method. The results demonstrate its superior ability to generate more accurate and robust depth maps across all regions compared to state-of-the-art methods. The source code will be publicly available at https://github.com/PingZhou-LF/Light-Field-Depth-Estimation-Based-on-Stitched-EPIs.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Enhanced Local Optimization Framework for Light Field Disparity Estimation2022
- Occlusion-aware depth estimation for light field using multi-orientation EPIsPattern Recognition, 2018
- Light Field Image Processing: An OverviewIEEE Journal of Selected Topics in Signal Processing, 2017
- Occlusion-Model Guided Antiocclusion Depth Estimation in Light FieldIEEE Journal of Selected Topics in Signal Processing, 2017
- A Light-Field Journey to Virtual RealityIEEE MultiMedia, 2017
- Light-Field Depth Estimation via Epipolar Plane Image Analysis and Locally Linear EmbeddingIEEE Transactions on Circuits and Systems for Video Technology, 2016
- Robust depth estimation for light field via spinning parallelogram operatorComputer Vision and Image Understanding, 2016
- Shape measurement by a multi-view methodology based on the remote tracking of a 3D optical scannerOptics and Lasers in Engineering, 2012
- Mean shift: a robust approach toward feature space analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Epipolar-plane image analysis: An approach to determining structure from motionInternational Journal of Computer Vision, 1987