Spectral Analysis With a Piecewise Separation Occlusion Model for Image-Based Rendering
- 16 September 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Imaging
- Vol. 8 (25730436) , 822-837
Abstract
Occlusion is ubiquitous in the real world, and neglecting it will certainly lead to quality degeneration in a reconstructed light field (LF). In this paper, we derive a piecewise separation occlusion model (PSOM) for LF reconstruction that is optimized for occlusion in the continuous Fourier and integral domains. The PSOM is first obtained by determining the definite integral intervals between the occlusion and nonocclusion boundaries in the spatial domain along the camera direction. We then use these definite integral intervals to perform spectral analysis of the plenoptic function (POF) to derive the occluded and nonoccluded plenoptic spectra. Finally, we show that using the two sampling rates derived from the occluded and nonoccluded spectra is more effective than using a uniform sampling rate for reconstructing a single scene unless the scene is free of occlusion. Through numerical experiments on simulated signals and real-world inward-looking and outward-looking scenes, we demonstrate the effectiveness of our proposed approach.Keywords
Funding Information
- National Natural Science Foundation of China (61961005, 61871437)
- Natural Science Foundation of Guangxi Province (2018GXNSFAA281195, 2019AC20121 (AD19245085))
This publication has 49 references indexed in Scilit:
- Light Field Reconstruction Using Sparsity in the Continuous Fourier DomainACM Transactions on Graphics, 2014
- Depth synthesis and local warps for plausible image-based navigationACM Transactions on Graphics, 2013
- Silhouette‐Aware Warping for Image‐Based RenderingComputer Graphics Forum, 2011
- A frequency analysis of light transportACM Transactions on Graphics, 2005
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Survey of image-based representations and compression techniquesIEEE Transactions on Circuits and Systems for Video Technology, 2003
- Spectral analysis for sampling image-based rendering dataIEEE Transactions on Circuits and Systems for Video Technology, 2003
- The convergence of graphics and visionComputer, 1998
- Epipolar-plane image analysis: An approach to determining structure from motionInternational Journal of Computer Vision, 1987
- Theory for Off-Specular Reflection From Roughened Surfaces*Journal of the Optical Society of America, 1967