Compression of Plenoptic Point Cloud Attributes Using 6-D Point Clouds and 6-D Transforms
- 19 November 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 25 (15209210) , 593-607
Abstract
In this paper, we introduce a novel 6-D representation of plenoptic point clouds, enabling joint, non-separable transform coding of plenoptic signals defined along both spatial and angular (viewpoint) dimensions. This 6-D representation, which is built in a global coordinate system, can be used in both multi-camera studio capture and video fly-by capture scenarios, with various viewpoint (camera) arrangements and densities. We show that both the Region-Adaptive Hierarchical Transform (RAHT) and the Graph Fourier Transform (GFT) can be extended to the proposed 6-D representation to enable the non-separable transform coding. Our method is applicable to plenoptic data with either dense or sparse sets of viewpoints, and to complete or incomplete plenoptic data, while the state-of-the-art RAHT-KLT method, which is separable in spatial and angular dimensions, is applicable only to complete plenoptic data. The "complete'' plenoptic data refers to data that has, for each spatial point, one colour for every viewpoint (ignoring any occlusions), while "incomplete'' data has colours only for the visible surface points at each viewpoint. We demonstrate that the proposed 6-D RAHT and 6-D GFT compression methods are able to outperform the state-of-the-art RAHT-KLT method on 3-D objects with various levels of surface specularity, and captured with different camera arrangements and different degrees of viewpoint sparsity.Keywords
Funding Information
- EU H2020 Research and Innovation Programme (694122)
This publication has 32 references indexed in Scilit:
- Point cloud attribute compression with graph transform2014
- Lambertian Reflectance2014
- Learning based compression of surface light fields for real-time rendering of global illumination scenes2013
- Robust principal component analysis?Journal of the ACM, 2011
- Adaptive Run-Length / Golomb-Rice Encoding of Quantized Generalized Gaussian Sources with Unknown Statistics2006
- Light field mappingACM Transactions on Graphics, 2002
- Surface light fields for 3D photography2000
- Spectral compression of mesh geometry2000
- Lazy decompression of surface light fields for precomputed global illumination1998
- A signal processing approach to fair surface design1995