Compression of Plenoptic Point Clouds
- 22 October 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 28 (3) , 1419-1427
Abstract
Point clouds have been recently used in applications involving real-time capture and rendering of 3D objects. In a point cloud, for practical reasons, each point or voxel is usually associated with one single color along with other attributes. The region-adaptive hierarchical transform (RAHT) coder has been proposed for single-color point clouds. The cloud is usually captured by many cameras and the colors are averaged in some fashion to yield the point color. This approach may not be very realistic since, in real world objects, the reflected light may significantly change with the viewing angle, especially if specular surfaces are present. For that, we are interested in a more complete representation, the plenoptic point cloud, wherein every point has associated colors in all directions. Here, we propose a compression method for such a representation. Instead of encoding a continuous function, since there is only a finite number of cameras, it makes sense to compress as many colors per voxel as cameras, and to leave any intermediary color rendering interpolation to the decoder. Hence, each voxel is associated with a vector of color values, for each color component. We have here developed and evaluated four methods to expand the RAHT coder to encompass the multiple colors case. Experiments with synthetic data helped us to correlate specularity with the compression, since object specularity, at a given point in space, directly affects color disparity among the cameras, impacting the coder performance. Simulations were carried out using natural (captured) data and results are presented as rate-distortion curves that show that a combination of Kahunen-Loève transform and RAHT achieves the best performance.Keywords
Funding Information
- Conselho Nacional de Desenvolvimento Científico e Tecnológico (308150/2014-7)
This publication has 16 references indexed in Scilit:
- Transform Coding for Point Clouds Using a Gaussian Process ModelIEEE Transactions on Image Processing, 2017
- Holoportation2016
- Compression of 3D Point Clouds Using a Region-Adaptive Hierarchical TransformIEEE Transactions on Image Processing, 2016
- Graph-based motion estimation and compensation for dynamic 3D point cloud compression2015
- Point cloud attribute compression with graph transform2014
- Real-time compression of point cloud streams2012
- A Generic Scheme for Progressive Point Cloud CodingIEEE Transactions on Visualization and Computer Graphics, 2008
- Light field mappingACM Transactions on Graphics, 2002
- Surface light fields for 3D photography2000
- Illumination for computer generated picturesCommunications of the ACM, 1975