Differential Transform for Video-Based Plenoptic Point Cloud Coding
- 1 February 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 31 (10577149) , 1994-2003
Abstract
Point cloud compression has been studied in standard bodies and we are here concerned with the Moving Picture Experts Group video-based point cloud compression (V-PCC) solution. Plenoptic point clouds (PPC) is a novel volumetric data representation wherein points are associated with colors in all viewing directions to improve realism. It is sampled as a number ( $N_{c}$ ) of attribute colors per point. We propose a new method for the efficient video-based compression of PPC that is backwards compatible with the existing single-color V-PCC decoder. V-PCC generates three image atlases which are encoded using an image/video encoder. We assume there may be a reference color which is to be encoded as the main payload. We generate $N_{c}+3$ atlases and we produce $N_{c}$ differential images against the reference color image. Those difference images are pixel-wise transformed using an $N_{c}$ -point discrete cosine transform, generating $N_{c}$ transformed atlases which are encoded, forming the secondary payload. Such secondary information is the plenoptic enhancement to the point cloud. If there is no reference attribute, we skip the differences and use the lowest frequency of the transformed atlases as the main payload. Results are presented that show an unrivaled performance of the proposed method.Keywords
Funding Information
- Samsung Eletrônica da Amazônia Ltd., through the “Point Clouds Compression” Project, by the Brazilian Informatics Law (8.248/91)
This publication has 15 references indexed in Scilit:
- Compression of Plenoptic Point CloudsIEEE Transactions on Image Processing, 2018
- A Framework for Surface Light Field Compression2018
- Motion-Compensated Compression of Dynamic Voxelized Point CloudsIEEE Transactions on Image Processing, 2017
- Holoportation2016
- Compression of 3D Point Clouds Using a Region-Adaptive Hierarchical TransformIEEE Transactions on Image Processing, 2016
- High-quality streamable free-viewpoint videoACM Transactions on Graphics, 2015
- Real-time high-resolution sparse voxelization with application to image-based modeling2013
- Viewport: A Distributed, Immersive Teleconferencing System with Infrared Dot PatternIEEE MultiMedia, 2013
- The Road to Immersive CommunicationProceedings of the IEEE, 2012
- Virtually ThereScientific American, 2001