Advanced 3D Motion Prediction for Video-Based Dynamic Point Cloud Compression
- 2 August 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 29 (10577149) , 289-302
Abstract
Point cloud based immersive media representation format has provided many opportunities for extended reality applications and has become widely used in volumetric content capturing scenarios. The high data rate of the point cloud is one of the key problems preventing the adoption of this media format. MPEG Immersive media working group (MPEG-I) aims to create a point cloud compression methodology relying on the existing video coding hardware implementations to solve this problem. However, in the scope of the state-of-the-art video-based dynamic point cloud compression (V-PCC) standard under MPEG-I, the intrinsic 3D object’s motion continuity is destroyed by the 2D projections resulting in a significant loss of inter prediction coding efficiency. In this paper, we first propose a general model utilizing the 3D motion and 3D to 2D correspondence to calculate the 2D motion vector (MV). Then under the V-PCC, we propose a geometry-based method using the accurate 3D reconstructed geometry from the 2D geometry video to estimate the 2D MV in the 2D attribute video. In addition, we propose an auxiliary-information-based method using the coarse 3D reconstructed geometry provided by the auxiliary information to estimate the 2D MV in both the 2D geometry and attribute videos. Furthermore, we provide the following two ways to use the estimated 2D MV to improve the coding efficiency. The first one is normative. We propose adding the estimated MV into the advanced motion vector candidate list and find a better motion vector predictor for each prediction unit (PU). The second one is non-normative. We propose applying the estimated MV as an additional candidate of the centers for motion estimation. We implement the proposed algorithms in the V-PCC reference software. The experimental results show that the proposed methods present significant coding gains compared with the current state-of-the-art motion prediction algorithm.Keywords
Funding Information
- National Basic Research Program of China (2015CB351803)
This publication has 16 references indexed in Scilit:
- Motion-Compensated Compression of Dynamic Voxelized Point CloudsIEEE Transactions on Image Processing, 2017
- Frame Rate Up-Conversion Based Motion Vector Derivation for Hybrid Video Coding2017
- Design, Implementation, and Evaluation of a Point Cloud Codec for Tele-Immersive VideoIEEE Transactions on Circuits and Systems for Video Technology, 2016
- Graph-Based Compression of Dynamic 3D Point Cloud SequencesIEEE Transactions on Image Processing, 2016
- Overview of the Multiview and 3D Extensions of High Efficiency Video CodingIEEE Transactions on Circuits and Systems for Video Technology, 2015
- Overview of SHVC: Scalable Extensions of the High Efficiency Video Coding StandardIEEE Transactions on Circuits and Systems for Video Technology, 2015
- Immersive 3D TelepresenceComputer, 2014
- Inter-view motion prediction in 3D-HEVC2014
- Overview of the High Efficiency Video Coding (HEVC) StandardIEEE Transactions on Circuits and Systems for Video Technology, 2012
- Real-time compression of point cloud streams2012