Fast Video-Based Point Cloud Compression Based on Early Termination and Transformer Model
- 16 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 8 (3) , 2336-2348
Abstract
Video-based Point Cloud Compression (V-PCC) was proposed by the Moving Picture Experts Group (MPEG) to standardize Point Cloud Compression (PCC). The main idea of V-PCC is to project the Dynamic Point Cloud (DPC) into auxiliary information, occupancy, geometry, and attribute videos for encoding utilizing High Efficiency Video Coding (HEVC), Versatile Video Coding (VVC), etc. Compared with the previous PCC algorithms, V-PCC has achieved a significant improvement in compression efficiency. However, it is accompanied by substantial computational complexity. To solve this problem, this paper proposes a fast V-PCC method to decrease the coding complexity. Taking into account the coding characteristic of V-PCC, the geometry and attribute maps are first classified into occupied and unoccupied blocks. Moreover, we analyze Coding Unit (CU) splitting for geometry and attribute map. Finally, we propose fast V-PCC algorithms based on early termination algorithm and transformer model, in which the early termination method is proposed for low complexity blocks in the geometry and attribute map, and the transformer model-based fast method is designed to predict the optimal CU splitting modes for the occupied block of the attribute map. The proposed algorithms are implemented with typical DPC sequences on the Test Model Category 2 (TMC2). The experimental results imply that the average time of the proposed method can significantly reduce 56.39% and 55.10% in the geometry and attribute map, respectively, with negligible Bjontegaard-Delta bitrate (BD-rate) compared with the anchor method.Keywords
Funding Information
- National Natural Science Foundation of China (61671283, U2033218)
This publication has 33 references indexed in Scilit:
- Dynamic Point Cloud Compression with Cross-Sectional Approach2023
- A fast Multi-Type-Tree split decision algorithm of intra coding unit in VVC2022
- Low-complexity intra coding scheme based on Bayesian and L-BFGS for VVCDigital Signal Processing, 2022
- Transformer-based Image Compression2022
- A Fast Multi-tree Partition Algorithm Based on Spatial-temporal Correlation for VVC2022
- Performance Evaluation of the Codec Agnostic Approach in MPEG-I Video-Based Point Cloud CompressionIEEE Access, 2021
- Efficient Quadtree Search for HEVC Coding Units for V-PCCIEEE Access, 2021
- Swin Transformer: Hierarchical Vision Transformer using Shifted Windows2021
- Occupancy-Map-Based Rate Distortion Optimization for Video-Based Point Cloud Compression2019
- Dynamic Point Cloud Geometry Compression via Patch-wise Polynomial Fitting2019