KeyNode-Driven Geometry Coding for Real-World Scanned Human Dynamic Mesh Compression
Authors:
- Huong HoangHHHuong Hoang
- Truong NguyenTNTruong Nguyen
- Pamela CosmanPCPamela Cosman
Preprint
Abstract
The compression of real-world scanned 3D human dynamic meshes is an emerging research area, driven by applications such as telepresence, virtual reality, and 3D digital streaming. Unlike synthesized dynamic meshes with fixed topology, scanned dynamic meshes often not only have varying topology across frames but also scan defects such as holes and outliers, increasing the complexity of prediction and compression. Additionally, human meshes often combine rigid and non-rigid motions, making accurate prediction and encoding significantly more difficult compared to objects that exhibit purely rigid motion. To address these challenges, we propose a compression method designed for real-world scanned human dynamic meshes, leveraging embedded key nodes. The temporal motion of each vertex is formulated as a distance-weighted combination of transformations from neighboring key nodes, requiring the transmission of solely the key nodes' transformations. To enhance the quality of the KeyNode-driven prediction, we introduce an octree-based residual coding scheme and a Dual-direction prediction mode, which uses I-frames from both directions. Extensive experiments demonstrate that our method achieves significant improvements over the state-of-the-art, with an average bitrate saving of 24.51% across the evaluated sequences, particularly excelling at low bitrates.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Video and Subdivision based Mesh Coding2022
- Compression of Time-Varying Textured Meshes using Patch Tiling and Image-based Tracking2022
- Efficient Registration for Human Surfaces via Isometric Regularization on Embedded DeformationIEEE Transactions on Visualization and Computer Graphics, 2022
- Efficient Fine-Granular Scalable Coding of 3D Mesh SequencesIEEE Transactions on Multimedia, 2012
- Improved prediction methods for scalable predictive animated mesh compressionJournal of Visual Communication and Image Representation, 2011
- Time-Varying Mesh Compression Using an Extended Block Matching AlgorithmIEEE Transactions on Circuits and Systems for Video Technology, 2007
- Temporal wavelet-based compression for 3D animated modelsComputers & Graphics, 2007
- Compression of soft-body animation sequencesComputers & Graphics, 2004
- Compression of Dynamic 3D Geometry Data Using Iterative Closest Point AlgorithmComputer Vision and Image Understanding, 2002
- Design and performance of tree-structured vector quantizersInformation Processing & Management, 1994