Depth map compression using multi-resolution graph-based transform for depth-image-based rendering
Authors:
- 1 September 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15224880,p. 1297-1300
Abstract
Depth map compression is important for efficient network transmission of 3D visual data in texture-plus-depth format, where the observer can synthesize an image of a freely chosen viewpoint via depth-image-based rendering (DIBR) using received neighboring texture and depth maps as anchors. Unlike texture maps, depth maps exhibit unique characteristics like smooth interior surfaces and sharp edges that can be exploited for coding gain. In this paper, we propose a multi-resolution approach to depth map compression using previously proposed graph-based transform (GBT). The key idea is to treat smooth surfaces and sharp edges of large code blocks separately and encode them in different resolutions: encode edges in original high resolution (HR) to preserve sharpness, and encode smooth surfaces in low-pass-filtered and down-sampled low resolution (LR) to save coding bits. Because GBT does not filter across edges, it produces small or zero high-frequency components when coding smooth-surface depth maps and leads to a compact representation in the transform domain. By encoding down-sampled surface regions in LR GBT, we achieve representation compactness for a large block without the high computation complexity associated with an adaptive large-block GBT. At the decoder, encoded LR surfaces are up-sampled and interpolated while preserving encoded HR edges. Experimental results show that our proposed multi-resolution approach using GBT reduced bitrate by 68% compared to native H.264 intra with DCT encoding original HR depth maps, and by 55% compared to single-resolution GBT encoding small blocks.Keywords
This publication has 9 references indexed in Scilit:
- Transform domain sparsification of depth maps using iterative quadratic programming2011
- Wavelets on graphs via spectral graph theoryApplied and Computational Harmonic Analysis, 2011
- Edge-adaptive transforms for efficient depth map coding2010
- Depth map distortion analysis for view rendering and depth coding2009
- Edge-preserving depth-map coding using graph-based wavelets2009
- Image Super-Resolution by TV-Regularization and Bregman IterationJournal of Scientific Computing, 2008
- Wavelet-Based Joint Estimation and Encoding of Depth-Image-Based Representations for Free-Viewpoint RenderingIEEE Transactions on Image Processing, 2008
- Directional Discrete Cosine Transforms for Image Coding2006
- Post-rendering 3D warping1997