Regional Bit Allocation and Rate Distortion Optimization for Multiview Depth Video Coding With View Synthesis Distortion Model
- 3 June 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 22 (9) , 3497-3512
Abstract
In this paper, we propose a view synthesis distortion model (VSDM) that establishes the relationship between depth distortion and view synthesis distortion for the regions with different characteristics: color texture area corresponding depth (CTAD) region and color smooth area corresponding depth (CSAD), respectively. With this VSDM, we propose regional bit allocation (RBA) and rate distortion optimization (RDO) algorithms for multiview depth video coding (MDVC) by allocating more bits on CTAD for rendering quality and fewer bits on CSAD for compression efficiency. Experimental results show that the proposed VSDM based RBA and RDO can improve the coding efficiency significantly for the test sequences. In addition, for the proposed overall MDVC algorithm that integrates VSDM based RBA and RDO, it achieves 9.99% and 14.51% bit rate reduction on average for the high and low bit rate, respectively. It can improve virtual view image quality 0.22 and 0.24 dB on average at the high and low bit rate, respectively, when compared with the original joint multiview video coding model. The RD performance comparisons using five different metrics also validate the effectiveness of the proposed overall algorithm. In addition, the proposed algorithms can be applied to both INTRA and INTER frames.Keywords
This publication has 27 references indexed in Scilit:
- Boundary Artifact Reduction in View Synthesis of 3D Video: From Perspective of Texture-Depth AlignmentIEEE Transactions on Broadcasting, 2011
- Sensitivity Analysis of the Human Visual System for Depth Cues in Stereoscopic 3-D DisplaysIEEE Transactions on Multimedia, 2011
- Depth No-Synthesis-Error Model for View Synthesis in 3-D VideoIEEE Transactions on Image Processing, 2011
- A Novel Rate Control Technique for Multiview Video Plus Depth Based 3D Video CodingIEEE Transactions on Broadcasting, 2011
- Display Dependent Preprocessing of Depth Maps Based on Just Noticeable Depth Difference ModelingIEEE Journal of Selected Topics in Signal Processing, 2011
- Reduced resolution depth coding for stereoscopic 3D videoIEEE Transactions on Consumer Electronics, 2010
- A Rate-Distortion Optimization Algorithm for Rate Control in H.2642007
- Frame bit allocation for the H.264/AVC video coder via Cauchy-density-based rate and distortion modelsIEEE Transactions on Circuits and Systems for Video Technology, 2005
- A study on rate distortion optimization scheme for JVT coder2003
- Joint optimization of communication rates and linear systemsIEEE Transactions on Automatic Control, 2003