Display Dependent Preprocessing of Depth Maps Based on Just Noticeable Depth Difference Modeling
- 24 January 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 5 (2) , 335-351
Abstract
This paper addresses the sensitivity of human vision to spatial depth variations in a 3-D video scene, seen on a stereoscopic display, based on an experimental derivation of a just noticeable depth difference (JNDD) model. The main target is to exploit the depth perception sensitivity of humans in suppressing the unnecessary spatial depth details, hence reducing the transmission overhead allocated to depth maps. Based on the JNDD model derived, depth map sequences are preprocessed to suppress the depth details that are not perceivable by the viewers and to minimize the rendering artefacts that arise due to optical noise, where the optical noise is triggered by the inaccuracies in the depth estimation process. Theoretical and experimental evidences are provided to illustrate that the proposed depth adaptive preprocessing filter does not alter the 3-D visual quality or the view synthesis quality for free-viewpoint video applications. Experimental results suggest that the bit rate for depth map coding can be reduced up to 78% for the depth maps captured with depth-range cameras and up to 24% for the depth maps estimated with computer vision algorithms, without affecting the 3-D visual quality or the arbitrary view synthesis quality.Keywords
This publication has 10 references indexed in Scilit:
- Efficient edge, motion and depth-range adaptive processing for enhancement of multi-view depth map sequences2009
- Quality Evaluation of Color Plus Depth Map-Based Stereoscopic VideoIEEE Journal of Selected Topics in Signal Processing, 2009
- Generation of ROI Enhanced Depth Maps Using Stereoscopic Cameras and a Depth CameraIEEE Transactions on Broadcasting, 2008
- Prediction of stereoscopic video quality using objective quality models of 2-D videoElectronics Letters, 2008
- Distance Dependent Depth Filtering in 3D Warping for 3DTV2007
- Stereoscopic Image Generation Based on Depth Images for 3D TVIEEE Transactions on Broadcasting, 2005
- High-quality video view interpolation using a layered representationACM Transactions on Graphics, 2004
- Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV2004
- Bilateral filtering for gray and color images2002
- Perceiving Layout and Knowing Distances1995