A new methodology to derive objective quality assessment metrics for scalable multiview 3D video coding
Open Access
- 1 September 2012
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 8 (3s) , 1-25
Abstract
With the growing demand for 3D video, efforts are underway to incorporate it in the next generation of broadcast and streaming applications and standards. 3D video is currently available in games, entertainment, education, security, and surveillance applications. A typical scenario for multiview 3D consists of several 3D video sequences captured simultaneously from the same scene with the help of multiple cameras from different positions and through different angles. Multiview video coding provides a compact representation of these multiple views by exploiting the large amount of inter-view statistical dependencies. One of the major challenges in this field is how to transmit the large amount of data of a multiview sequence over error prone channels to heterogeneous mobile devices with different bandwidth, resolution, and processing/battery power, while maintaining a high visual quality. Scalable Multiview 3D Video Coding (SMVC) is one of the methods to address this challenge; however, the evaluation of the overall visual quality of the resulting scaled-down video requires a new objective perceptual quality measure specifically designed for scalable multiview 3D video. Although several subjective and objective quality assessment methods have been proposed for multiview 3D sequences, no comparable attempt has been made for quality assessment of scalable multiview 3D video. In this article, we propose a new methodology to build suitable objective quality assessment metrics for different scalable modalities in multiview 3D video. Our proposed methodology considers the importance of each layer and its content as a quality of experience factor in the overall quality. Furthermore, in addition to the quality of each layer, the concept of disparity between layers (inter-layer disparity) and disparity between the units of each layer (intra-layer disparity) is considered as an effective feature to evaluate overall perceived quality more accurately. Simulation results indicate that by using this methodology, more efficient objective quality assessment metrics can be introduced for each multiview 3D video scalable modalities.Keywords
This publication has 18 references indexed in Scilit:
- A new Scalable Multi-View Video Coding configuration for mobile applications2011
- 3-D Video Representation Using Depth MapsProceedings of the IEEE, 2010
- Prediction of stereoscopic video quality using objective quality models of 2-D videoElectronics Letters, 2008
- View Scalable Multiview Video Coding Using 3-D Warping With Depth MapIEEE Transactions on Circuits and Systems for Video Technology, 2007
- Overview of the Scalable Video Coding Extension of the H.264/AVC StandardIEEE Transactions on Circuits and Systems for Video Technology, 2007
- A Theoretical Framework for End-to-End Video Quality Prediction of MPEG-based Sequences2007
- Video Quality Metric for Bit Rate Control via Joint Adjustment of Quantization and Frame RateIEEE Transactions on Broadcasting, 2007
- Autostereoscopic 3D displaysComputer, 2005
- High-quality video view interpolation using a layered representation2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004