VQAMap: A Novel Mechanism for Mapping Objective Video Quality Metrics to Subjective MOS Scale
- 10 June 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Broadcasting
- Vol. 62 (3) , 610-627
Abstract
The reliable estimation of video quality has become increasingly important with the proliferation of online video services and users becoming more quality aware. A multitude of objective video quality assessment (VQA) metrics with various performance and complexity have been proposed. However, their applicability in real-world scenarios is limited by the lack of clear interpretations of how the metric values reflect the subjective user-perceived video quality. This paper proposes a novel mechanism called VQAMap, that uses data from public VQA databases and enables to automatically create generic rules for mapping the values of objective VQA metrics to the subjective MOS scale (i.e., 1-bad, 2-poor, 3-fair, 4-good, and 5-excellent). An extensive evaluation study of VQAMap was conducted using data from three public VQA databases, considering six objective VQA metrics. The results analysis has shown that VQAMap provides mapping rules with quality estimation accuracy as high as 95%, while the variation in performance being caused by the varying accuracy of the different objective metrics.Keywords
Funding Information
- Irish Research Council Embark Postgraduate Scholarship Scheme
This publication has 40 references indexed in Scilit:
- Analysis of Distortion Distribution for Pooling in Image Quality PredictionIEEE Transactions on Broadcasting, 2016
- Performance evaluation of EMOS model for mapping-based Video Quality estimation2015
- Quality Assessment Considering Viewing Distance and Image ResolutionIEEE Transactions on Broadcasting, 2015
- Image quality assessment based on multi-scale representation of structureDigital Signal Processing, 2014
- Image Quality Assessment Based on Low Order Moment FeaturesIEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2014
- Quality Utility modelling for multimedia applications for Android Mobile devices2012
- Efficient Reduced-Reference Video Quality MeterIEEE Transactions on Broadcasting, 2008
- Image information and visual qualityIEEE Transactions on Image Processing, 2006
- Multiscale structural similarity for image quality assessment2004
- Video quality assessment based on structural distortion measurementSignal Processing: Image Communication, 2004