Salient Motion Features for Video Quality Assessment
Authors:
- 1 April 2011
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 20 (4) , 948-958
Abstract
Design of algorithms that are able to estimate video quality as perceived by human observers is of interest for a number of applications. Depending on the video content, the artifacts introduced by the coding process can be more or less pronounced and diversely affect the quality of videos, as estimated by humans. While it is well understood that motion affects both human attention and coding quality, this relationship has only recently started gaining attention among the research community, when video quality assessment (VQA) is concerned. In this paper, the effect of calculating several objective measure features, related to video coding artifacts, separately for salient motion and other regions of the frames of the sequence is examined. In addition, we propose a new scheme for quality assessment of coded video streams, which takes into account salient motion. Standardized procedure has been used to calculate the Mean Opinion Score (MOS), based on experiments conducted with a group of non-expert observers viewing standard definition (SD) sequences. MOS measurements were taken for nine different SD sequences, coded using MPEG-2 at five different bit-rates. Eighteen different published approaches related to measuring the amount of coding artifacts objectively on a single-frame basis were implemented. Additional features describing the intensity of salient motion in the frames, as well as the intensity of coding artifacts in the salient motion regions were proposed. Automatic feature selection was performed to determine the subset of features most correlated to video quality. The results show that salient-motion-related features enhance prediction and indicate that the presence of blocking effect artifacts and blurring in the salient regions and variance and intensity of temporal changes in non-salient regions influence the perceived video quality.Keywords
This publication has 38 references indexed in Scilit:
- Bayesian surprise attracts human attentionVision Research, 2009
- An Attention-Driven Model for Grouping Similar Images with Image Retrieval ApplicationsEURASIP Journal on Advances in Signal Processing, 2006
- Statistical Modeling of Complex Backgrounds for Foreground Object DetectionIEEE Transactions on Image Processing, 2004
- Video quality assessment based on structural distortion measurementSignal Processing: Image Communication, 2004
- Segregation of object and background motion in the retinaNature, 2003
- A model of saliency-based visual attention for rapid scene analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Selection of relevant features and examples in machine learningArtificial Intelligence, 1997
- Modeling visual attention via selective tuningArtificial Intelligence, 1995
- 1st- and 2nd-order motion and texture resolution in central and peripheral visionVision Research, 1995
- The Variation of Critical Fusion Frequency with Brightness at Various Retinal Locations*Journal of the Optical Society of America, 1951