Perceptual Quality Assessment of Omnidirectional Images as Moving Camera Videos
- 12 January 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 28 (8) , 3022-3034
Abstract
Omnidirectional images (also referred to as static 360 $^{\circ }$ panoramas) impose viewing conditions much different from those of regular 2D images. How do humans perceive image distortions in immersive virtual reality (VR) environments is an important problem which receives less attention. We argue that, apart from the distorted panorama itself, two types of VR viewing conditions are crucial in determining the viewing behaviors of users and the perceived quality of the panorama: the starting point and the exploration time. We first carry out a psychophysical experiment to investigate the interplay among the VR viewing conditions, the user viewing behaviors, and the perceived quality of 360 $^{\circ }$ images. Then, we provide a thorough analysis of the collected human data, leading to several interesting findings. Moreover, we propose a computational framework for objective quality assessment of 360 $^{\circ }$ images, embodying viewing conditions and behaviors in a delightful way. Specifically, we first transform an omnidirectional image to several video representations using different user viewing behaviors under different viewing conditions. We then leverage advanced 2D full-reference video quality models to compute the perceived quality. We construct a set of specific quality measures within the proposed framework, and demonstrate their promises on three VR quality databases.
Keywords
All Related Versions
Funding Information
- National Key R&D Program of China (2018AAA0100601)
- National Natural Science Foundation of China (62071407, 61822109)
- Fok Ying Tung Education Foundation (161061)
- Jiangxi Natural Science Foundation of China (20202ACB202007)
- CityU APRC (9610487)
This publication has 37 references indexed in Scilit:
- Perceptual Losses for Real-Time Style Transfer and Super-Resolution2016
- A Framework to Evaluate Omnidirectional Video Coding Schemes2015
- SSIM-optimal linear image restoration2008
- A Statistical Evaluation of Recent Full Reference Image Quality Assessment AlgorithmsIEEE Transactions on Image Processing, 2006
- An information fidelity criterion for image quality assessment using natural scene statisticsIEEE Transactions on Image Processing, 2005
- Multiscale structural similarity for image quality assessment2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Recency and duration neglect in subjective assessment of television picture qualityApplied Cognitive Psychology, 2001
- Efficient, robust, and fast global motion estimation for video codingIEEE Transactions on Image Processing, 2000
- Scanpaths in saccadic eye movements while viewing and recognizing patternsVision Research, 1971