Omnidirectional Images as Moving Camera Videos
Authors:
- Xiangjie SuiXSXiangjie Sui
- Kede MaKMKede Ma
- Yiru YaoYYYiru Yao
- Yuming FangYFYuming Fang
Preprint
Abstract
Omnidirectional images (also referred to as static 360{\deg} panoramas) impose viewing conditions much different from those of regular 2D images. A natural question arises: how do humans perceive image distortions in immersive virtual reality (VR) environments? We argue that, apart from the distorted panorama itself, three types of viewing behavior governed by VR conditions are crucial in determining its perceived quality: starting point, exploration time, and scanpath. In this paper, we propose a principled computational framework for objective quality assessment of 360{\deg} images, which embodies the threefold behavior in a delightful way. Specifically, we first transform an omnidirectional image to several video representations using viewing behavior of different users. We then leverage the recent advances in full-reference 2D image/video quality assessment to compute the perceived quality of the panorama. We construct a set of specific quality measures within the proposed framework, and demonstrate their promises on two VR quality databases.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- Comparison of Full-Reference Image Quality Models for Optimization of Image Processing SystemsInternational Journal of Computer Vision, 2021
- A Comparative Evaluation Of Temporal Pooling Methods For Blind Video Quality Assessment2020
- C3DVQA: Full-Reference Video Quality Assessment with 3D Convolutional Neural Network2020
- State-of-the-Art in 360° Video/Image Processing: Perception, Assessment and CompressionIEEE Journal of Selected Topics in Signal Processing, 2020
- Weighted-to-Spherically-Uniform Quality Evaluation for Omnidirectional VideoIEEE Signal Processing Letters, 2017
- Visual Importance Pooling for Image Quality AssessmentIEEE Journal of Selected Topics in Signal Processing, 2009
- Recency and duration neglect in subjective assessment of television picture qualityApplied Cognitive Psychology, 2001
- Efficient, robust, and fast global motion estimation for video codingIEEE Transactions on Image Processing, 2000
- Scanpaths in saccadic eye movements while viewing and recognizing patternsVision Research, 1971
- The serial position effect of free recall.Journal of Experimental Psychology, 1962