Viewport-Driven Rate-Distortion Optimized 360º Video Streaming
Authors:
- Jacob ChakareskiJCJacob Chakareski
- Ridvan AksuRARidvan Aksu
- Xavier CorbillonXCXavier Corbillon
- Gwendal SimonGSGwendal Simon
- Viswanathan SwaminathanVSViswanathan Swaminathan
- 1 May 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
The growing popularity of virtual and augmented reality communications and 360° video streaming is moving video communication systems into much more dynamic and resource-limited operating settings. The enormous data volume of 360° videos requires an efficient use of network bandwidth to maintain the desired quality of experience for the end user. To this end, we propose a framework for viewport-driven rate-distortion optimized 360° video streaming that integrates the user view navigation pattern and the spatiotemporal rate-distortion characteristics of the 360° video content to maximize the delivered user quality of experience for the given network/system resources. The framework comprises a methodology for constructing dynamic heat maps that capture the likelihood of navigating different spatial segments of a 360° video over time by the user, an analysis and characterization of its spatiotemporal rate-distortion characteristics that leverage preprocessed spatial tilling of the 360° view sphere, and an optimization problem formulation that characterizes the delivered user quality of experience given the user navigation patterns, 360° video encoding decisions, and the available system/network resources. Our experimental results demonstrate the advantages of our framework over the conventional approach of streaming a monolithic uniformly-encoded 360° video and a state-of-the-art reference method. Considerable video quality gains of 4 - 5 dB are demonstrated in the case of two popular 4K 360° videos.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Adaptive 360-Degree Video Streaming using Scalable Video Coding2017
- Characterization of 360-degree Videos2017
- Towards Bandwidth Efficient Adaptive Streaming of Omnidirectional Video over HTTP2017
- Improving Virtual Reality Streaming using HTTP/22017
- Viewport-adaptive navigable 360-degree video delivery2017
- Adaptive 360 VR Video Streaming: Divide and Conquer2016
- Optimizing 360 video delivery over cellular networks2016
- A Framework to Evaluate Omnidirectional Video Coding Schemes2015
- Characteristics of Head-Mounted Displays and Their Effects on Simulator SicknessHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2011
- Convex Optimization2004