Very Long Term Field of View Prediction for 360-Degree Video Streaming
Authors:
- Chenge LiCLChenge Li
- Weixi ZhangWZWeixi Zhang
- Yong LiuYLYong Liu
- Yao WangYWYao Wang
- 1 March 2019
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 297-302
Abstract
360-degree videos have gained increasing popularity in recent years with the developments and advances in Virtual Reality (VR) and Augmented Reality (AR) technologies. In such applications, a user only watches a video scene within a field of view (FoV) centered in a certain direction. Predicting the future FoV in a long time horizon (more than seconds ahead) can help save bandwidth resources in on-demand video streaming while minimizing video freezing in networks with significant bandwidth variations. In this work, we treat the FoV prediction as a sequence learning problem, and propose to predict the target user's future FoV not only based on the user's own past FoV center trajectory but also other users' future FoV locations. We propose multiple prediction models based on two different FoV representations: one using FoV center trajectories and another using equirectangular heatmaps that represent the FoV center distributions. Extensive evaluations with two public datasets demonstrate that the proposed models can significantly outperform benchmark models, and other users' FoVs are very helpful for improving long-term predictions.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- CLS2018
- Predicting Head Movement in Panoramic Video: A Deep Reinforcement Learning ApproachIEEE Transactions on Pattern Analysis and Machine Intelligence, 2018
- Multi-path multi-tier 360-degree video streaming in 5G networks2018
- Gaze Prediction in Dynamic 360° Immersive Videos2018
- Fixation Prediction for 360° Video Streaming in Head-Mounted Virtual Reality2017
- A Dataset for Exploring User Behaviors in VR Spherical Video Streaming2017
- Shooting a moving target: Motion-prediction-based transmission for 360-degree videos2016
- Effective Approaches to Attention-based Neural Machine Translation2015