Perceptual Quality Aware Adaptive 360-Degree Video Streaming with Deep Reinforcement Learning
Authors:
- 16 May 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1190-1195
Abstract
As 360-degree videos are with high data volume, it is a great challenge to deliver the content and provide a high quality of experience (QoE) for users. In this paper, we investigate the tile-level rate allocation problem with the purpose of optimizing users’ QoE. Specifically, we find the nonlinearity between video quality and bitrate through extensive experiments. Thus, a QoE metric is defined to better measure the perceptual quality. Considering the sequential decision nature of video streaming, we formulate the rate decision problem as an Markov Decision Process. Then we propose a deep reinforcement learning based rate adaptive streaming approach to solve this problem. However, the solution space is large as a 360-degree video is spatially partitioned into multiple tiles. In order to address the problem of combinatorial explosion, we propose a tile classification method based on the predicted viewpoint. Experimental results based on real-world traces show that our algorithm can improve the overall QoE by 16% − 22% compared to existing algorithms.Keywords
Funding Information
- Natural Science Foundation of Hubei Province
- Fundamental Research Funds for the Central Universities
- Natural Science Foundation of Hunan Province
This publication has 18 references indexed in Scilit:
- LeaD: Large-Scale Edge Cache Deployment Based on Spatio-Temporal WiFi Traffic StatisticsIEEE Transactions on Mobile Computing, 2020
- DRL360: 360-degree Video Streaming with Deep Reinforcement Learning2019
- Content Popularity Prediction Towards Location-Aware Mobile Edge CachingIEEE Transactions on Multimedia, 2018
- Spherical Structural Similarity Index for Objective Omnidirectional Video Quality Assessment2018
- CUB360: Exploiting Cross-Users Behaviors for Viewport Prediction in 360 Video Adaptive Streaming2018
- Beyond throughput2018
- Gaze Prediction in Dynamic 360° Immersive Videos2018
- Synergy of Big Data and 5G Wireless Networks: Opportunities, Approaches, and ChallengesIEEE Wireless Communications, 2018
- Prioritized Buffer Control in Two-tier 360 Video Streaming2017
- Towards Bandwidth Efficient Adaptive Streaming of Omnidirectional Video over HTTP2017