Adaptive Video Streaming via Deep Reinforcement Learning from User Trajectory Preferences
Authors:
- 6 November 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
Client-side adaptive bitrate (ABR) algorithms based on deep reinforcement learning (RL) can continuously improve its adaptability to network conditions. However, most existing methods adopt fixed reward functions to train the ABR policy, which leads the results being not consistent with user-perceived quality of experience (QoE) in a long duration under various network conditions. In order to optimize the QoE, this paper proposes a novel ABR algorithm considering user preference based on short trajectory segments. The user-specific preference feedback, which is selected by the user from a pair of short track segments in advance, is collected and applied to define the training goal of RL. Specifically, we train a deep neural network to define the RL reward and integrate it with A3C-based ABR algorithm. The experiment results show that the accuracy of the proposed reward model outperforms most existing fixed reward functions by 13.6% in user preference prediction, and the optimized ABR algorithm improves QoE by 16.4% on average.Keywords
Funding Information
- National Natural Science Foundation of China
- Natural Science Foundation of Guangxi Province
This publication has 14 references indexed in Scilit:
- A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTPIEEE Communications Surveys & Tutorials, 2018
- A Quality-of-Experience Database for Adaptive Video StreamingIEEE Transactions on Broadcasting, 2018
- Recurrent and Dynamic Models for Predicting Streaming Video Quality of ExperienceIEEE Transactions on Image Processing, 2018
- D-DASH: A Deep Q-Learning Framework for DASH Video StreamingIEEE Transactions on Cognitive Communications and Networking, 2017
- Neural Adaptive Video Streaming with Pensieve2017
- A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTPACM SIGCOMM Computer Communication Review, 2015
- A buffer-based approach to rate adaptation2014
- Improving Fairness, Efficiency, and Stability in HTTP-Based Adaptive Video Streaming With FestiveIEEE/ACM Transactions on Networking, 2014
- Commute path bandwidth traces from 3G networks2013
- OnActor-Critic AlgorithmsSIAM Journal on Control and Optimization, 2003