QoE-Aware 3D Video Streaming via Deep Reinforcement Learning in Software Defined Networking Enabled Mobile Edge Computing
- 25 November 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network Science and Engineering
- Vol. 8 (1) , 419-433
Abstract
With the advancements of wireless network transmission technology, 2D video is hard to satisfy people's requirement for multimedia. Therefore, the high-definition 3D video that can bring a whole new viewing experience is starting to enter people's vision. However, when a tremendously large number of users play 3D video, it puts enormous computational pressure on the cloud server, which incurs high transmission latency. To release the tension, in this paper we consider a promising computing and networking architecture by incorporating Mobile Edge Computing (MEC) and Software-defined Networking (SDN) and propose a novel resource allocation model (RAM) to allocate resources and reduce delay. We propose an Actor-Critic-based deep reinforcement learning algorithm for viewport prediction and QoE optimization, called QoE-AC. For the differential transmission in the playback phase, we use the LSTM network for bandwidth and viewport prediction, while combining the historical information of the blocks into the Actor-Critic network as observations. The SDN-enabled edge network can be adaptively assigned the best transmission speed for future tiles based on observations to maximize QoE. Finally, under different QoE targets, our proposed system can be adapted to all situations and has a 10%-15% performance improvemenKeywords
Funding Information
- National Natural Science Foundation of China (61972448)
- National Natural Science Foundation of China (61972449)
- National Natural Science Foundation of China (61702287)
- Tianjin Association for Science and Technology (TJSQNTJ-2018-19)
- National Natural Science Foundation of China (61802048)
- Dalian University of Technology
- National Natural Science Foundation of China (U19B2004)
- Equipment Development Department (41412010702)
- New R&D Institutions in Zhongshan City (2017F1FC0001)
- National Natural Science Foundation of China (61902445)
- Guangdong Basic and Applied Basic Research Foundation (2019A1515011798)
This publication has 31 references indexed in Scilit:
- A Dataset for Exploring User Behaviors in VR Spherical Video Streaming2017
- Edge computing for interactive media and video streaming2017
- Collaborative Mobile Edge Computing in 5G Networks: New Paradigms, Scenarios, and ChallengesIEEE Communications Magazine, 2017
- Resource Management with Deep Reinforcement Learning2016
- mDASH: A Markov Decision-Based Rate Adaptation Approach for Dynamic HTTP StreamingIEEE Transactions on Multimedia, 2016
- A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTPACM SIGCOMM Computer Communication Review, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Commute path bandwidth traces from 3G networks2013
- Dynamic adaptive streaming over HTTP --2011
- Congestion–distortion optimized video transmission over ad hoc networksSignal Processing: Image Communication, 2005