QoS Aware Transcoding for Live Streaming in Edge-Clouds Aided HetNets: An Enhanced Actor-Critic Approach
- 20 September 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 68 (11) , 11295-11308
Abstract
With the advances in hand-held devices (smart-phones and tablets, etc.) and high speed wireless networks, users have an explosive growth demand for live streaming service. Due to the diversity of user equipments (UEs), the live streaming has to be transcoded into different versions. However, transcoding is a computationally expensive and time consuming process. Due to the dynamic characteristics of wireless network environment, providing high quality and low latency live videos for UEs is a big challenge. This study investigates user scheduling, transcoding decision, computational and wireless spectrum resources allocation problem in edge-clouds aided heterogeneous networks (Het-Nets). The research focuses on improving UEs' quality of service (QoS) for live-streaming services, which includes quality of video and latency requirements. Different from existing literature, to approach the real wireless environment, the available computa- tional and wireless spectrum resources are modeled as random processes in the work. Considering dynamic characteristics of wireless networks and available resources, the above problem is modeled as a Markov decision process (MDP). Since the action space of the MDP is multi-dimensional continuous variables mixed with discrete variables, it is difficult to solve this problem by traditional learning algorithms. Therefore, an enhanced actor-critic algorithm is proposed to resolve the problem, in which both the actor part and the critic part employ eligibility traces. Extensive simulation results with different system parameters show the effectiveness of the proposed algorithm.Keywords
Funding Information
- National Natural Science Foundation of China (11804209)
This publication has 39 references indexed in Scilit:
- Online Cloud Transcoding and Distribution for Crowdsourced Live Game Video StreamingIEEE Transactions on Circuits and Systems for Video Technology, 2016
- Coping With Heterogeneous Video Contributors and Viewers in Crowdsourced Live Streaming: A Cloud-Based ApproachIEEE Transactions on Multimedia, 2016
- Joint Optimization of Radio and Computational Resources for Multicell Mobile-Edge ComputingIEEE Transactions on Signal and Information Processing over Networks, 2015
- A Joint Online Transcoding and Delivery Approach for Dynamic Adaptive StreamingIEEE Transactions on Multimedia, 2015
- TACT: A Transfer Actor-Critic Learning Framework for Energy Saving in Cellular Radio Access NetworksIEEE Transactions on Wireless Communications, 2014
- How much energy is needed to run a wireless network?IEEE Wireless Communications, 2011
- OnActor-Critic AlgorithmsSIAM Journal on Control and Optimization, 2003
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998
- Q-learningMachine Learning, 1992
- Simple statistical gradient-following algorithms for connectionist reinforcement learningMachine Learning, 1992