Optimizing HTTP-Based Adaptive Streaming in Vehicular Environment Using Markov Decision Process
- 26 October 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 17 (12) , 2297-2309
Abstract
Hypertext transfer protocol (HTTP) is the fundamental mechanics supporting web browsing on the Internet. An HTTP server stores large volumes of contents and delivers specific pieces to the clients when requested. There is a recent move to use HTTP for video streaming as well, which promises seamless integration of video delivery to existing HTTP-based server platforms. This is achieved by segmenting the video into many small chunks and storing these chunks as separate files on the server. For adaptive streaming, the server stores different quality versions of the same chunk in different files to allow real-time quality adaptation of the video due to network bandwidth variation experienced by a client. For each chunk of the video, which quality version to download, therefore, becomes a major decision-making challenge for the streaming client, especially in vehicular environment with significant uncertainty in mobile bandwidth. In this paper, we demonstrate that for such decision making, the Markov decision process (MDP) is superior to previously proposed non-MDP solutions. Using publicly available video and bandwidth datasets, we show that the MDP achieves up to a 15x reduction in playback deadline miss compared to a well-known non-MDP solution when the MDP has the prior knowledge of the bandwidth model. We also consider a model-free MDP implementation that uses Q-learning to gradually learn the optimal decisions by continuously observing the outcome of its decision making. We find that the MDP with Q-learning significantly outperforms the MDP that uses bandwidth models.Keywords
This publication has 31 references indexed in Scilit:
- Towards agile and smooth video adaptation in dynamic HTTP streaming2012
- Video streaming using a location-based bandwidth-lookup service for bitrate planningACM Transactions on Multimedia Computing, Communications, and Applications, 2012
- What happens when HTTP adaptive streaming players compete for bandwidth?2012
- Adaptive scalable video streaming in wireless networks2012
- Dynamic adaptive streaming over HTTP dataset2012
- Client intelligence for adaptive streaming solutionsSignal Processing: Image Communication, 2011
- Reinforcement learning for dynamic multimedia adaptationJournal of Network and Computer Applications, 2007
- Quality Control for Scalable Media Processing ApplicationsJournal of Scheduling, 2004
- Optimal streaming of layered video2003
- Optimal streaming of layered video2003