VATP360: Viewport Adaptive 360-Degree Video Streaming based on Tile Priority
Author:
Preprint
Abstract
360-degree video becomes increasingly popular among users. In the current network bandwidth, serving high resolution 360 degree video to users is quite difficult. Most of the work has been devoted to the prediction of user viewports or tile-based adaptive algorithms. However, it is difficult to predict user viewports more accurately using only information such as user's historical viewports or video saliency maps. In this paper, we propose a viewport adaptive 360-degree video streaming method based on tile priority (VATP360), which tries to balance between the performance and the overhead. The proposed VATP360 consists of three main modules: viewport prediction, tile priority classification and bitrate allocation. In the viewport prediction module, object motion trajectory and predicted user's region-of-interest (ROI) are used to achieve accurate prediction of the user's future viewport. Then, the predicted viewport, along with the object motion trajectory, are fed into the proposed tile priority classification algorithm to assign different priorities to tiles, which would reduce the computational complexity of the bitrate allocation module. Finally in the bitrate allocation stage, we adaptively assign bitrates to tiles of different priority by reinforcement learning. Experimental results on publicly available datasets have demonstrated the effectiveness of the proposed method.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Hybrid‐360: An adaptive bitrate algorithm for tile‐based 360 video streamingTransactions on Emerging Telecommunications Technologies, 2021
- A survey on 360-degree video: Coding, quality of experience and streamingComputer Communications, 2021
- A Combined Field-of-View Prediction-Assisted Viewport Adaptive Delivery Scheme for 360° VideosIEEE Transactions on Broadcasting, 2021
- Reinforcement Learning Based Rate Adaptation for 360-Degree Video StreamingIEEE Transactions on Broadcasting, 2020
- A Survey on Adaptive 360° Video Streaming: Solutions, Challenges and OpportunitiesIEEE Communications Surveys & Tutorials, 2020
- Deep Learning for Content-Based Personalized Viewport Prediction of 360-Degree VR VideosIEEE Networking Letters, 2020