Adaptive 360-Degree Streaming: Optimizing With Multi-Window and Stochastic Viewport Prediction
Authors:
- 13 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 24 (7) , 5903-5915
Abstract
The tile-based approach is widely adopted in adaptive 360-degree video streaming systems, due to its efficiency in managing limited bandwidth resources. Recently, significant research efforts have been devoted to viewport-prediction-enabled bitrate adaptation for tile-based 360-degree Adaptive Bit-Rate (ABR) streaming, towards improving the average video quality while reducing rebuffering. However, the inherent uncertainty of users’ viewports has posed limitations on users’ Quality of Experience (QoE) for tile-based 360-degree ABR streaming. In this paper, we introduce a multi-window and stochastic viewport prediction approach to address the viewport uncertainty. In particular, considering our goal of maximizing the expectation of future QoE, we investigate a viewport distribution prediction model, to cope with the inherent randomness. Additionally, to accommodate the varying gap between the playback and the download process, we explore the multiple-window viewport prediction models to capture different prediction gaps. Even with the utilization of distributional prediction and multi-window models, predicting viewports far into the future is still inherently challenging. Accordingly, we propose a patience pattern temporarily suspending the download process, allowing for the accumulation of additional head movement trajectory data. Finally, we employ a model predictive control (MPC) approach for sequential decision-making, formulating the MPC problem as a mixed-integer non-linear programming (MINLP) task. To mitigate the computational burden associated with solving MINLP, we introduce a mixed-integer linear programming transformation to achieve efficient decision-making. Extensive experiments, utilizing real-world traces and user head movement trajectories, demonstrate that the proposed method outperforms state-of-the-art methods, improving overall QoE performance by 16.75% –18.91% .Keywords
Funding Information
- National Natural Science Foundation of China (62101336)
- Basic and Applied Basic Research Foundation of Guangdong Province (2022A1515011301)
This publication has 36 references indexed in Scilit:
- Adaptive 360-Degree Video Streaming with Multi-window and Stochastic Viewport Prediction2024
- SDSR: Optimizing Metaverse Video Streaming via Saliency-Driven Dynamic Super-ResolutionIEEE Journal on Selected Areas in Communications, 2023
- Collaborative Streaming and Super Resolution Adaptation for Mobile Immersive Videos2023
- Perceptual Quality Aware Adaptive 360-Degree Video Streaming with Deep Reinforcement Learning2022
- Learning-Based Prediction, Rendering and Transmission for Interactive Virtual Reality in RIS-Assisted Terahertz NetworksIEEE Journal on Selected Areas in Communications, 2021
- Probabilistic Tile Visibility-Based Server-Side Rate Adaptation for Adaptive 360-Degree Video StreamingIEEE Journal of Selected Topics in Signal Processing, 2019
- DRL360: 360-degree Video Streaming with Deep Reinforcement Learning2019
- Gaze Prediction in Dynamic 360° Immersive Videos2018
- Dynamic threshold based rate adaptation for HTTP live streaming2017
- Model Predictive Controllers2007