Enhanced VR Experience With Edge Computing: The Impact of Decoding Latency
- 13 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 24 (7) , 6275-6292
Abstract
Virtual reality (VR) applications have revolutionized digital interaction by providing immersive experiences. 360$^{\circ }$ VR video streaming has experienced significant growth and popularity as a pivotal VR application. However, the combination of limited network bandwidth and the demand for high-quality videos frequently hinders the achievement of a satisfactory quality of experience (QoE). Although prior methods have enhanced QoE, the effects of decoding latency have been poorly studied. It is technically challenging to design a quality adaptation algorithm that can balance the pursuit of high-quality videos and the limitation of limited bandwidth resources. To address this challenge, we propose an edge-end architecture for 360$^{\circ }$ VR video streaming and aim to enhance overall QoE by solving a performance optimization problem. Specifically, our experiments on commercial mobile devices in real-world situations reveal that decoding latency significantly influences QoE. First, decoding latency plays a major role in contributing to end-to-end latency, which exceeds the transmission latency. Second, decoding latency can differ considerably between devices with varying computational capabilities. Building on this insight, we propose a novel latency-aware quality adaptation (LAQA) algorithm. LAQA lies in developing a solution that can allocate video quality in real-time and enhance overall QoE. LAQA involves not only the quality of the received content, the transmission latency and the quality variance, but also the decoding latency and the fairness of the user quality. Subsequently, we formulate a combinatorial optimization problem to maximize overall QoE. Through extensive validation with experimental data from real-world situations, LAQA offers a promising approach to enhance QoE and ensure fairness performance in different devices. In particular, LAQA achieves 16.77% and 10.66% enhancement over the state-of-the-art combinatorial optimization and reinforcement learning algorithm, respectively, in terms of QoE at 4K resolution. Furthermore, LAQA ensures excellent scalability by simulating the number of users ranging from 15 to 60, making it a robust solution for diverse and growing user scales.
Keywords
Funding Information
- National Natural Science Foundation of China (62072410)
- National Natural Science Foundation of China (62272414)
- Fundamental Research Funds for the Provincial Universities of Zhejiang (RF-B2022002)
- Science and Technology Development Fund of Macau SAR (0158/2022/A)
This publication has 57 references indexed in Scilit:
- VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams2024
- Adaptive 360-Degree Video Streaming with Multi-window and Stochastic Viewport Prediction2024
- Enhancing User Experience in High-Resolution Collaborative Virtual Reality on Commodity Mobile Devices2023
- Multi-cell MEC Space Partition and Dynamic Adjustment Scheme for VR Video Transmission2022
- Enhancing Quality of Experience for Collaborative Virtual Reality with Commodity Mobile Devices2022
- Energy-Efficient and QoE-Aware 360-Degree Video Streaming on Mobile Devices2022
- Allies: Tile-Based Joint Transcoding, Delivery and Caching of 360° Videos in Edge Cloud Networks2020
- On generalized log-Moyal distribution: A new heavy tailed size distributionInsurance: Mathematics and Economics, 2018
- Evaluation of temporal variation of video quality in packet loss networksSignal Processing: Image Communication, 2011
- XXX. Theory of ionization fluctuationsJournal of Computers in Education, 1955