MUL-VR: Multi-UAV Collaborative Layered Visual Perception and Transmission for Virtual Reality
- 8 January 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 24 (4) , 2734-2749
Abstract
Nowadays, unmanned aerial vehicles (UAVs) are deployed to perceive high-definition visuals of ground targets (GTs) for environment reconstruction of virtual reality (VR) by leveraging their high flexibility. Inspired by the classic scalable video coding method, we develop a novel multi-UAV collaborative layered visual perception and transmission scheme for VR named MUL-VR, wherein GTs are divided into multiple overlapped clusters and multiple UAVs are deployed to collaboratively perceive visuals from these clusters. Specifically, our proposed formulation entails maximizing user’s quality of experience (QoE) by optimizing cluster radii, UAV horizontal coordinates, and bandwidth allocation strategy subject to the constraints on visual quality, transmission delay and available bandwidth. To address this issue, we formulate the investigated MUL-VR scheme into an intractable optimization problem, which, however, is difficult to solve due to the non-convexity of the objective function and constraints, as well as the intricate coupling of the variables. To tackle this challenging problem, we first propose an efficient alternating algorithm, which decomposes the original optimization problem into three subproblems, and then derive the optimal closed-form solution to each subproblem. Consequently, the final solution can be obtained by iteratively optimizing the variables associated with each subproblem, while holding the variables in the other two subproblems fixed, until the convergence condition is satisfied. Simulation results demonstrate that the proposed scheme can effectively improve the user’s QoE and enhance the robustness of the system, yielding superior performance compared to other benchmarks. Specifically, compared to the classic K-Means based scheme, the proposed scheme offers a 25.9% enhancement in terms of QoE when the preference coefficient ε = 0.1 and such performance gain progressively expands as ε increases.Keywords
Funding Information
- Shanghai Pujiang Program (22PJD073)
- National Natural Science Foundation of China (62101386, 62201391)
- Fundamental Research Funds for the Central Universities (22120230311)
- International Strategic Innovative Project of National Key Research and Development Program of China (2023YFE0112500)
This publication has 42 references indexed in Scilit:
- Human-Centric Resource Allocation in the Metaverse Over Wireless CommunicationsIEEE Journal on Selected Areas in Communications, 2023
- Drone Grand Prix: Educational Robotics Competitions Using Drones with First-Person View (FPV)2023
- QoE Fairness Resource Allocation in Digital Twin-Enabled Wireless Virtual Reality SystemsIEEE Journal on Selected Areas in Communications, 2023
- OpenDIBR: Open Real-Time Depth-Image-Based renderer of light field videos for VRMultimedia Tools and Applications, 2023
- A Contract-Theory-Based Incentive Mechanism for UAV-Enabled VR-Based Services in 5G and BeyondIEEE Internet of Things Journal, 2023
- Virtual-Reality Interpromotion Technology for Metaverse: A SurveyIEEE Internet of Things Journal, 2023
- VR-Based Immersive Service Management in B5G Mobile Systems: A UAV Command and Control Use CaseIEEE Internet of Things Journal, 2022
- Optimizing Number, Placement, and Backhaul Connectivity of Multi-UAV NetworksIEEE Internet of Things Journal, 2022
- A Comprehensive Overview on 5G-and-Beyond Networks With UAVs: From Communications to Sensing and IntelligenceIEEE Journal on Selected Areas in Communications, 2021
- Networked Drone Cameras for Sports Streaming2017