Meta-Reinforcement Learning for Immersive Virtual Reality over THz/VLC Wireless Networks
Authors:
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
In this paper, the problem of enhancing the quality of virtual reality (VR) services is studied for an indoor terahertz (THz)/visible light communication (VLC) wireless network. In the studied model, small base stations (SBSs) transmit high-quality VR images to users over THz bands and light-emitting diodes (LEDs) provide accurate indoor positioning services for VR users using VLC. Here, VR users move in real time and their movement patterns change over time according to their application. Both THz and VLC links can be blocked by the bodies of VR users. To control the energy consumption of the studied THz/VLC wireless VR network, VLC access points (VAPs) must be selectively turned on so as to ensure accurate and extensive positioning for VR users. Based on the user positions, each SBS must generate corresponding VR images and build THz links without body blockage to transmit the VR content. The problem is formulated as an optimization problem whose goal is to maximize the sum successful transmission probability of all VR users by selecting the appropriate VAPs to be turned on and controlling the user association with SBSs. To solve this problem, a policy gradient-based reinforcement learning (RL) algorithm using meta-learning framework is proposed. The proposed algorithm can effectively solve the formulated problem and enable the trained policy to quickly adapt to new user movement patterns. Simulation results demonstrate that, compared to a baseline trust region policy optimization algorithm (TRPO), the proposed meta-learning solution yields a 78% improvement in the convergence speed and about 16.4% improvement in the sum successful transmission probabilities of all VR users.Keywords
Funding Information
- National Natural Science Foundation of China
- National Science Foundation
This publication has 12 references indexed in Scilit:
- Deep Learning for Optimal Deployment of UAVs With Visible Light CommunicationsIEEE Transactions on Wireless Communications, 2020
- Energy Efficient User Clustering, Hybrid Precoding and Power Optimization in Terahertz MIMO-NOMA SystemsIEEE Journal on Selected Areas in Communications, 2020
- Cellular-Connected Wireless Virtual Reality: Requirements, Challenges, and SolutionsIEEE Communications Magazine, 2020
- Taming the Latency in Multi-User VR 360°: A QoE-Aware Deep Learning-Aided Multicast FrameworkIEEE Transactions on Communications, 2020
- Artificial Neural Networks-Based Machine Learning for Wireless Networks: A TutorialIEEE Communications Surveys & Tutorials, 2019
- Communications, Caching, and Computing for Mobile Virtual Reality: Modeling and TradeoffIEEE Transactions on Communications, 2019
- Joint Radio Communication, Caching, and Computing Design for Mobile Virtual Reality Delivery in Fog Radio Access NetworksIEEE Journal on Selected Areas in Communications, 2019
- A Survey of Positioning Systems Using Visible LED LightsIEEE Communications Surveys & Tutorials, 2018
- Interference and SINR in Dense Terahertz Networks2015
- Indoor Positioning System Using Visible Light and AccelerometerJournal of Lightwave Technology, 2014