Deep Deterministic Policy Gradient-Based Rate Maximization for RIS-UAV-Assisted Vehicular Communication Networks
- 14 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Transportation Systems
- Vol. 25 (11) , 15732-15744
Abstract
Reconfigurable intelligent surface (RIS) is a promising paradigm for implementing intelligent reconfigurable wireless propagation environments in the 6G era. However, most of the existing studies focus on utilizing RIS deployed on buildings to provide services to users or constructing a RIS-assisted system framework for static users, which greatly limited application in real-time changing vehicular communication environments. As a result, combining unmanned aerial vehicles (UAVs) with RIS (RIS-UAV) plays a crucial role in various wireless networks due to their high mobility. To maximize the communication rate between base station (BS) and mobile vehicle, we propose a position prediction strategy for vehicles that facilitates real-time adjustment of UAV trajectories and RIS phase shifts, enhancing communication in dynamic environments. Deep reinforcement learning (DRL) algorithm is utilized to solve the above question, which achieves a good effect on convergence in continuous action space. Simulation results demonstrate that compared with benchmark schemes, the algorithm we suggested has significant performance gains, that is to maximize the communication rate under system constraints and guarantee the reliability of the communication.Keywords
Funding Information
- Postgraduate Research and Practice Innovation Program of Jiangsu Province (SJCX22_0277)
- National Key Research and Development Program of China (2021ZD0140405)
- Natural Science Foundation on Frontier Leading Technology Basic Research Project of Jiangsu (BK20212001)
- Natural Science Foundation of Jiangsu Province (BK2021022532)
- Future Network Scientific Research Fund Project (FNSRFP-2021-ZD-8)
- Six Talent Peaks Project in Jiangsu Province
This publication has 49 references indexed in Scilit:
- A UAV mounted RIS aided communication and localization integration system for ground vehicles2022
- Three-Dimensional-Map-Based Trajectory Design in UAV-Aided Wireless Localization SystemsIEEE Internet of Things Journal, 2021
- Intelligent Reflecting Surface Aided Vehicular Communications2020
- Multi-Agent Reinforcement Learning Based Resource Management in MEC- and UAV-Assisted Vehicular NetworksIEEE Journal on Selected Areas in Communications, 2020
- Sum Rate Maximization via Reconfigurable Intelligent Surface in UAV Communication: Phase Shift and Trajectory Optimization2020
- Smart Radio Environments Empowered by Reconfigurable Intelligent Surfaces: How It Works, State of Research, and The Road AheadIEEE Journal on Selected Areas in Communications, 2020
- Resource Allocation and 3-D Placement for UAV-Enabled Energy-Efficient IoT CommunicationsIEEE Internet of Things Journal, 2020
- Joint Beamforming and Trajectory Optimization for Intelligent Reflecting Surfaces-Assisted UAV CommunicationsIEEE Access, 2020
- UAV Communications for 5G and Beyond: Recent Advances and Future TrendsIEEE Internet of Things Journal, 2018
- Energy-Aware Dynamic Resource Allocation in UAV Assisted Mobile Edge Computing Over Social Internet of VehiclesIEEE Access, 2018