Beamforming Optimization for IRS-Assisted mmWave V2I Communication Systems via Reinforcement Learning
Open Access
- 8 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 60521-60533
Abstract
Intelligent reflecting surface (IRS), which can provide a propagation path where non-line-of-sight (NLOS) link exists, is a promising technology to enable beyond fifth-generation (B5G) mobile communication systems. In this paper, we jointly optimize the base station (BS) and IRS beamforming to enhance network performance in the mmWave vehicle-to-infrastructure (V2I) communication system. However, the joint optimization of the beamforming matrix for BS and IRS is challenging due to non-convex and time-varying issues. To tackle those issues, we propose a novel reinforcement learning algorithm based on deep deterministic policy gradient (DDPG) method. Simulation results corroborate that the proposed algorithm converges in both systems with and without IRS, and the case with IRS improves the network performance from as little as about 5% to as much as about 100% depending on the environments such as the number of vehicles or deployment. Simulation results also show that in the IRS-assisted communication, up to 10% higher network throughput can be achieved in Dense V2I network scenario compared to Sparse case.Keywords
Funding Information
- ICT R&D program of MSIT/IITP (2021-0-01810)
This publication has 50 references indexed in Scilit:
- Energy-Efficient Object Detection Using Semantic DecompositionIEEE Transactions on Very Large Scale Integration (VLSI) Systems, 2017
- Millimeter wave communication in vehicular networks: Challenges and opportunities2017
- 5G: A Tutorial Overview of Standards, Trials, Challenges, Deployment, and PracticeIEEE Journal on Selected Areas in Communications, 2017
- Energy-Efficient UAV Communication With Trajectory OptimizationIEEE Transactions on Wireless Communications, 2017
- Human-level control through deep reinforcement learningNature, 2015
- Key elements to enable millimeter wave communications for 5G wireless systemsIEEE Wireless Communications, 2014
- Coverage and capacity of millimeter-wave cellular networksIEEE Communications Magazine, 2014
- What Will 5G Be?IEEE Journal on Selected Areas in Communications, 2014
- Millimeter Wave Mobile Communications for 5G Cellular: It Will Work!IEEE Access, 2013
- Fundamentals of Wireless Communication2005