Deep Reinforcement Learning for RIS-Empowered High-Speed Railway Cell-Free Networks
- 21 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Wireless Communications Letters
- Vol. 12 (12) , 2078-2082
Abstract
Cell-free multiple-input multiple-output (MIMO) and reconfigurable intelligent surface (RIS) have been envisioned as two promising techniques to enhance the data transmission rate of high-speed railway (HSR) networks. This paper considers the HSR cell-free MIMO system empowered by RIS with finite discrete phase shifters to pursue performance improvement. Particularly, the RIS phase shift optimization problem is formulated, aiming at maximizing the achievable rate. To deal with the complicated control problem, a deep reinforcement learning (DRL)-based scheme is proposed, where double deep Q-network (DDQN) method is invoked for designing phase shifts. Simulation results demonstrate that compared with the existing optimization-based baseline scheme, the proposed scheme can obtain the comparable achievable rate with much shorter time consumption.Keywords
Funding Information
- High-level Talents Research Start-up Project of Hebei University (521100222061)
- National key research and development program (2021YFB2900301)
- National key research and development program (2020YFB1806604)
- National key research and development program (2021YFB3901302)
- National Natural Science Foundation of China (62221001)
- Royal Society Newton Advanced Fellowship (NA191006)
- Royal Society Newton Advanced Fellowship (61961130391)
- Natural Science Foundation of Jiangsu Province Major Project (BK20212002)
- Open Research Fund from the Shenzhen Research Institute of Big Data (2019ORF01006)
This publication has 19 references indexed in Scilit:
- When mmWave High-Speed Railway Networks Meet Reconfigurable Intelligent Surface: A Deep Reinforcement Learning MethodIEEE Wireless Communications Letters, 2021
- A Joint Precoding Framework for Wideband Reconfigurable Intelligent Surface-Aided Cell-Free NetworkIEEE Transactions on Signal Processing, 2021
- Deep Reinforcement Learning-Based Dynamic Spectrum Access for D2D Communication Underlay Cellular NetworksIEEE Communications Letters, 2021
- Multi-Hop RIS-Empowered Terahertz Communications: A DRL-Based Hybrid Beamforming DesignIEEE Journal on Selected Areas in Communications, 2021
- Beyond Cell-Free MIMO: Energy Efficient Reconfigurable Intelligent Surface Aided Cell-Free MIMO CommunicationsIEEE Transactions on Cognitive Communications and Networking, 2021
- Achievable Rate Maximization for Aerial Intelligent Reflecting Surface-aided Cell-free Massive MIMO System2020
- Deep Reinforcement Learning-Based Intelligent Reflecting Surface for Secure Wireless CommunicationsIEEE Transactions on Wireless Communications, 2020
- Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement LearningIEEE Journal on Selected Areas in Communications, 2020
- 5G Key Technologies for Smart RailwaysProceedings of the IEEE, 2020
- Cell-Free Massive MIMO Versus Small CellsIEEE Transactions on Wireless Communications, 2017