DRL-Based RIS Phase Shift Design for OFDM Communication Systems
- 6 February 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Wireless Communications Letters
- Vol. 12 (4) , 733-737
Abstract
This letter investigates a downlink orthogonal frequency division multiplexing (OFDM) transmission system aided by a reconfigurable intelligent surface (RIS). To reduce the system overhead and cost, we consider a 1-bit resolution and column-wise controllable RIS, and aim to design the reflection phase shifts of the elements on the RIS to improve the spectral efficiency. By leveraging a deep Q-network (DQN) framework, a deep reinforcement learning (DRL) based optimization algorithm is proposed in order to design the reflection phase shifts. Simulations illustrate that the proposed DRL-based algorithm can achieve significant performance gains in the spectral efficiency, while greatly reducing the calculation delay.Keywords
Funding Information
- National Natural Science Foundation of China (62231009, 61971126)
- Natural Science Foundation of Jiangsu Province (BK20211511)
- Jiangsu Province Frontier Leading Technology Basic Research Project (BK20212002)
- Research Grant from the Department for the Economy Northern Ireland through the U.S.–Ireland Research and Development Partnership Programme
- National Natural Science Foundation of China (62261160576, 61921004)
This publication has 17 references indexed in Scilit:
- Tensor-Based Algebraic Channel Estimation for Hybrid IRS-Assisted MIMO-OFDMIEEE Transactions on Wireless Communications, 2021
- MIMO Transmission Through Reconfigurable Intelligent Surface: System Design, Analysis, and ImplementationIEEE Journal on Selected Areas in Communications, 2020
- Prospective Multiple Antenna Technologies for Beyond 5GIEEE Journal on Selected Areas in Communications, 2020
- PrecoderNet: Hybrid Beamforming for Millimeter Wave Systems With Deep Reinforcement LearningIEEE Wireless Communications Letters, 2020
- Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement LearningIEEE Journal on Selected Areas in Communications, 2020
- Intelligent Reflecting Surface with Discrete Phase Shifts: Channel Estimation and Passive Beamforming2020
- Deep Reinforcement Learning for Intelligent Reflecting Surfaces: Towards Standalone Operation2020
- Intelligent Reflecting Surface Meets OFDM: Protocol Design and Rate MaximizationIEEE Transactions on Communications, 2020
- Deep Reinforcement Learning Based Intelligent Reflecting Surface Optimization for MISO Communication SystemsIEEE Wireless Communications Letters, 2020
- IRS-Enhanced OFDMA: Joint Resource Allocation and Passive Beamforming OptimizationIEEE Wireless Communications Letters, 2020