Active RIS-aided EH-NOMA Networks: A Deep Reinforcement Learning Approach
Preprint
Abstract
An active reconfigurable intelligent surface (RIS)-aided multi-user downlink communication system is investigated, where non-orthogonal multiple access (NOMA) is employed to improve spectral efficiency, and the active RIS is powered by energy harvesting (EH). The problem of joint control of the RIS's amplification matrix and phase shift matrix is formulated to maximize the communication success ratio with considering the quality of service (QoS) requirements of users, dynamic communication state, and dynamic available energy of RIS. To tackle this non-convex problem, a cascaded deep learning algorithm namely long short-term memory-deep deterministic policy gradient (LSTM-DDPG) is designed. First, an advanced LSTM based algorithm is developed to predict users' dynamic communication state. Then, based on the prediction results, a DDPG based algorithm is proposed to joint control the amplification matrix and phase shift matrix of the RIS. Finally, simulation results verify the accuracy of the prediction of the proposed LSTM algorithm, and demonstrate that the LSTM-DDPG algorithm has a significant advantage over other benchmark algorithms in terms of communication success ratio performance.Keywords
All Related Versions
This publication has 36 references indexed in Scilit:
- RIS-Aided Ground-Aerial NOMA Communications: A Distributionally Robust DRL ApproachIEEE Journal on Selected Areas in Communications, 2022
- RIS-Assisted Joint Transmission in a Two-Cell Downlink NOMA Cellular SystemIEEE Journal on Selected Areas in Communications, 2022
- AI Empowered RIS-Assisted NOMA Networks: Deep Learning or Reinforcement Learning?IEEE Journal on Selected Areas in Communications, 2021
- Non Orthogonal Multiple Access with Energy Harvesting Using Reconfigurable Intelligent Surfaces for Rayleigh ChannelsWireless Personal Communications, 2021
- RIS Enhanced Massive Non-Orthogonal Multiple Access Networks: Deployment and Passive Beamforming DesignIEEE Journal on Selected Areas in Communications, 2020
- Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement LearningIEEE Journal on Selected Areas in Communications, 2020
- Applications of Deep Reinforcement Learning in Communications and Networking: A SurveyIEEE Communications Surveys & Tutorials, 2019
- Simultaneous Wireless Information and Power Transfer (SWIPT): Recent Advances and Future ChallengesIEEE Communications Surveys & Tutorials, 2017
- A Survey on Non-Orthogonal Multiple Access for 5G Networks: Research Challenges and Future TrendsIEEE Journal on Selected Areas in Communications, 2017
- Practical Non-Linear Energy Harvesting Model and Resource Allocation for SWIPT SystemsIEEE Communications Letters, 2015