Active RIS-Aided EH-NOMA Networks: A Deep Reinforcement Learning Approach
- 18 July 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Communications
- Vol. 71 (10) , 5846-5861
Abstract
An active reconfigurable intelligent surface (RIS)-aided multi-user downlink communication system is investigated, where non-orthogonal multiple access (NOMA) is employed to improve spectral efficiency, and the active RIS is powered by energy harvesting (EH). The problem of joint control of the RIS’s amplification matrix and phase shift matrix is formulated to maximize the communication success ratio with considering the quality of service (QoS) requirements of users, dynamic communication state, and dynamic available energy of RIS. To tackle this non-convex problem, a cascaded deep learning algorithm namely long short-term memory-deep deterministic policy gradient (LSTM-DDPG) is designed. First, an advanced LSTM based algorithm is developed to predict users’ dynamic communication state. Then, based on the prediction results, a DDPG based algorithm is proposed to joint control the amplification matrix and phase shift matrix of the RIS. Finally, simulation results verify the accuracy of the prediction of the proposed LSTM algorithm, and demonstrate that the LSTM-DDPG algorithm has a significant advantage over other benchmark algorithms in terms of communication success ratio performance.Keywords
All Related Versions
Funding Information
- Key Project on Anhui Provincial Natural Science Study by Colleges and Universities (KJ2020A0514)
- Anhui Provincial Research Programming Project (2022AH051039)
- National Natural Science Foundation of China (62271099)
- Key Research Project of Chongqing Education Commission (KJZD-K201800603)
- Fundamental Research Funds for the Central Universities (20720220080)
- China National Key R&D Program (2021YFA1000500)
- National Natural Science Foundation of China (62101492)
- Natural Science Foundation of Zhejiang Province (LR22F010002)
- Zhejiang University Global Partnership Fund, Zhejiang University Education Foundation Qizhen Scholar Foundation, and Fundamental Research Funds for the Central Universities (2021FZZX001-21)
This publication has 40 references indexed in Scilit:
- Intelligent Reflecting Surface Enhanced Wireless Network via Joint Active and Passive BeamformingIEEE Transactions on Wireless Communications, 2019
- Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless CommunicationIEEE Transactions on Wireless Communications, 2019
- Applications of Deep Reinforcement Learning in Communications and Networking: A SurveyIEEE Communications Surveys & Tutorials, 2019
- Outage Performance Analysis for the Advanced SIC Receiver in Wireless NOMA SystemsIEEE Transactions on Vehicular Technology, 2018
- Simultaneous Wireless Information and Power Transfer (SWIPT): Recent Advances and Future ChallengesIEEE Communications Surveys & Tutorials, 2017
- A Survey on Non-Orthogonal Multiple Access for 5G Networks: Research Challenges and Future TrendsIEEE Journal on Selected Areas in Communications, 2017
- A hybrid framework combining solar energy harvesting and wireless charging for wireless sensor networks2016
- Practical Non-Linear Energy Harvesting Model and Resource Allocation for SWIPT SystemsIEEE Communications Letters, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Long Short-Term MemoryNeural Computation, 1997