Energy-Efficient Rate-Splitting Multiple Access: A Deep Reinforcement Learning-Based Framework
Open Access
- 6 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Open Journal of the Communications Society
- Vol. 4, 2397-2409
Abstract
Rate-Splitting Multiple Access (RSMA) has been recognized as an effective technique to reconcile the tradeoff between decoding interference and treating interference as noise in 6G and beyond networks. In this paper, in line with the need for network sustainability, we study the energy-efficient power and rate allocation of the common and private messages transmitted in the downlink of a single-cell single-antenna RSMA network. Contrary to the literature that resorts to heuristic approaches to deal with the joint problem, we transform the formulated energy efficiency maximization problem into a multi-agent Deep Reinforcement Learning (DRL) problem, based on which each transmitted private message represents a different DRL agent. Each agent explores its own state-action space, the size of which is fixed and independent of the number of agents, and shares its gained experience by exploration with a common neural network. Two DRL algorithms, namely the value-based Deep Q-Learning (DQL) and the policy-based REINFORCE, are properly configured and utilized to solve it. The adaptation of the proposed DRL framework is also demonstrated for the treatment of the considered network’s sum-rate maximization objective. Numerical results obtained via modeling and simulation verify the effectiveness of the proposed DRL framework to conclude a solution to the joint problem under both optimization objectives, outperforming existing heuristic approaches and algorithms from the literature.Keywords
Funding Information
- European Commission through the Horizon Europe/JU SNS project Hexa-X-II (101095759)
This publication has 27 references indexed in Scilit:
- Power Allocation in Multi-User Cellular Networks: Deep Reinforcement Learning ApproachesIEEE Transactions on Wireless Communications, 2020
- Energy Efficient Rate Splitting Multiple Access (RSMA) with Reconfigurable Intelligent Surface2020
- Energy Efficiency in C-RAN using Rate Splitting and Common Message Decoding2020
- Rate-Splitting Unifying SDMA, OMA, NOMA, and Multicasting in MISO Broadcast Channel: A Simple Two-User Rate AnalysisIEEE Wireless Communications Letters, 2019
- Multi-Agent Deep Reinforcement Learning for Dynamic Power Allocation in Wireless NetworksIEEE Journal on Selected Areas in Communications, 2019
- Applications of Deep Reinforcement Learning in Communications and Networking: A SurveyIEEE Communications Surveys & Tutorials, 2019
- Learning Radio Resource Management in RANs: Framework, Opportunities, and ChallengesIEEE Communications Magazine, 2018
- Robust Transmission in Downlink Multiuser MISO Systems: A Rate-Splitting ApproachIEEE Transactions on Signal Processing, 2016
- Human-level control through deep reinforcement learningNature, 2015
- Weighted sum-rate maximization using weighted MMSE for MIMO-BC beamforming designIEEE Transactions on Wireless Communications, 2008