Meta Reinforcement Learning for Resource Allocation in Multi-Antenna UAV Network with Rate Splitting Multiple Access
Authors:
Preprint
Abstract
Unmanned aerial vehicles (UAVs) with multiple antennas have recently been explored to improve capacity in wireless networks. However, the strict energy constraint of UAVs, given their simultaneous flying and communication tasks, renders the exploration of energy-efficient multi-antenna techniques indispensable for UAVs. Meanwhile, lens antenna subarray (LAS) emerges as a promising energy-efficient solution that has not been previously harnessed for this purpose. In this paper, we propose a LAS-aided multi-antenna UAV to serve ground users in the downlink transmission of the terahertz (THz) band, utilizing rate splitting multiple access (RSMA) for effective beam division multiplexing. We formulate an optimization problem of maximizing the total system spectral efficiency (SE). This involves optimizing the UAV's transmit beamforming and the common rate of RSMA. By recasting the optimization problem into a Markov decision process (MDP), we propose a deep deterministic policy gradient (DDPG)-based resource allocation mechanism tailored to capture problem dynamics and optimize its variables. Moreover, given the UAV's frequent mobility and consequential system reconfigurations, we fortify the trained DDPG model with a meta-learning strategy, enhancing its adaptability to system variations. Numerically, more than 20\% energy efficiency gain is achieved by our proposed LAS-aided multi-antenna UAV equipped with 4 lenses, compared to a single-lens UAV. Simulations also demonstrate that at a signal-to-noise (SNR) of 10 dB, the incorporation of RSMA results in a 22\% SE enhancement over conventional orthogonal beam division multiple access. Furthermore, the overall system SE improves by 27\%, when meta-learning is employed for fine-tuning the conventional DDPG method in literature.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Beamforming for STAR-RIS-Aided Integrated Sensing and Communication Using Meta DRLIEEE Wireless Communications Letters, 2024
- Multicarrier Rate-Splitting Multiple Access: Superiority of OFDM-RSMA Over OFDMA and OFDM-NOMAIEEE Communications Letters, 2023
- Energy Consumption Minimization in Secure Multi-Antenna UAV-Assisted MEC Networks With Channel UncertaintyIEEE Transactions on Wireless Communications, 2023
- Intelligent Analog Beam Selection and Beamspace Channel Tracking in THz Massive MIMO With Lens Antenna ArrayIEEE Transactions on Cognitive Communications and Networking, 2023
- Energy and Spectral-Efficient Lens Antenna Subarray Design in MmWave MIMO SystemsIEEE Access, 2022
- Placement and Resource Allocation of Wireless-Powered Multiantenna UAV for Energy-Efficient Multiuser NOMAIEEE Transactions on Wireless Communications, 2022
- Joint Altitude and Hybrid Beamspace Precoding Optimization for UAV-Enabled Multiuser mmWave MIMO SystemIEEE Transactions on Vehicular Technology, 2021
- Intelligent Trajectory Design for Secure Full- Duplex MIMO-UAV Relaying Against Active Eavesdroppers: A Model-Free Reinforcement Learning ApproachIEEE Access, 2020
- Lens Antenna Subarrays in mmWave Hybrid MIMO SystemsIEEE Access, 2020
- 3-D Beamforming for Flexible Coverage in Millimeter-Wave UAV CommunicationsIEEE Wireless Communications Letters, 2019