Graph-Embedded Multi-Agent Learning for Smart Reconfigurable THz MIMO-NOMA Networks
Preprint
Abstract
With the accelerated development of immersive applications and the explosive increment of internet-of-things (IoT) terminals, 6G would introduce terahertz (THz) massive multiple-input multiple-output non-orthogonal multiple access (MIMO-NOMA) technologies to meet the ultra-high-speed transmission and massive connectivity requirements. Nevertheless, the unreliability of THz transmissions and the extreme heterogeneity of device requirements pose critical challenges for practical applications. To address these challenges, we propose a novel smart reconfigurable THz MIMO-NOMA framework, which can realize customizable and intelligent communications by flexibly and coordinately reconfiguring hybrid beams through the cooperation between access points (APs) and reconfigurable intelligent surfaces (RISs). The optimization problem is formulated as a decentralized partially-observable Markov decision process (Dec-POMDP) to maximize the network energy efficiency, while guaranteeing the diversified users' performance, via a joint RIS element selection, coordinated discrete phase-shift control, and power allocation strategy. To solve the above non-convex, strongly coupled, and highly complex mixed integer nonlinear programming (MINLP) problem, we propose a novel multi-agent deep reinforcement learning (MADRL) algorithm, namely graph-embedded value-decomposition actor-critic (GE-VDAC), that embeds the interaction information of agents, and learns a locally optimal solution through a distributed policy. Numerical results demonstrate that the proposed algorithm achieves highly customized communications and outperforms traditional MADRL algorithms.Keywords
All Related Versions
This publication has 28 references indexed in Scilit:
- Reconfigurable Intelligent Surfaces: Principles and OpportunitiesIEEE Communications Surveys & Tutorials, 2021
- Graph Neural Networks for Scalable Radio Resource Management: Architecture Design and Theoretical AnalysisIEEE Journal on Selected Areas in Communications, 2020
- Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV Based Random Access IoT Networks With NOMAIEEE Journal on Selected Areas in Communications, 2020
- RIS Enhanced Massive Non-Orthogonal Multiple Access Networks: Deployment and Passive Beamforming DesignIEEE Journal on Selected Areas in Communications, 2020
- Smart Radio Environments Empowered by Reconfigurable Intelligent Surfaces: How It Works, State of Research, and The Road AheadIEEE Journal on Selected Areas in Communications, 2020
- Toward Smart Wireless Communications via Intelligent Reflecting Surfaces: A Contemporary SurveyIEEE Communications Surveys & Tutorials, 2020
- Energy Efficient User Clustering, Hybrid Precoding and Power Optimization in Terahertz MIMO-NOMA SystemsIEEE Journal on Selected Areas in Communications, 2020
- A Dynamic Array-of-Subarrays Architecture and Hybrid Precoding Algorithms for Terahertz Wireless CommunicationsIEEE Journal on Selected Areas in Communications, 2020
- Hybrid Precoding-Based Millimeter-Wave Massive MIMO-NOMA With Simultaneous Wireless Information and Power TransferIEEE Journal on Selected Areas in Communications, 2018
- Capacity Comparison Between MIMO-NOMA and MIMO-OMA With Multiple Users in a ClusterIEEE Journal on Selected Areas in Communications, 2017