Double-Layer Power Control for Mobile Cell-Free XL-MIMO With Multi-Agent Reinforcement Learning
- 10 October 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 23 (5) , 4658-4674
Abstract
Cell-free (CF) extremely large-scale multiple-input multiple-output (XL-MIMO) is regarded as a promising technology for enabling future wireless communication systems. Significant attention has been generated by its considerable advantages in augmenting degrees of freedom. In this paper, we first investigate a CF XL-MIMO system with base stations equipped with XL-MIMO panels under a dynamic environment. Then, we propose an innovative multi-agent reinforcement learning (MARL)-based power control algorithm that incorporates predictive management and distributed optimization architecture, which provides a dynamic strategy for addressing high-dimension signal processing problems. Specifically, we compare various MARL-based algorithms, which shows that the proposed MARL-based algorithm effectively strikes a balance between spectral efficiency (SE) performance and convergence time. Moreover, we consider a double-layer power control architecture based on the large-scale fading coefficients between antennas to suppress interference within dynamic systems. Compared to the single-layer architecture, the results obtained unveil that the proposed double-layer architecture has a nearly 24% SE performance improvement, especially with massive antennas and smaller antenna spacing.Keywords
All Related Versions
Funding Information
- Fundamental Research Funds for the Central Universities (2022JBQY004, 2023YJS001)
- National Key Research and Development Program of China (2020YFB1807201)
- National Natural Science Foundation of China (62221001)
- Natural Science Foundation of Jiangsu Province, Major Project (BK20212002)
- ZTE Industry-University-Institute Cooperation Funds (HC-CN-20221202003)
This publication has 34 references indexed in Scilit:
- Uplink Power Control for Extremely Large-Scale MIMO with Multi-Agent Reinforcement Learning and Fuzzy Logic2023
- 6G Wireless Communications: From Far-Field Beam Steering to Near-Field Beam FocusingIEEE Communications Magazine, 2023
- Near-Field Channel Estimation for Extremely Large-Scale Array Communications: A Model-Based Deep Learning ApproachIEEE Communications Letters, 2023
- Multi-Agent Reinforcement Learning-Based Pilot Assignment for Cell-Free Massive MIMO SystemsIEEE Access, 2022
- Multi-User Holographic MIMO Surfaces: Channel Modeling and Spectral Efficiency AnalysisIEEE Journal of Selected Topics in Signal Processing, 2022
- Wireless Energy Transfer in RIS-Aided Cell-Free Massive MIMO Systems: Opportunities and ChallengesIEEE Communications Magazine, 2022
- Channel Estimation for Extremely Large-Scale Massive MIMO: Far-Field, Near-Field, or Hybrid-Field?IEEE Communications Letters, 2021
- Multi-agent deep reinforcement learning: a surveyArtificial Intelligence Review, 2021
- Prospective Multiple Antenna Technologies for Beyond 5GIEEE Journal on Selected Areas in Communications, 2020
- Deep Learning Power Allocation in Massive MIMO2018