Optimal Resource Allocation Considering Non-Uniform Spatial Traffic Distribution in Ultra-Dense Networks: A Multi-Agent Reinforcement Learning Approach
Open Access
- 16 February 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 20455-20464
Abstract
Recently, the demand for small cell base stations (SBSs) has been exploding to accommodate the explosive increase in mobile data traffic. In ultra-dense small cell networks (UDSCNs), because the spatial and temporal traffic distributions are significantly disproportionate, the efficient management of the energy consumption of SBSs is crucial. Therefore, we herein propose a multi-agent distributed Q-learning algorithm that maximizes energy efficiency (EE) while minimizing the number of outage users. Through intensive simulations, we demonstrate that the proposed algorithm outperforms conventional algorithms in terms of EE and the number of outage users. Even though the proposed reinforcement learning algorithm has significantly lower computational complexity than the centralized approach, it is shown that it can converge to the optimal solution.Keywords
Funding Information
- Institute of Information & Communications Technology Planning & Evaluation
- Korean Government (MSIT) through the 5G Open Intelligence-Defined RAN (ID-RAN) Technique Based on 5G New Radio (2018-0-01659)
This publication has 22 references indexed in Scilit:
- Cluster-Based Resource Allocation and User Association in mmWave Femtocell NetworksIEEE Transactions on Communications, 2018
- A Hierarchical SDN Architecture for Ultra-Dense Millimeter-Wave Cellular NetworksIEEE Communications Magazine, 2018
- What is 5G? Emerging 5G Mobile Services and Network RequirementsSustainability, 2017
- Energy Efficient User Association and Power Allocation in Millimeter-Wave-Based Ultra Dense Networks With Energy Harvesting Base StationsIEEE Journal on Selected Areas in Communications, 2017
- A Q-Learning Framework for User QoE Enhanced Self-Organizing Spectrally Efficient Network Using a Novel Inter-Operator Proximal Spectrum SharingIEEE Journal on Selected Areas in Communications, 2016
- On the Low-Complexity Resource Allocation for Self-Healing With Reduced Message Passing in Indoor Wireless Communication SystemsIEEE Transactions on Wireless Communications, 2015
- Towards 1 Gbps/UE in Cellular Systems: Understanding Ultra-Dense Small Cell DeploymentsIEEE Communications Surveys & Tutorials, 2015
- Energy-Efficient Base-Stations Sleep-Mode Techniques in Green Cellular Networks: A SurveyIEEE Communications Surveys & Tutorials, 2015
- Green Cellular Networks: A Survey, Some Research Issues and ChallengesIEEE Communications Surveys & Tutorials, 2011
- Green radio: radio techniques to enable energy-efficient wireless networksIEEE Communications Magazine, 2011