Collaborative Multi-BS Power Management for Dense Radio Access Network Using Deep Reinforcement Learning
- 18 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Green Communications and Networking
- Vol. 7 (4) , 2104-2116
Abstract
Network energy efficiency is a main pillar in the design and operation of wireless communication systems. In this paper, we investigate a dense radio access network (dense-RAN) capable of radiated power management at the base station (BS). Aiming to improve the long-term network energy efficiency, an optimization problem is formulated by collaboratively managing multi-BSs’ radiated power levels with constraints on the users’ traffic volume and achievable rate. Considering stochastic traffic arrivals at the users and time-varying network interference, we first formulate the problem as a Markov decision process (MDP) and then develop a novel deep reinforcement learning (DRL) framework based on the cloud-RAN operation scheme. To tackle the trade-off between complexity and performance, the overall optimization of multi-BSs’ energy efficiency with the multiplicative complexity constraint is modeled to achieve near-optimal performance by using a deep Q-network (DQN). In DQN, each BS first maximizes its individual energy efficiency, and then cooperates with other BSs to maximize the overall multi-BSs’ energy efficiency. Simulation results demonstrate that the proposed algorithm can converge faster and enjoy a network energy efficiency improvement by 5% and 10% compared with the benchmarks of the Q-learning and sleep schemes, respectively.Keywords
All Related Versions
Funding Information
- National Key Project (2020YFB1807700)
- NSFC (62071296)
- Shanghai (22JC1404000, 20JC1416502, PKX2021-D02)
- Erik Jonsson Distinguished Professorship at UT-Dallas
This publication has 47 references indexed in Scilit:
- Traffic-Aware Cloud RAN: A Key for Green 5G NetworksIEEE Journal on Selected Areas in Communications, 2016
- Mobile Coordinated Wireless Sensor Network: An Energy Efficient Scheme for Real-Time TransmissionsIEEE Journal on Selected Areas in Communications, 2016
- Energy Efficiency of Downlink Transmission Strategies for Cloud Radio Access NetworksIEEE Journal on Selected Areas in Communications, 2016
- Multiobjective Auction-Based Switching-Off Scheme in Heterogeneous Networks: To Bid or Not to Bid?IEEE Transactions on Vehicular Technology, 2016
- Energy Efficiency Tradeoff Mechanism Towards Wireless Green Communication: A SurveyIEEE Communications Surveys & Tutorials, 2015
- A Survey on Green Mobile Networking: From The Perspectives of Network Operators and Mobile UsersIEEE Communications Surveys & Tutorials, 2014
- TACT: A Transfer Actor-Critic Learning Framework for Energy Saving in Cellular Radio Access NetworksIEEE Transactions on Wireless Communications, 2014
- Connected‐Mode Mobility in LTE Heterogeneous Networks2013
- Consumption factor: A figure of merit for power consumption and energy efficiency in broadband wireless communications2011
- Green Cellular Networks: A Survey, Some Research Issues and ChallengesIEEE Communications Surveys & Tutorials, 2011