Abstract
Ultra-dense network (UDN) is considered as one of the key technologies for the explosive growth of mobile traffic demand on the Internet of Things (IoT). It enhances network capacity by deploying small base stations in large quantities, but it simultaneously causes great energy consumption. In this paper, we use energy harvesting (EH) and energy cooperation technologies to maximize system throughput and save energy. Considering that the energy arrival process and channel information are not available a-priori, we propose an optimal deep reinforcement learning (DRL) algorithm to solve this average throughput maximization problem over finite horizon. We also propose a multi-agent deep reinforcement learning method to solve the dimensionality problem caused by the expansion of the state and action dimension. Finally, we compare these algorithms with two traditional algorithms, greedy algorithm and conservative algorithm. The numerical results show that the proposed algorithms are valid and effective in increasing system average throughput on long term.
Funding Information
  • National Natural Science Foundation of China (61501202)
  • Fundamental Research Funds for the Central Universities

This publication has 31 references indexed in Scilit: