Throughput Maximization by Deep Reinforcement Learning With Energy Cooperation for Renewable Ultradense IoT Networks
- 16 June 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 7 (9) , 9091-9102
Abstract
Ultra-dense network (UDN) is considered as one of the key technologies for the explosive growth of mobile traffic demand on the Internet of Things (IoT). It enhances network capacity by deploying small base stations in large quantities, but it simultaneously causes great energy consumption. In this paper, we use energy harvesting (EH) and energy cooperation technologies to maximize system throughput and save energy. Considering that the energy arrival process and channel information are not available a-priori, we propose an optimal deep reinforcement learning (DRL) algorithm to solve this average throughput maximization problem over finite horizon. We also propose a multi-agent deep reinforcement learning method to solve the dimensionality problem caused by the expansion of the state and action dimension. Finally, we compare these algorithms with two traditional algorithms, greedy algorithm and conservative algorithm. The numerical results show that the proposed algorithms are valid and effective in increasing system average throughput on long term.Keywords
Funding Information
- National Natural Science Foundation of China (61501202)
- Fundamental Research Funds for the Central Universities
This publication has 31 references indexed in Scilit:
- Energy-Aware Traffic Offloading for Green Heterogeneous NetworksIEEE Journal on Selected Areas in Communications, 2016
- Integrating Cellular Networks, Smart Grid, and Renewable Energy: Analysis, Architecture, and ChallengesIEEE Access, 2015
- Cognitive Radio for Smart Grids: Survey of Architectures, Spectrum Sensing Mechanisms, and Networking ProtocolsIEEE Communications Surveys & Tutorials, 2015
- Towards 1 Gbps/UE in Cellular Systems: Understanding Ultra-Dense Small Cell DeploymentsIEEE Communications Surveys & Tutorials, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Ultra-dense networks in millimeter-wave frequenciesIEEE Communications Magazine, 2015
- Power Allocation for Energy Harvesting Transmitter With Causal InformationIEEE Transactions on Communications, 2014
- Millimeter Wave Channel Modeling and Cellular Capacity EvaluationIEEE Journal on Selected Areas in Communications, 2014
- Research Directions for the Internet of ThingsIEEE Internet of Things Journal, 2014
- Resource allocation for multicast services in distributed antenna systems with quality of services guaranteesIET Communications, 2012