Deep Reinforcement Learning for Communication Flow Control in Wireless Mesh Networks
Authors:
- 9 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Network
- Vol. 35 (2) , 112-119
Abstract
Wireless mesh network (WMN) is one of the most promising technologies for Internet of Things (IoT) applications because of its self-adaptive and self-organization nature. To meet different performance requirements on communications in WMNs, traditional approaches always have to program flow control strategies in an explicit way. In this case, the performance of WMNs will be significantly affected by the dynamic properties of underlying networks in real applications. With providing a more flexible solution in mind, in this article, for the first time, we present how we can apply emerging Deep Reinforcement Learning (DRL) on communication flow control in WMNs. Moreover, different from a general DRL based networking solution, in which the network properties are pre-defined, we leverage the adaptive nature of WMNs and propose a self-adaptive DRL approach. Specifically, our method can reconstruct a WMN during the training of a DRL model. In this way, the trained DRL model can capture more properties of WMNs and achieve better performance. As a proof of concept, we have implemented our method with a self-adap-tive Deep Q-learning Network (DQN) model. The evaluation results show that the presented solution can significantly improve the communication performance of data flows in WMNs, compared to a static benchmark solution.Keywords
Funding Information
- National Natural Science Foundation of China (61902222)
This publication has 14 references indexed in Scilit:
- Deep Reinforcement Learning for Multimedia Traffic Control in Software Defined NetworkingIEEE Network, 2018
- An Energy-Efficient and Congestion Control Data-Driven Approach for Cluster-Based Sensor NetworkMobile Networks and Applications, 2018
- A Clustering Algorithm That Maximizes Throughput in 5G Heterogeneous F-RAN Networks2018
- Deep-Reinforcement Learning Multiple Access for Heterogeneous Wireless Networks2018
- Deep Reinforcement Learning for Dynamic Multichannel Access in Wireless NetworksIEEE Transactions on Cognitive Communications and Networking, 2018
- Survey on clustering in heterogeneous and homogeneous wireless sensor networksThe Journal of Supercomputing, 2017
- A Survey of Clustering Techniques in WSNs and Consideration of the Challenges of Applying Such to 5G IoT ScenariosIEEE Internet of Things Journal, 2017
- State-of-the-Art Deep Learning: Evolving Machine Intelligence Toward Tomorrow’s Intelligent Network Traffic Control SystemsIEEE Communications Surveys & Tutorials, 2017
- A systematic review on clustering and routing techniques based upon LEACH protocol for wireless sensor networksJournal of Network and Computer Applications, 2013
- Clustering Uncertain Data Using Voronoi Diagrams and R-Tree IndexIEEE Transactions on Knowledge and Data Engineering, 2010