Decentralized Configuration of TSCH-Based IoT Networks for Distinctive QoS: A Deep Reinforcement Learning Approach
- 3 May 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (19) , 16869-16880
Abstract
The IEEE 802.15.4 Time-Slotted Channel Hopping (TSCH) is widely used as a reliable, low-power, and low-cost communication technology for many industrial Internet-of-Things (IoT) networks. In many applications, Quality-of-Service (QoS) requirements are different for heterogeneous nodes, necessitating non-equal parameter settings per node. This results in a very large configuration space making space exploration complex and time-consuming. Moreover, network state and QoS requirements may change over time. Thus, run-time configuration mechanisms are needed for making decisions about proper node settings to consistently satisfy diverse and dynamic QoS requirements. In this paper, we propose a run-time decentralized self-optimization framework based on Deep Reinforcement Learning (DRL) for parameter configuration of a multi-hop TSCH network. DRL adopts neural networks as approximate functions to speed up the process of converging to QoS-satisfying configurations. Simulation results show that our proposed framework enables the network to use the right configuration settings according to the diverse QoS demands of different nodes. Moreover, it is shown that the convergence time of the learning framework is in the order of a few minutes which is acceptable for many IoT applications.Keywords
Funding Information
- Electronic Component Systems for European Leadership Joint Undertaking through SCOTT European (737422)
This publication has 13 references indexed in Scilit:
- Deep Reinforcement Learning for QoS provisioning at the MAC layer: A SurveyEngineering Applications of Artificial Intelligence, 2021
- Priority-Aware Reinforcement-Learning-Based Integrated Design of Networking and Control for Industrial Internet of ThingsIEEE Internet of Things Journal, 2020
- Reinforcement Learning Meets Wireless Networks: A Layering PerspectiveIEEE Internet of Things Journal, 2020
- Deep Reinforcement Learning Aided Intelligent Access Control in Energy Harvesting Based WLANIEEE Transactions on Vehicular Technology, 2020
- Implementation of DNNs on IoT devicesNeural Computing and Applications, 2019
- Distributed Policy Learning Based Random Access for Diversified QoS Requirements2019
- Parameter Self-Configuration and Self-Adaptation in Industrial Wireless Sensor-Actuator Networks2019
- Orchestra2015
- Human-level control through deep reinforcement learningNature, 2015
- Q-learningMachine Learning, 1992