Low-Latency and Q-Learning-Based Distributed Scheduling Function for Dynamic 6TiSCH Networks
Open Access
- 3 April 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 49694-49707
Abstract
Traffic patterns generated by industrial Internet of Things (IIoT) services can be categorized as either periodic or bursty. The minimal scheduling function (MSF), standardized by the 6TiSCH working group, serves as an example of a scheduling function for IEEE 802.15.4e time-slotted channel hopping. However, the MSF is inadequate for bursty traffic patterns in which a large amount of data is delivered at random intervals. This limitation arises because the MSF requires more dedicated cells to prevent packet loss, but an increased allocation of dedicated cells leads to excessive cell utilization and energy inefficiency. Furthermore, low latency should be considered in bursty traffic patterns, which require proper cell allocation instead of random cell allocation. To address these challenges, we propose a low-latency and Q-learning-based scheduling function (LLQL-SF), is designed for 6TiSCH networks. This new scheduler has been designed to effectively adapt to dynamic traffic patterns by optimizing cell allocation to minimize latency. Additionally, we have integrated a Q-learning algorithm into this scheduler, enabling it to dynamically determine the ideal quantity of dedicated cells required for each slot frame iteration based on the network demands. The proposed methods were evaluated by simulation over various periodic or bursty traffic and network sizes. Also, test over 30 real testbed devices that deployed on FIT IoT-LAB. The results indicated that LLQL-SF outperformed the benchmark methods. LLQL-SF can achieve higher packet delivery, lower latency, and energy usage compared with the standard scheduling function by 11%, -20%, and -11%, respectively.Keywords
Funding Information
- MSIT (Ministry of Science and ICT), Korea
- ITRC (Information Technology Research Center) Support Program (IITP-2024-RS-2023-00260098)
- IITP
- Institute of Information & communications Technology Planning & Evaluation (IITP) under the Artificial Intelligence Convergence Innovation Human Resources Development (IITP-2024-RS-2023-00254177)
- Korea government
This publication has 27 references indexed in Scilit:
- Multi-Agent Reinforcement-Learning-Based Time-Slotted Channel Hopping Medium Access Control Scheduling SchemeIEEE Access, 2020
- OST: On-Demand TSCH Scheduling with Traffic-Awareness2020
- Industry 4.0: Industrial Internet of Things (IIOT)2020
- RL-TSCH: A Reinforcement Learning Algorithm for Radio Scheduling in TSCH 802.15.4e2019
- TESLA: Traffic-Aware Elastic Slotframe Adjustment in TSCH NetworksIEEE Access, 2019
- IETF 6TiSCH: A TutorialIEEE Communications Surveys & Tutorials, 2019
- Simulating 6TiSCH networksTransactions on Emerging Telecommunications Technologies, 2018
- ReSF: Recurrent Low-Latency Scheduling in IEEE 802.15.4e TSCH networksAd Hoc Networks, 2018
- Decentralized Traffic Aware Scheduling in 6TiSCH Networks: Design and Experimental EvaluationIEEE Internet of Things Journal, 2015
- OpenWSN: a standards‐based low‐power wireless development environmentTransactions on Emerging Telecommunications Technologies, 2012