RL meets Multi-Link Operation in IEEE 802.11be: Multi-Headed Recurrent Soft-Actor Critic-based Traffic Allocation
Authors:
- 28 May 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4001-4006
Abstract
IEEE 802.11be -Extremely High Throughput-, commercially known as Wireless-Fidelity (Wi-Fi) 7 is the newest IEEE 802.11 amendment that comes to address the increasingly throughput hungry services such as Ultra High Definition (4K/8K) Video and Virtual/Augmented Reality (VR/AR). To do so, IEEE 802.11be presents a set of novel features that will boost the Wi-Fi technology to its edge. Among them, Multi-Link Operation (MLO) devices are anticipated to become a reality, leaving Single-Link Operation (SLO) Wi-Fi in the past. To achieve superior throughput and very low latency, a careful design approach must be taken, on how the incoming traffic is distributed in MLO capable devices. In this paper, we present a Reinforcement Learning (RL) algorithm named Multi-Headed Recurrent Soft-Actor Critic (MH-RSAC) to distribute incoming traffic in 802.11be MLO capable networks. Moreover, we compare our results with two non-RL baselines previously proposed in the literature named: Single Link Less Congested Interface (SLCI) and Multi-Link Congestion-aware Load balancing at flow arrivals (MCAA). Simulation results reveal that the MH-RSAC algorithm is able to obtain gains in terms of Throughput Drop Ratio (TDR) up to 35.2% and 6% when compared with the SLCI and MCAA algorithms, respectively. Finally, we observed that our scheme is able to respond more efficiently to high throughput and dynamic traffic such as VR and Web Browsing (WB) when compared with the baselines. Results showed an improvement of the MH-RSAC scheme in terms of Flow Satisfaction (FS) of up to 25.6% and 6% over the the SCLI and MCAA algorithms.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Multi-Link Operation in IEEE 802.11be WLANsIEEE Wireless Communications, 2022
- Dynamic Traffic Allocation in IEEE 802.11be Multi-Link WLANsIEEE Wireless Communications Letters, 2022
- Competitive Multi-Agent Load Balancing with Adaptive Policies in Wireless Networks2022
- Virtual Reality Gaming on the Cloud: A Reality Check2021
- Analysis of Latency and Reliability Improvement with Multi-Link Operation over 802.112021
- Survey and Perspective on Extremely High Throughput (EHT) WLAN — IEEE 802.11beMobile Networks and Applications, 2020
- An Introduction to Probability Theory and Its Applications; Vol. 1Revue de l'Institut International de Statistique / Review of the International Statistical Institute, 1969