A Novel Multiple Access Scheme for Heterogeneous Wireless Communications Using Symmetry-Aware Continual Deep Reinforcement Learning
Open Access
- 28 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Machine Learning in Communications and Networking
- Vol. 3, 353-368
Abstract
The Metaverse holds the potential to revolutionize digital interactions through the establishment of a highly dynamic and immersive virtual realm over wireless communications systems, offering services such as massive twinning and telepresence. This landscape presents novel challenges, particularly efficient management of multiple access to the frequency spectrum, for which numerous adaptive Deep Reinforcement Learning (DRL) approaches have been explored. However, challenges persist in adapting agents to heterogeneous and non-stationary wireless environments. In this paper, we present a novel approach that leverages Continual Learning (CL) to enhance intelligent Medium Access Control (MAC) protocols, featuring an intelligent agent coexisting with legacy User Equipments (UEs) with varying numbers, protocols, and transmission profiles unknown to the agent for the sake of backward compatibility and privacy. We introduce an adaptive Double and Dueling Deep Q-Learning (D3QL)-based MAC protocol, enriched by a symmetry-aware CL mechanism, which maximizes intelligent agent throughput while ensuring fairness. Mathematical analysis validates the efficiency of our proposed scheme, showcasing superiority over conventional DRL-based techniques in terms of throughput, collision rate, and fairness, coupled with real-time responsiveness in highly dynamic scenarios.Keywords
All Related Versions
Funding Information
- ICTFICIAL Oy
- European Union’s Horizon Europe (HE) Research and Innovation Program HORIZON-Joint Undertaking Smart Networks and Services (JUSNS)-2023 through the 6G-Path Project (101139172)
- European Union’s Horizon 2020 Research and Innovation Program through the aerOS Project (101069732)
This publication has 44 references indexed in Scilit:
- Dynamic MAC Protocol for Wireless Spectrum Sharing via Hyperdimensional Self-LearningIEEE Access, 2024
- Metaverse Communications, Networking, Security, and Applications: Research Issues, State-of-the-Art, and Future DirectionsIEEE Communications Surveys & Tutorials, 2023
- QoS-Aware Service Prediction and Orchestration in Cloud-Network Integrated Beyond 5G2023
- Near-optimal Cloud-Network Integrated Resource Allocation for Latency-Sensitive B5G2022
- A Full Dive Into Realizing the Edge-Enabled Metaverse: Visions, Enabling Technologies, and ChallengesIEEE Communications Surveys & Tutorials, 2022
- Deep Reinforcement Learning for QoS provisioning at the MAC layer: A SurveyEngineering Applications of Artificial Intelligence, 2021
- Spectrum Management in the 6G Era: The Role of Regulation and Spectrum Sharing2020
- Automatic MAC protocol selection in wireless networks based on reinforcement learningComputer Communications, 2020
- Human-level control through deep reinforcement learningNature, 2015
- Q-learningMachine Learning, 1992