Design of a Feasible Wireless MAC Communication Protocol via Multi-Agent Reinforcement Learning
Authors:
- 5 May 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 94-100
Abstract
In the future beyond 5G (B5G) and 6G wireless networks, the topic of automatically learning a medium access control (MAC) communication protocol via the multi-agent reinforcement learning (MARL) paradigm has been receiving much attention. The proposals available in the literature show promising simulation results. However, they have been designed to run in computer simulations, where an environment gives observations and rewards to the agents neglecting the communications overhead. As a result, these solutions cannot be implemented in real-world scenarios as they are or require huge additional costs. In this paper, we focus on this feasibility problem. First, we provide a new description of the main learning schemes available in the literature from the perspective of feasibility in practical scenarios. Then, we propose a new feasible MARL-based learning framework that goes beyond the concept of an omniscient environment. We properly model a feasible Markov decision process (MDP), identify which physical entity calculates the reward, and how the reward is provided to the learning agents. The proposed learning framework is designed to reduce impact on the communication resources, while better exploiting the available information to learn efficient MAC protocols. Finally, we compare the proposed feasible framework against other solutions in terms of training convergence and communication performance achieved by the learned MAC protocols. The simulation results show that our feasible system exhibits performance in line with the unfeasible solutions.Keywords
This publication has 11 references indexed in Scilit:
- Learning Generalized Wireless MAC Communication Protocols via Abstraction2022
- 6G Wireless Networks: Vision, Requirements, Applications and Challenges2022
- Enabling URLLC in 5G NR IIoT Networks: A Full-Stack End-to-End Analysis2022
- Applications of Multi-Agent Reinforcement Learning in Future Internet: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2022
- The Emergence of Wireless MAC Protocols with Multi-Agent Reinforcement Learning2021
- Toward Joint Learning of Optimal MAC Signaling and Wireless Channel AccessIEEE Transactions on Cognitive Communications and Networking, 2021
- Reinforcement Learning for Connected Autonomous Vehicle Localization via UAVs2020
- Artificial-Intelligence-Enabled Air Interface for 6G: Solutions, Challenges, and Standardization ImpactsIEEE Communications Magazine, 2020
- Optimization for Reinforcement Learning: From a single agent to cooperative agentsIEEE Signal Processing Magazine, 2020
- Distributed Policy Evaluation Under Multiple Behavior StrategiesIEEE Transactions on Automatic Control, 2014