Joint Multi-Agent Reinforcement Learning and Message-Passing for Resilient Multi-UAV Networks
- 2 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Network and Service Management
- Vol. 23, 2051-2063
Abstract
This paper introduces a novel resilient algorithm designed for distributed unmanned aerial vehicles (UAVs) in dynamic and unreliable network environments. Initially, the UAVs should be trained via multi-agent reinforcement learning (MARL) for autonomous mission-critical operations and are fundamentally grounded by centralized training and decentralized execution (CTDE) using a centralized MARL server. In this situation, it is crucial to consider the case where several UAVs cannot receive CTDE-based MARL learning parameters for resilient operations in unreliable network conditions. To tackle this issue, a communication graph is used where its edges are established when two UAVs/nodes are communicable. Then, the edge-connected UAVs can share their training data if one of the UAVs cannot be connected to the CTDE-based MARL server under unreliable network conditions. Additionally, the edge cost considers power efficiency. Based on this given communication graph, message-passing is used for electing the UAVs that can provide their MARL learning parameters to their edge-connected peers. Lastly, performance evaluations demonstrate the superiority of our proposed algorithm in terms of power efficiency and resilient UAV task management, outperforming existing benchmark algorithms.Keywords
Funding Information
- Electronics and Telecommunications Research Institute
- Korean Government [Research on Multi-Agent Reinforcement Learning Exploration, Communication, Training Strategy]
- Air Force Office of Scientific Research (FA2386-22-1-4009)
- Ministry of Trade, Industry and Energy and Korea Evaluation Institute of Industrial Technology ((RS-2024-00442168))
This publication has 46 references indexed in Scilit:
- Online Multi-Agent Reinforcement Learning for Multiple Access in Wireless NetworksIEEE Communications Letters, 2023
- Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning2023
- Quantum Multi-Agent Reinforcement Learning for Autonomous Mobility CooperationIEEE Communications Magazine, 2023
- Multi-Agent Visual Coordination Using Optical Wireless CommunicationIEEE Robotics and Automation Letters, 2023
- Joint Neural Network for Trajectory and Communication Design in Multi-UAV Systems2022
- Centralized Resource Allocation and Distributed Power Control for NOMA-Integrated NR V2XIEEE Internet of Things Journal, 2021
- Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A TutorialIEEE Communications Surveys & Tutorials, 2021
- Self-adaptive power control with deep reinforcement learning for millimeter-wave Internet-of-vehicles video cachingJournal of Communications and Networks, 2020
- Robust 60-GHz Beamforming for UAVs: Experimental Analysis of Hovering, Blockage, and Beam SelectionIEEE Internet of Things Journal, 2020
- Mobility-Aware Centralized Reinforcement Learning for Dynamic Resource Allocation in HetNets2019