Information Bottleneck for Communication-Efficient Multi-Agent Reinforcement Learning in UAV Swarms
Open Access
Abstract
Multi-agent reinforcement learning has emerged as a promising paradigm for cooperative unmanned aerial vehicle (UAV) swarm coordination. However, existing communication-aware MARL methods primarily focus on communication topology, message routing, and message aggregation, while the information content of the exchanged messages is often only implicitly controlled. In realistic UAV networks, inter-agent communication is constrained by limited bandwidth, communication range, energy consumption, and packet loss. It is therefore desirable for each UAV to transmit compact and task-relevant information rather than dense and redundant latent features. In this paper, we propose IB-CEMARL, an information-bottleneck-guided, communication-efficient multi-agent reinforcement learning framework for UAV swarms. We formulate inter-UAV communication as a minimal sufficient message-learning problem in which each UAV encodes its local observation into a stochastic bottleneck message before exchanging information with its neighbors. Cauchy–Schwarz divergence-based quadratic mutual information is adopted as a unified dependence measure to jointly regularize message compression, preserve decision-relevant information, and reduce statistical redundancy among neighboring UAV messages. Extensive experiments demonstrate that IB-CEMARL achieves superior cooperative performance, reduced message redundancy, and stronger robustness compared with representative communication-aware MARL baselines. In particular, IB-CEMARL improves the average return by and reduces inter-message dependence by compared with the KL-IB-MARL baseline while maintaining efficient communication under constrained bandwidth settings.
Keywords
Funding Information
- National Natural Science Foundation of China (62573227)
- Collaborative Innovation Fund of the Institute of Optoelectronic Technology (613CXJJ2025DX03)
- State Key Laboratory Foundation for Defense Science and Technology (2025-WDZC-004-06)
This publication has 17 references indexed in Scilit:
- Large-Scale UAV Swarm Coordination for Sensing and Communication: A Spatiotemporal PerspectiveACM Computing Surveys, 2026
- A Survey on DRL-Based UAV Communications and Networking: DRL Fundamentals, Applications and ImplementationsIEEE Communications Surveys & Tutorials, 2025
- Joint optimization of communication and mission performance for multi-UAV collaboration network: A multi-agent reinforcement learning methodAd Hoc Networks, 2024
- A survey of multi-agent deep reinforcement learning with communicationAutonomous Agents and Multi-Agent Systems, 2024
- Distributed Machine Learning for UAV Swarms: Computing, Sensing, and SemanticsIEEE Internet of Things Journal, 2023
- Application of Deep Reinforcement Learning to UAV Swarming for Ground SurveillanceSensors, 2023
- The Surprising Effectiveness of PPO in Cooperative Multi-Agent Games2022
- Information-Bottleneck-Based Behavior Representation Learning for Multi-Agent Reinforcement Learning2021
- Deep Deterministic Information Bottleneck with Matrix-Based Entropy Functional2021
- The Cauchy–Schwarz divergence and Parzen windowing: Connections to graph theory and Mercer kernelsJournal of the Franklin Institute, 2006