Distributed Routing Optimization Algorithm for FANET Based on Multiagent Reinforcement Learning
- 26 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 24 (15) , 24851-24864
Abstract
Recent advancements in protocol design and optimization for Flying Ad-hoc Networks have shown significant progress. However, the existing centralized optimization control algorithms pose conflicts with the distributed nature of these systems. To address this challenge, this paper proposes a novel distributed routing optimization algorithm based on multi-agent reinforcement learning, integrated with an adaptive multi-mode routing framework incorporating multi-protocol cooperation mechanisms. The algorithm adopts the Decentralized Execution Multi-Agent Deep Deterministic Policy Gradient (DE-MADDPG) algorithm framework, enabling individual unmanned aerial vehicles to directly adjust the protocols and protocol parameters of the current node based solely on local network information. This optimization enhances network structure and overall performance without considering the transmission delay of control signals. The ns3-gym simulation platform is employed for performance evaluation, comparing the proposed algorithm with Deep Q-Network (DQN), Multi-Agent Deep Deterministic Policy Gradient (MADDPG), and other algorithms. The experimental results demonstrate that compared to the routing algorithm optimized based on DQN, the proposed algorithm exhibits the best overall performance, with a 26.31% reduction in energy consumption and a 19.69% decrease in end-to-end delay.Keywords
Funding Information
- National Defense Technology Foundation Research Project (JCKY2023xxxx007)
- Natural Science Foundation of China (61973161, 61991404)
- Jiangsu Science and Technology planning project (BE2021610)
This publication has 32 references indexed in Scilit:
- Fuzzy logic based cross-layer design to improve Quality of Service in Mobile ad-hoc networks for Next-gen Cyber Physical SystemEngineering Science and Technology, an International Journal, 2022
- QMR:Q-learning based Multi-objective optimization Routing protocol for Flying Ad Hoc NetworksComputer Communications, 2020
- STFANET: SDN-Based Topology Management for Flying Ad Hoc NetworkIEEE Access, 2019
- Data collection using unmanned aerial vehicles for Internet of Things platformsComputers and Electrical Engineering, 2019
- Multi-agent deep learning for simultaneous optimization for time and energy in distributed routing systemFuture Generation Computer Systems, 2019
- Reinforcement Learning Based Routing in Networks: Review and Classification of ApproachesIEEE Access, 2019
- A traffic-differentiated routing algorithm in Flying Ad Hoc Sensor Networks with SDN cluster controllersJournal of the Franklin Institute, 2019
- Jamming-Resilient Multipath Routing Protocol for Flying Ad Hoc NetworksIEEE Access, 2018
- A Survey on Network Architectures and Applications for Nanosat and UAV Swarms2018
- Suitability of MANET Routing Protocols for the Next-Generation National Security and Public Safety Systems2015