Multi-UAV Adaptive Path Planning Using Deep Reinforcement Learning
Authors:
- 1 October 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 649-656
Abstract
Efficient aerial data collection is important in many remote sensing applications. In large-scale monitoring scenarios, deploying a team of unmanned aerial vehicles (UAVs) offers improved spatial coverage and robustness against individual failures. However, a key challenge is cooperative path planning for the UAVs to efficiently achieve a joint mission goal. We propose a novel multi-agent informative path planning approach based on deep reinforcement learning for adaptive terrain monitoring scenarios using UAV teams. We introduce new network feature representations to effectively learn path planning in a 3D workspace. By leveraging a counterfactual baseline, our approach explicitly addresses credit assignment to learn cooperative behaviour. Our experimental evaluation shows improved planning performance, i.e. maps regions of interest more quickly, with respect to non-counterfactual variants. Results on synthetic and real-world data show that our approach has superior performance compared to state-of-the-art non-learning-based methods, while being transferable to varying team sizes and communication constraints.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Deep Reinforcement Learning Applied to Multi-agent Informative Path Planning in Environmental Missions2023
- UAV swarm path planning with reinforcement learning for field prospectingApplied Intelligence, 2022
- Monitoring and Mapping of Crop Fields with UAV Swarms Based on Information Gain2022
- Informative path planning for anomaly detection in environment exploration and monitoringOcean Engineering, 2022
- An informative path planning framework for UAV-based terrain monitoringAutonomous Robots, 2020
- Joint Optimization of Multi-UAV Target Assignment and Path Planning Based on Multi-Agent Reinforcement LearningIEEE Access, 2019
- Perspectives for Remote Sensing with Unmanned Aerial Vehicles in Precision AgricultureTrends in Plant Science, 2019
- Multi-objective UAV path planning for search and rescue2017
- Supporting wilderness search and rescue using a camera‐equipped mini UAVJournal of Field Robotics, 2007
- Using occupancy grids for mobile robot perception and navigationComputer, 1989