Risk-aware UAV-UGV Rendezvous with Chance-Constrained Markov Decision Process
Authors:
- 6 December 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 180-187
Abstract
We study a chance-constrained variant of the cooperative aerial-ground vehicle routing problem, in which an Unmanned Aerial Vehicle (UAV) with limited battery capacity and an Unmanned Ground Vehicle (UGV) that can also act as a mobile recharging station need to jointly accomplish a mission such as monitoring a set of points. Due to the limited battery capacity of the UAV, two vehicles sometimes have to deviate from their task to rendezvous and recharge the UAV. Unlike prior work that has focused on the deterministic case, we address the challenge of stochastic energy consumption of the UAV. We are interested in finding the optimal policy that decides when and where to rendezvous such that the expected travel time of the UAV is minimized and the probability of running out of charge is less than a user-defined tolerance. We formulate this problem as a Chance Constrained Markov Decision Process (CCMDP), which can be equivalently transformed into a Constrained Markov Decision Process (CMDP). To the best knowledge of the authors, this is the first CMDP-based formulation for the UAVUGV routing problems under power consumption uncertainty. We adopt a Linear Programming (LP) based approach to solve the problem optimally. We demonstrate the effectiveness of our formulation in the context of an Intelligence Surveillance and Reconnaissance (ISR) mission.Keywords
All Related Versions
Funding Information
- National Science Foundation
- Arm
This publication has 21 references indexed in Scilit:
- Cooperative Routing Problem for Ground Vehicle and Unmanned Aerial Vehicle: The Application on Intelligence, Surveillance, and Reconnaissance MissionsIEEE Access, 2019
- Persistent Monitoring with Refueling on a Terrain Using a Team of Aerial and Ground Robots2018
- Optimization Approaches for the Traveling Salesman Problem with DroneTransportation Science, 2018
- Algorithms for Routing of Unmanned Aerial Vehicles with Mobile Recharging Stations2018
- Optimization approaches for civil applications of unmanned aerial vehicles (UAVs) or aerial drones: A surveyNetworks, 2018
- On the min-cost Traveling Salesman Problem with DroneTransportation Research Part C: Emerging Technologies, 2018
- Sensor Planning for a Symbiotic UAV and UGV System for Precision AgricultureIEEE Transactions on Robotics, 2016
- Planning Paths for Package Delivery in Heterogeneous Multirobot TeamsIEEE Transactions on Automation Science and Engineering, 2015
- The flying sidekick traveling salesman problem: Optimization of drone-assisted parcel deliveryTransportation Research Part C: Emerging Technologies, 2015
- Risk-Sensitive Reinforcement Learning Applied to Control under ConstraintsJournal of Artificial Intelligence Research, 2005