Air-Ground Spatial Crowdsourcing with UAV Carriers by Geometric Graph Convolutional Multi-Agent Deep Reinforcement Learning
Authors:
- 1 April 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1790-1802
Abstract
Spatial Crowdsourcing (SC) has been proved as an effective paradigm for data acquisition in urban environments. Apart from using human participants, with the rapid development of unmanned vehicles (UVs) technologies, unmanned aerial or ground vehicles (UAVs, UGVs) are equipped with various high-precision sensors, enabling them to become new types of data collectors. However, UGVs’ operational range is constrained by the road network, and UAVs are limited by power supply, it is thus natural to use UGVs and UAVs together as a coalition, and more precisely, UGVs behave as the UAV carriers for range extensions to achieve complicated air-ground SC tasks. In this paper, we propose a novel communication-based multi-agent deep reinforcement learning method called "GARL", which consists of a multi-center attention-based graph convolutional network (GCN) to accurately extract UGV specific features from UGV stop network called "MC-GCN", and a novel GNN-based communication mechanism called "E-Comm" to make the cooperation among UGVs adaptive to constant changing of geometric shapes formed by UGVs. Extensive simulation results on two campuses of KAIST and UCLA campuses show that GARL consistently outperforms eight other baselines in terms of overall efficiency.Keywords
Funding Information
- National Natural Science Foundation of China
- National Key Research and Development Program of China
This publication has 25 references indexed in Scilit:
- Distributed Energy-Efficient Multi-UAV Navigation for Long-Term Communication Coverage by Deep Reinforcement LearningIEEE Transactions on Mobile Computing, 2019
- Blockchain-Enabled Data Collection and Sharing for Industrial IoT With Deep Reinforcement LearningIEEE Transactions on Industrial Informatics, 2018
- Energy-Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning ApproachIEEE Journal on Selected Areas in Communications, 2018
- When Mobile Crowd Sensing Meets UAV: Energy-Efficient Task Assignment and Route PlanningIEEE Transactions on Communications, 2018
- Learning-Based Energy-Efficient Data Collection by Unmanned Vehicles in Smart CitiesIEEE Transactions on Industrial Informatics, 2017
- A Concise Introduction to Decentralized POMDPs2016
- Convolutional neural networks at constrained time cost2015
- Energy-Aware Participant Selection for Smartphone-Enabled Mobile Crowd SensingIEEE Systems Journal, 2015
- Toward QoI and Energy-Efficiency in Internet-of-Things Sensory EnvironmentsIEEE Transactions on Emerging Topics in Computing, 2014
- GeoCrowd2012