Deep-Graph-Based Reinforcement Learning for Joint Cruise Control and Task Offloading for Aerial Edge Internet of Things (EdgeIoT)
- 10 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (21) , 21676-21686
Abstract
This paper puts forth an aerial edge Internet-of-Things (EdgeIoT) system, where an unmanned aerial vehicle (UAV) is employed as a mobile edge server to process mission-critical computation tasks of ground Internet-of-Things (IoT) devices. When the UAV schedules an IoT device to offload its computation task, the tasks buffered at the other unselected devices could be outdated and have to be cancelled. We investigate a new joint optimization of UAV cruise control and task offloading allocation, which maximizes tasks offloaded to the UAV, subject to the IoT device’s computation capacity and battery budget, and the UAV’s speed limit. Since the optimization contains a large solution space while the instantaneous network states are unknown to the UAV, we propose a new deep graph-based reinforcement learning framework. An advantage actor-critic (A2C) structure is developed to train the real-time continuous actions of the UAV in terms of the flight speed, heading, and the offloading schedule of the IoT device. By exploring hidden representations resulting from the network feature correlation, our framework takes advantage of graph neural networks (GNN) to supervise the training of UAV’s actions in A2C. The proposed GNN-A2C framework is implemented with Google Tensorflow. The performance analysis shows that GNN-A2C achieves fast convergence and reduces considerably the task missing rate in aerial EdgeIoT.Keywords
Funding Information
- National Funds through FCT/MCTES (Portuguese Foundation for Science and Technology), within the CISTER Research Unit (UIDP/UIDB/04234/2020)
- National Funds through FCT (PTDC/EEICOM/3362/2021 (ADANET))
This publication has 39 references indexed in Scilit:
- Performance modeling and analysis of a UAV path planning and target detection in a UAV-based wireless sensor networkComputer Networks, 2018
- Joint Offloading and Trajectory Design for UAV-Enabled Mobile Edge Computing SystemsIEEE Internet of Things Journal, 2018
- Communication-Aware Trajectory Planning for Unmanned Aerial Vehicles in Urban EnvironmentsJournal of Guidance, Control, and Dynamics, 2018
- An Air-Ground Integration Approach for Mobile Edge Computing in IoTIEEE Communications Magazine, 2018
- Mobile Edge Computing for Cellular-Connected UAV: Computation Offloading and Trajectory Optimization2018
- Computation Offloading and Resource Allocation in D2D-Enabled Mobile Edge Computing2018
- Service Entity Placement for Social Virtual Reality Applications in Edge Computing2018
- Edge Computing for the Internet of Things: A Case StudyIEEE Internet of Things Journal, 2018
- The Altitude Hold Algorithm of UAV Based on Millimeter Wave Radar Sensors2017
- Mobile-Edge Computing and the Internet of Things for Consumers: Extending cloud computing and services to the edge of the networkIEEE Consumer Electronics Magazine, 2016