Abstract
With the development of Unmanned Aerial Vehicles (UAVs) in recent years, UAV-mounted Mobile Edge Computing (MEC) systems are widely used for broadband connectivity and emergency communications in areas without internet. However, the onboard energy of UAVs is limited, and how to provide long-term computing services for ground User Equipments (UEs) still faces significant challenges. In this paper, UAVs are used as mobile base stations to offer MEC services for UEs. Unlike existing solutions that mainly solve UAV path planning from convex optimization methods, we propose a Multi-Agent Path planning (MAP) scheme based on deep reinforcement learning. We aim to minimize the total energy consumption of UAVs while completing the offloading tasks of UEs. At the same time, fairness is taken into account to ensure UE offloading balance and UAV load balance. To this end, we establish the optimization problem and design the state space, action space, and reward function for modeling each UAV through Deep Neural Networks (DNNs). Extensive simulation experiments show that the proposed scheme outperforms other benchmark schemes.
Funding Information
  • Hunan Natural Science Foundation of China (2020JJ4008)
  • National Natural Science Foundation of China (61672221, 61572219, 61772184, 61732017, 61502162, 61702175)
  • Hunan Key Research and Development Program (2020GK2006)
  • Key Research and Development Project of Hunan Province of China (2022GK2020)
  • Hunan Natural Science Foundation of China (2022JJ30171)
  • Funding Projects of Zhejiang Lab (2021LC0AB05)

This publication has 36 references indexed in Scilit: