Abstract
Mobile edge computing (MEC) is considered a novel paradigm for computation-intensive and delay-sensitive tasks in fifth generation (5G) networks and beyond. However, its uncertainty, referred to as dynamic and randomness, from the mobile device, wireless channel, and edge network sides, results in high-dimensional, nonconvex, nonlinear, and NP-hard optimization problems. Thanks to the evolved reinforcement learning (RL), upon iteratively interacting with the dynamic and random environment, its trained agent can intelligently obtain the optimal policy in MEC. Furthermore, its evolved versions, such as deep reinforcement learning (DRL), can achieve higher convergence speed efficiency and learning accuracy based on the parametric approximation for the large-scale state-action space. This paper provides a comprehensive research review on RL-enabled MEC and offers insight for development in this area. More importantly, associated with free mobility, dynamic channels, and distributed services, the MEC challenges that can be solved by different kinds of RL algorithms are identified, followed by how they can be solved by RL solutions in diverse mobile applications. Finally, the open challenges are discussed to provide helpful guidance for future research in RL training and learning MEC.
Funding Information
  • National Key Research and Development Program of China (2020YFA0711301)
  • National Natural Science Foundation of China (61941104, 61901298, 61922049, 61801248, 61771264)
  • Natural Science Foundation of Tianjin (20JCQNJC00300)
  • Science and Technology Development Fund of Tianjin Education Commission for Higher Education (2018KJ211)
  • Shanghai Municipal Science and Technology Major Project (2018SHZDZX04)
  • Tsinghua University–China Mobile Communications Group Company Ltd. Joint Institute
  • Natural Science Foundation of Jiangsu Province (BK20180943)

This publication has 177 references indexed in Scilit: