Reinforcement Learning-Empowered Mobile Edge Computing for 6G Edge Intelligence
Open Access
- 16 June 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 65156-65192
Abstract
Mobile edge computing (MEC) is considered a novel paradigm for computation-intensive and delay-sensitive tasks in fifth generation (5G) networks and beyond. However, its uncertainty, referred to as dynamic and randomness, from the mobile device, wireless channel, and edge network sides, results in high-dimensional, nonconvex, nonlinear, and NP-hard optimization problems. Thanks to the evolved reinforcement learning (RL), upon iteratively interacting with the dynamic and random environment, its trained agent can intelligently obtain the optimal policy in MEC. Furthermore, its evolved versions, such as deep reinforcement learning (DRL), can achieve higher convergence speed efficiency and learning accuracy based on the parametric approximation for the large-scale state-action space. This paper provides a comprehensive research review on RL-enabled MEC and offers insight for development in this area. More importantly, associated with free mobility, dynamic channels, and distributed services, the MEC challenges that can be solved by different kinds of RL algorithms are identified, followed by how they can be solved by RL solutions in diverse mobile applications. Finally, the open challenges are discussed to provide helpful guidance for future research in RL training and learning MEC.Keywords
All Related Versions
Funding Information
- National Key Research and Development Program of China (2020YFA0711301)
- National Natural Science Foundation of China (61941104, 61901298, 61922049, 61801248, 61771264)
- Natural Science Foundation of Tianjin (20JCQNJC00300)
- Science and Technology Development Fund of Tianjin Education Commission for Higher Education (2018KJ211)
- Shanghai Municipal Science and Technology Major Project (2018SHZDZX04)
- Tsinghua University–China Mobile Communications Group Company Ltd. Joint Institute
- Natural Science Foundation of Jiangsu Province (BK20180943)
This publication has 177 references indexed in Scilit:
- Network Slicing for 5G with SDN/NFV: Concepts, Architectures, and ChallengesIEEE Communications Magazine, 2017
- On Radio Access Network Slicing from a Radio Resource Management PerspectiveIEEE Wireless Communications, 2017
- The Emergence of Edge ComputingComputer, 2017
- Online Learning for Offloading and Autoscaling in Renewable-Powered Mobile Edge Computing2016
- Delay-optimal computation task scheduling for mobile-edge computing systems2016
- Processor-Network Speed Scaling for Energy–Delay Tradeoff in Smartphone ApplicationsIEEE/ACM Transactions on Networking, 2015
- Human-level control through deep reinforcement learningNature, 2015
- Network virtualization and software defined networking for cloud computing: a surveyIEEE Communications Magazine, 2013
- A tutorial on decomposition methods for network utility maximizationIEEE Journal on Selected Areas in Communications, 2006
- Dynamic critical-path scheduling: an effective technique for allocating task graphs to multiprocessorsIEEE Transactions on Parallel and Distributed Systems, 1996