A Hybrid DQN and Optimization Approach for Strategy and Resource Allocation in MEC Networks
- 17 February 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Wireless Communications
- Vol. 20 (7) , 4282-4295
Abstract
We consider a multi-user multi-server mobile edge computing (MEC) network with time-varying fading channels and formulate an offloading decision and resource allocation problem. To solve this mixed-integer non-convex problem, we propose two hybrid approaches that learn offloading strategy with DQN (opt-DQN) or Q-table (opt-QL) at each user equipment (UE). The communication resources are allocated with an optimization algorithm at each computational access point (CAP). We also propose a pure DQN method that learns both the offloading strategy and resource allocation via Q-learning (QL). We analyze the convergence behavior of the QL-based algorithms from a game-theoretical perspective and demonstrate the performance of the proposed hybrid approaches for different network sizes. The simulation results show that the hybrid approaches reach lower costs than other baseline algorithms and the pure-DQN approach. Moreover, the performance of the pure-DQN approach degrades severely as the network size increases, while opt-DQN still performs the best, followed by opt-QL. These observations demonstrate that the hybrid approach that combines the advantages of both QL and convex optimization is a promising design for a multi-user MEC network, wherein complicated offloading and resource allocation strategies need to be determined in a timely and accurate fashion.Keywords
Funding Information
- Ministry of Science and Technology, Taiwan (MOST107-2221-E-002-196-MY3)
- MOE ARF Tier 2 (T2EP20120-0006)
- SUTD Growth Plan Grant for AI
This publication has 34 references indexed in Scilit:
- Edge Computing: Vision and ChallengesIEEE Internet of Things Journal, 2016
- Energy Efficient Mobile Cloud Computing Powered by Wireless Energy TransferIEEE Journal on Selected Areas in Communications, 2016
- Joint Optimization of Radio and Computational Resources for Multicell Mobile-Edge ComputingIEEE Transactions on Signal and Information Processing over Networks, 2015
- Internet of Things: A Survey on Enabling Technologies, Protocols, and ApplicationsIEEE Communications Surveys & Tutorials, 2015
- An IoT-Aware Architecture for Smart Healthcare SystemsIEEE Internet of Things Journal, 2015
- Low-Energy Security: Limits and Opportunities in the Internet of ThingsIEEE Security & Privacy, 2015
- Scenarios for 5G mobile and wireless communications: the vision of the METIS projectIEEE Communications Magazine, 2014
- A Q-learning-based dynamic channel assignment technique for mobile communication systemsIEEE Transactions on Vehicular Technology, 1999
- Processor design for portable systemsJournal of Signal Processing Systems, 1996
- Nonlinear Optimization by Successive Linear ProgrammingManagement Science, 1982