A DQN-Based Cache Strategy for Mobile Edge Networks
Authors:
- Siyuan SunSSSiyuan Sun
- Junhua ZhouJZJunhua Zhou
- Jiuxing WenJWJiuxing Wen
- Yifei WeiYWYifei Wei
- Xiaojun WangXWXiaojun Wang
Open Access
- 1 January 2022
- journal article
- research article
- Published by Tech Science Press in Computers, Materials & Continua
- Vol. 71 (2) , 3277-3291
Abstract
The emerging mobile edge networks with content caching capability allows end users to receive information from adjacent edge servers directly instead of a centralized data warehouse, thus the network transmission delay and system throughput can be improved significantly. Since the duplicate content transmissions between edge network and remote cloud can be reduced, the appropriate caching strategy can also improve the system energy efficiency of mobile edge networks to a great extent. This paper focuses on how to improve the network energy efficiency and proposes an intelligent caching strategy according to the cached content distribution model for mobile edge networks based on promising deep reinforcement learning algorithm. The deep neural network (DNN) and Q-learning algorithm are combined to design a deep reinforcement learning framework named as the deep-Q neural network (DQN), in which the DNN is adopted to represent the approximation of action-state value function in the Q-learning solution. The parameters iteration strategies in the proposed DQN algorithm were improved through stochastic gradient descent method, so the DQN algorithm could converge to the optimal solution quickly, and the network performance of the content caching policy can be optimized. The simulation results show that the proposed intelligent DQN-based content cache strategy with enough training steps could improve the energy efficiency of the mobile edge networks significantly.Keywords
This publication has 27 references indexed in Scilit:
- User Scheduling and Resource Allocation in HetNets With Hybrid Energy Supply: An Actor-Critic Reinforcement Learning ApproachIEEE Transactions on Wireless Communications, 2017
- Integration of Networking, Caching, and Computing in Wireless Systems: A Survey, Some Research Issues, and ChallengesIEEE Communications Surveys & Tutorials, 2017
- Resource Allocation for Information-Centric Virtualized Heterogeneous Networks With In-Network Caching and Mobile Edge ComputingIEEE Transactions on Vehicular Technology, 2017
- Edge caching with mobility prediction in virtualized LTE mobile networksFuture Generation Computer Systems, 2017
- Optimal Cooperative Content Caching and Delivery Policy for Heterogeneous Cellular NetworksIEEE Transactions on Mobile Computing, 2016
- A Survey of Caching Policies and Forwarding Mechanisms in Information-Centric NetworkingIEEE Communications Surveys & Tutorials, 2016
- Software-Defined Network Function Virtualization: A SurveyIEEE Access, 2015
- Flow-Based Management For Energy Efficient Campus NetworksIEEE Transactions on Network and Service Management, 2015
- Information-centric network function virtualization over 5g mobile wireless networksIEEE Network, 2015
- A survey of energy-efficient caching in information-centric networkingIEEE Communications Magazine, 2014