Joint Content Caching, Recommendation, and Transmission for Layered Scalable Videos Over Dynamic Cellular Networks: A Dueling Deep Q-Learning Approach
Open Access
- 7 March 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 36657-36669
Abstract
Scalable Video Coding (SVC) and edge caching are two techniques that hold the potential to improve user-perceived video viewing experience. Moreover, video recommendation can further enhance the caching gain by reshaping users’ video preferences. In this paper, we investigate the video caching, recommendation and transmission for layered SVC streaming in cache-enabled cellular networks. Considering the dynamic characteristics of video popularity distribution and wireless network environment, to improve energy efficiency by minimizing system energy consumption and ensure the average user preference deviation tolerance, we begin by formulating a long-term optimization problem that focuses on video caching, recommendation and user association (UA). The problem is then transformed into a Markov decision process (MDP), which is solved by designing a dueling deep Q-learning network (DDQN)-based algorithm. Using this algorithm, we can obtain the optimal video caching, recommendation and UA solutions. Since the action space of the MDP is huge, to cope with the “curse of dimensionality”, linear approximation is integrated into the designed algorithm. Finally, the proposed algorithm’s convergence and effectiveness in reducing long-term system energy consumption are demonstrated through extensive simulations.Keywords
Funding Information
- Research Project Supported by Shanxi Scholarship Council of China (2022-147)
- Research Project Supported by Fundamental Research Program of Shanxi Province (202203021212151, 202203021221117)
- Research Project Supported by the National Natural Science Foundation of China (92367104, 92267301)
This publication has 57 references indexed in Scilit:
- AI Models for Green Communications Towards 6GIEEE Communications Surveys & Tutorials, 2021
- Video Caching, Analytics, and Delivery at the Wireless Edge: A Survey and Future DirectionsIEEE Communications Surveys & Tutorials, 2020
- Deep Q-Learning-Based Content Caching With Update Strategy for Fog Radio Access NetworksIEEE Access, 2019
- On Mobile Edge CachingIEEE Communications Surveys & Tutorials, 2019
- Coded Caching with Joint Content Recommendation and User Grouping2018
- Resource Allocation for Ultra-Dense Networks: A Survey, Some Research Issues and ChallengesIEEE Communications Surveys & Tutorials, 2018
- A Survey of Machine Learning Techniques Applied to Software Defined Networking (SDN): Research Issues and ChallengesIEEE Communications Surveys & Tutorials, 2018
- Ultra-Dense Networks: A SurveyIEEE Communications Surveys & Tutorials, 2016
- A Tutorial and Review on Inter-Layer FEC Coded Layered Video StreamingIEEE Communications Surveys & Tutorials, 2015
- Q-learningMachine Learning, 1992