Coded Caching Optimization in Dual Time-Scale Wireless Networks: An Advantage Actor–Critic Learning Approach
Open Access
- 9 November 2025
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 15 (22) , 11915
Abstract
The rapid growth of mobile data traffic poses significant challenges to ensuring high-quality service in wireless networks. Although the caching technique is capable of alleviating network congestion, most existing schemes depend on uncoded caching with prior knowledge of content popularity and ignore the time-scale mismatch between content dynamics and user mobility. To address these challenges, we first formulate a dynamic coded caching optimization framework under a dual time-scale model that simultaneously captures long-term content popularity evolution and short-term user mobility patterns. Then, we model the optimization problem as a Markov decision process and design a novel advantage actor–critic (A2C) based coded caching algorithm. By introducing the advantage function, the proposed approach can mitigate variance in policy updates and accelerate convergence under the caching capacity constraint. Finally, extensive simulations are conducted to demonstrate that our proposed algorithm significantly outperforms baseline caching schemes in terms of average delay cost.Keywords
Funding Information
- National Natural Science Foundation of China (62201350)
- Scientific Research Fund of Zhejiang Provincial Education Department (Y202454938)
- Natural Science Foundation of Zhejiang University of Science and Technology (2023QN115)
This publication has 32 references indexed in Scilit:
- Cooperative edge-caching based transmission with minimum effective delay in heterogeneous cellular networksComputer Communications, 2024
- A collaborative cache allocation strategy for performance and link cost in mobile edge computingThe Journal of Supercomputing, 2024
- Deep-Reinforcement-Learning-Based Joint Caching and Resources Allocation for Cooperative MECIEEE Internet of Things Journal, 2023
- Many-Objective Optimization-Based Content Popularity Prediction for Cache-Assisted Cloud–Edge–End Collaborative IoT NetworksIEEE Internet of Things Journal, 2023
- Energy-Aware Coded Caching Strategy Design With Resource Optimization for Satellite-UAV-Vehicle-Integrated NetworksIEEE Internet of Things Journal, 2021
- Learning Automata Based Q-Learning for Content Placement in Cooperative CachingIEEE Transactions on Communications, 2020
- High Definition Map for Automated Driving: Overview and AnalysisJournal of Navigation, 2019
- Throughput and Delay Analysis of Wireless Caching Helper Systems With Random AvailabilityIEEE Access, 2018
- Modeling, Analysis, and Optimization of Coded Caching in Small-Cell NetworksIEEE Transactions on Communications, 2017
- Mobility-aware caching for content-centric wireless networks: modeling and methodologyIEEE Communications Magazine, 2016