Toward Cooperatively Caching in Multi-UAV-Assisted Network: A Queue-Aware CDS-Based Reinforcement Learning Mechanism With Energy-Efficiency Maximization
- 16 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (9) , 16461-16477
Abstract
With its attractive controllable mobility and flexible deployment advantages, the Unmanned Aerial Vehicle (UAV) has emerged as a promising solution to support temporary caching services by pre-fetching popular content. However, it still exists an obvious challenge due to the limited storage and energy of UAVs with stochastic arrival requests, which is not well addressed by present works resulting in low Quality-of-Service (QoS) for users. In this paper, therefore, we propose a queue-aware cooperatively caching mechanism in the multi-UAV assisted system by considering the random user requests, in which a well-designed Connected Dominating Set (CDS) is developed to make collaborative caching schedule. In particular, we formulate the issue as a long-term queue stability constrained energy efficiency maximization problem by a well-tailored Lyapunov optimization framework. As a non-linear mixed-integer optimization with a nonconvex objective function and coupled variables, we solve it by designing a decentralized Cooperative Reinforcement Learning (CRL) algorithm with the developed CDS. The numerical results demonstrate that our proposed joint algorithm outperforms other benchmark algorithms in terms of caching latency, cache hit ratio, and energy efficiency.Keywords
Funding Information
- National Natural Science Foundation of China (62371158)
- Natural Science Foundation of Guangdong Province (2021A1515011953)
This publication has 38 references indexed in Scilit:
- Joint Slice Level and Base Station Level Admission Control in RAN Slicing2022
- Secure Throughput Optimization for Cache-Enabled Multi-UAVs NetworksIEEE Internet of Things Journal, 2021
- Collaborative Computation Offloading and Resource Allocation in Multi-UAV-Assisted IoT Networks: A Deep Reinforcement Learning ApproachIEEE Internet of Things Journal, 2021
- QoE Based Network Deployment and Caching Placement for Cache-Enabling UAV Networks2020
- Joint resource allocation and computation offloading in mobile edge computing for SDN based wireless networksJournal of Communications and Networks, 2019
- Joint Offloading and Trajectory Design for UAV-Enabled Mobile Edge Computing SystemsIEEE Internet of Things Journal, 2018
- Reinforcement Learning for Decentralized Trajectory Design in Cellular UAV Networks With Sense-and-Send ProtocolIEEE Internet of Things Journal, 2018
- A Survey of Caching Techniques in Cellular Networks: Research Issues and Challenges in Content Placement and Delivery StrategiesIEEE Communications Surveys & Tutorials, 2018
- A Survey of Caching Policies and Forwarding Mechanisms in Information-Centric NetworkingIEEE Communications Surveys & Tutorials, 2016
- Convex Optimization2004