Towards Energy-Efficiency: Integrating DRL and ze-RIS for Task Offloading in UAV-MEC Environments
Open Access
- 7 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 1
Abstract
Unmanned aerial vehicles (UAVs) play an important role within mobile edge computing (MEC) networks in improving communications for ground users during emergency situations. However, sustaining high-quality service for extended periods is challenging because of constraints on battery capacity and computing capabilities of UAVs. To address this issue, we leverage zero-energy reconfigurable intelligent surfaces (ze-RIS) within UAV-MEC networks and introduce a comprehensive strategy that combines task offloading and resource sharing. A deep reinforcement learning (DRL) driven energy efficient task offloading (DEETO) scheme is presented. The primary objective is to minimize UAV energy ingestion. DEETO aims to enhance task offloading decision mechanism, computing and communication resource allocation, while adopting hybrid task offloading mechanism with intelligent RIS phase-shift control. We begin by modeling it as a DRL problem, structuring it as a Markov decision process (MDP), and subsequently resolving it effectively through the use of the advantage actor-critic (A2C) algorithm. Our simulation results highlight the superiority of the DEETO scheme compared to alternative approaches. DEETO excelled by achieving a notable energy savings of 16.98% from the allocated energy resources, coupled with the highest task turnover rate of 94.12%, all achieved within a shorter learning time frames per second (TFPS) and yielding higher rewards.Keywords
Funding Information
- 433 Ministry of Education, Saudi Arabia (IFKSUOR3-459)
This publication has 35 references indexed in Scilit:
- DRL-driven zero-RIS assisted energy-efficient task offloading in vehicular edge computing networksJournal of King Saud University Computer and Information Sciences, 2023
- Toward Autonomous Multi-UAV Wireless Network: A Survey of Reinforcement Learning-Based ApproachesIEEE Communications Surveys & Tutorials, 2023
- Zero-Energy Devices Empowered 6G Networks: Opportunities, Key Technologies, and ChallengesIEEE Internet of Things Magazine, 2023
- Joint Task Offloading and Resource Allocation for RIS-assisted UAV for Mobile Edge Computing Networks2023
- The State of AI-Empowered Backscatter Communications: A Comprehensive SurveyIEEE Internet of Things Journal, 2023
- A Survey on STAR-RIS: Use Cases, Recent Advances, and Future Research ChallengesIEEE Internet of Things Journal, 2023
- Joint Waveform Design and Detection in Symbiotic Ambient Backscatter NOMA SystemsIEEE Internet of Things Journal, 2023
- Task offloading paradigm in mobile edge computing-current issues, adopted approaches, and future directionsJournal of Network and Computer Applications, 2022
- Joint Multi-UAV Path Planning and LoS Communication for Mobile-Edge Computing in IoT Networks With RISsIEEE Internet of Things Journal, 2022
- Computation Capacity Enhancement by Joint UAV and RIS Design in IoTIEEE Internet of Things Journal, 2022