Enabling Adaptive Optimization of Energy Efficiency and Quality of Service in NR-V2X Communications via Multiagent Deep Reinforcement Learning
- 23 October 2024
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 12 (4) , 4022-4037
Abstract
The Third Generation Partnership Project has standardized new-radio vehicle-to-everything (NR-V2X) to facilitate advanced use cases for safety-critical message conveyance. However, there is a paucity of resource allocation research for high-performance NR-V2X communications. In this article, we investigate an adaptive optimization issue of energy efficiency (EE) and Quality of Service (QoS) in NR-V2X networks inspired by the Tchebycheff function. To address this issue, we first formulate the resource allocation task as a time-variant mixed-integer nonlinear programming (MINLP) problem. Then, we propose a fully decentralized multiagent deep reinforcement learning (MADRL)-based algorithm characterized by a multitask-actor shared-critic (MTA-SC) architecture and a localized training and distributed execution (LTDE) framework to promote efficient learning and minimize information exchange. Finally, we implement the proposed algorithm in a three-lane highway NR-V2X scenario. Numerical results demonstrate that the proposed algorithm comprehensively outperforms benchmarks in terms of convergence performance, scalability, and robustness.Keywords
Funding Information
- National Natural Science Foundation of China (No. 62371057)
This publication has 46 references indexed in Scilit:
- Resource Allocation for Vehicle Platooning in 5G NR-V2X via Deep Reinforcement Learning2021
- Multi-agent deep reinforcement learning: a surveyArtificial Intelligence Review, 2021
- A review of applications in federated learningComputers & Industrial Engineering, 2020
- An improved MOEA/D algorithm for bi-objective optimization problems with complex Pareto fronts and its application to structural optimizationExpert Systems with Applications, 2018
- Simultaneous Wireless Information and Power Transfer (SWIPT): Recent Advances and Future ChallengesIEEE Communications Surveys & Tutorials, 2017
- Mastering the game of Go without human knowledgeNature, 2017
- Advances in Energy Harvesting Communications: Past, Present, and Future ChallengesIEEE Communications Surveys & Tutorials, 2015
- Human-level control through deep reinforcement learningNature, 2015
- An extended cutting plane method for solving convex MINLP problemsComputers & Chemical Engineering, 1995
- An LP/NLP based branch and bound algorithm for convex MINLP optimization problemsComputers & Chemical Engineering, 1992