Dual-Attention Deep Reinforcement Learning for Multi-MAP 3D Trajectory Optimization in Dynamic 5G Networks
Authors:
- 28 May 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 6417-6422
Abstract
5G and beyond networks need to provide dynamic and efficient infrastructure management to better adapt to time-varying user behaviors (e.g., user mobility, interference, user traffic and evolution of the network topology). In this paper, we propose to manage the trajectory of Mobile Access Points (MAPs) under all these dynamic constraints with reduced complexity. We first formulate the placement problem to manage MAPs over time. Our solution addresses time-varying user traffic and user mobility through a Multi-Agent Deep Reinforcement Learning (MADRL). To achieve real-time behavior, the proposed solution learns to perform distributed assignment of MAP-user positions and schedules the MAP path among all users without centralized user's clustering feedback. Our solution exploits a dual-attention MADRL model via proximal policy optimization to dynamically move MAPs in 3D. The dual-attention takes into account information from both users and MAPs. The cooperation mechanism of our solution allows to manage different scenarios, without a priory information and without re-training, which significantly reduces complexity.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Three-Dimension Trajectory Design for Multi-UAV Wireless Network With Deep Reinforcement LearningIEEE Transactions on Vehicular Technology, 2020
- 3D UAV Trajectory Design and Frequency Band Allocation for Energy-Efficient and Fair Communication: A Deep Reinforcement Learning ApproachIEEE Transactions on Wireless Communications, 2020
- Multi-Agent Deep Reinforcement Learning for Trajectory Design and Power Allocation in Multi-UAV NetworksIEEE Access, 2020
- Optimal UAV Base Station Trajectories Using Flow-Level Models for Reinforcement LearningIEEE Transactions on Cognitive Communications and Networking, 2019
- Reinforcement Learning in Multiple-UAV Networks: Deployment and Movement DesignIEEE Transactions on Vehicular Technology, 2019
- Trajectory Optimization for Multiple UAVs Acting as Wireless Relays2018
- Efficient 3D aerial base station placement considering users mobility by reinforcement learning2018
- Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless NetworksIEEE Transactions on Wireless Communications, 2018
- Propagation Path Loss Models for 5G Urban Micro- and Macro-Cellular Scenarios2016
- Optimal LAP Altitude for Maximum CoverageIEEE Wireless Communications Letters, 2014