A Time-Efficient and Attention-Aware Deployment Strategy for UAV Networks Driven by Deep Reinforcement Learning
Authors:
- 1 September 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 01-05
Abstract
Collaborative unmanned aerial vehicle (UAV) networking has the characteristics of flexibility, efficiency, ubiquity, etc., which can enhance wireless network coverage and improve the quality of service to ground users. However, collaborative UAV networking has main challenges such as location deployment and energy optimization. For collaborative networking scenarios, it is necessary to focus on solving key issues such as algorithm convergence and time complexity. In response to the above problems, we propose to leverage hybrid deep reinforcement learning (DRL) with spatial attention mechanism to reduce time complexity according to actual application requirements of location deployment. Firstly, the convolutional neural network is used to improve the ability of discriminating state features. Then, an improved spatial attention mechanism is introduced to apply different weights to state features of different spatial locations, and focuses on the state features that are favorable for UAV deployment in spatial locations. Finally, the offline training state attention model is added to the state input of hybrid deep reinforcement learning for adaptive deployment training. The simulation results show that the training time of the algorithm can be greatly reduced while both mean opinion score (MOS) and energy consumption performance are reduced by about 10%.Keywords
This publication has 11 references indexed in Scilit:
- On-demand deployment of multiple aerial base stations for traffic offloading and network recoveryComputer Networks, 2019
- Machine Learning for Wireless Connectivity and Security of Cellular-Connected UAVsIEEE Wireless Communications, 2019
- Securing UAV Communications via Joint Trajectory and Power ControlIEEE Transactions on Wireless Communications, 2019
- UAV Communications for 5G and Beyond: Recent Advances and Future TrendsIEEE Internet of Things Journal, 2018
- UAV-Aided Projection-Based Compressive Data Gathering in Wireless Sensor NetworksIEEE Internet of Things Journal, 2018
- Planning While Flying: A Measurement-Aided Dynamic Planning of Drone Small CellsIEEE Internet of Things Journal, 2018
- Air-Ground Integrated Mobile Edge Networks: Architecture, Challenges, and OpportunitiesIEEE Communications Magazine, 2018
- Unmanned aerial and ground vehicle (UAV-UGV) system prototype for civil infrastructure missions2018
- Multi-UAV-Aided Networks: Aerial-Ground Cooperative Vehicular Networking ArchitectureIEEE Vehicular Technology Magazine, 2015
- Novel Cross-Layer QoE-Aware Radio Resource Allocation Algorithms in Multiuser OFDMA SystemsIEEE Transactions on Communications, 2014