FlyBeam: Echo State Learning for Joint Flight and Beamforming Control in Wireless UAV Networks
- 1 June 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-6
Abstract
This paper aims at designing high-data-rate swarm UAV networks with distributed beamforming capabilities. The primary challenge is that the beamforming gain in swarm UAV networks is highly affected by the UAVs’ flight altitude, their movements and the resulting intermittent link blockages, as well as the availability of channel state information (CSI) at individual UAVs. To address this challenge, we propose FlyBeam, a learning- based framework for joint flight and beamforming control in swarm UAV networks. We first present a mathematical formulation of the control problem with the objective of maximizing the throughput of swarm UAV networks by jointly controlling the flight and distributed beamforming of UAVs. Then, a distributed solution algorithm is designed based on a combination of Echo State Network learning and online reinforcement learning. The former is adopted to approximate the utility function for individual UAVs based on online measurements, by jointly considering the unknown blockage dynamics and other factors that affect the beamforming gain. The latter is used to guide the exploitation and exploration in FlyBeam. The effectiveness of FlyBeam is evaluated through an extensive simulation campaign. Results indicate that significant (up to 450%) beamforming gain can be achieved by FlyBeam. We also investigate the effects of blockages and UAV flight altitude on the beamforming gain. It is found that, which is somewhat surprising, higher (rather than lower) beamforming gain can be achieved by FlyBeam with denser blockages in swarm UAV networks.Keywords
This publication has 23 references indexed in Scilit:
- Common Throughput Maximization in UAV-Enabled OFDMA Systems With Delay ConsiderationIEEE Transactions on Communications, 2018
- Joint Trajectory and Communication Design for Multi-UAV Enabled Wireless NetworksIEEE Transactions on Wireless Communications, 2018
- An investigation of geolocation-aware beamforming algorithms for swarming UAVs2017
- Toward the Performance Enhancement of Microwave Cellular Networks Through THz LinksIEEE Transactions on Vehicular Technology, 2016
- Research on least square channel estimation algorithm based on phase compensation2016
- Massive MIMO: survey and future research topicsIET Communications, 2016
- A Cooperative Network Framework for Multi-UAV Guided Ground Ad Hoc NetworksJournal of Intelligent & Robotic Systems, 2014
- Performance analysis and comparison of ZF and MRT based downlink massive MIMO systems2014
- Analysis of Blockage Effects on Urban Cellular NetworksIEEE Transactions on Wireless Communications, 2014
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998