Joint Sensing and Communications for Deep Reinforcement Learning-based Beam Management in 6G
Authors:
- 4 December 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5019-5024
Abstract
User location is a piece of critical information for network management and control. However, location uncertainty is unavoidable in certain settings leading to localization errors. In this paper, we consider the user location uncertainty in the mmWave networks, and investigate joint vision-aided sensing and communications using deep reinforcement learning-based beam management for future 6G networks. In particular, we first extract pixel characteristic-based features from satellite images to improve localization accuracy. Then we propose a UK-medoids based method for user clustering with location uncertainty, and the clustering results are consequently used for the beam management. Finally, we apply the DRL algorithm for intra-beam radio resource allocation. The simulations first show that our proposed vision-aided method can substantially reduce the localization error. The proposed UK-medoids and DRL based scheme (UKM-DRL) is compared with two other schemes: K-means based clustering and DRL based resource allocation (K-DRL) and UK-means based clustering and DRL based resource allocation (UK-DRL). The proposed method has 17.2% higher throughput and 7.7% lower delay than UK-DRL, and more than doubled throughput and 55.8% lower delay than K-DRL.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Deep Learning-Based Landmark Detection for Mobile Robot Outdoor LocalizationMachines, 2019
- Unsupervised Machine Learning-Based User Clustering in Millimeter-Wave-NOMA SystemsIEEE Transactions on Wireless Communications, 2018
- The Application of Machine Learning in mmWave-NOMA Systems2018
- Pixel characteristics based feature extraction approach for roadside object detection2015
- Location-Aware Communications for 5G Networks: How location information can improve scalability, latency, and robustness of 5GIEEE Signal Processing Magazine, 2014
- Non-orthogonal Multiple Access in a Downlink Multiuser Beamforming System2013
- Depth camera based indoor mobile robot localization and navigation2012
- Localization using GPS and VISION aided INS with an image database and a network of a ground-based reference station in outdoor environmentsInternational Journal of Control, Automation, and Systems, 2011
- Clustering Uncertain Data Via K-Medoids2008
- Uncertain Data Mining: An Example in Clustering Location Data2006