A Q-Learning Approach for Real-Time NOMA Scheduling of Medical Data in UAV-Aided WBANs
Open Access
- 1 November 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 115074-115091
Abstract
Unmanned Aerial Vehicles (UAVs) have emerged as a flexible and cost-effective solution for remote monitoring of the vital signs of patients in large-scale Internet of Medical Things (IoMT) Wireless Body Area Networks (WBANs). This paper deals with the problem of using UAVs for real-time scheduling of the transmission of vital signs in delay-sensitive IoMT WBANs. The main challenge for such a network is to timely and reliably transmit the vital signs of patients to the remote monitoring center without interrupting their daily lifestyles. To achieve this goal, we propose a Q -learning-based algorithm to optimize the trajectory of each UAV, as the mobile Base Station (BS), to harvest vital signs of patients in outdoor applications, especially in unreachable areas. In this algorithm, UAVs learn to reach the best 3D position by discovering the network environment step-by-step. It stands for the position in which the covered patients by each UAV have the highest transmission rate, the least delay and energy consumption. Moreover, we employ the Non-Orthogonal Multiple Access (NOMA) technique to simultaneously schedule multiple transmissions by accepting a degree of interference between them in order to enhance the spectrum efficiency of the network. Eventually, the performance of our proposed scheme is evaluated via extensive simulations in terms of throughput, energy consumption, and delay. The simulation results show that our proposed scheme iteratively converges to the benchmark value of the mentioned factors by increasing the information of cluster environment through episodes.Keywords
Funding Information
- NSERC through Discovery Grant
This publication has 25 references indexed in Scilit:
- UAV-enabled healthcare architecture: Issues and challengesFuture Generation Computer Systems, 2019
- Unmanned Aerial Vehicle-to-Wearables (UAV2W) Indoor Radio Propagation Channel Measurements and ModelingIEEE Access, 2019
- 3D Trajectory Optimization in Rician Fading for UAV-Enabled Data HarvestingIEEE Transactions on Wireless Communications, 2019
- Learning to Communicate in UAV-Aided Wireless Networks: Map-Based ApproachesIEEE Internet of Things Journal, 2018
- Interoperability Enhancement in Health Care at Remote Locations using Thread Protocol in UAVs2018
- UAV Trajectory Optimization for Data Offloading at the Edge of Multiple CellsIEEE Transactions on Vehicular Technology, 2018
- Optimal LAP Altitude for Maximum CoverageIEEE Wireless Communications Letters, 2014
- IEEE Standard for Local and metropolitan area networks - Part 15.6: Wireless Body Area Networks2012
- Cyclic orthogonal codes in CDMA-based asynchronous Wireless Body Area Networks2012
- The global k-means clustering algorithmPattern Recognition, 2003