Deep Reinforcement Learning Based Adaptive Modulation With Outdated CSI
- 19 July 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Letters
- Vol. 25 (10) , 3291-3295
Abstract
The problem of adaptive modulation with outdated channel state information (CSI) is considered. Best existing approach to tackle this problem relies on using a (non-)linear auto-regressive moving average (ARMA) model to predict current CSI from outdated values. This approach is valid only if the wireless channel variations over time behave in a linear or smooth enough nonlinear fashion, which is not necessarily the case. We propose a deep reinforcement learning based adaptive modulation (DRL-AM) approach that can handle this limitation. While DRL-AM is more complex than (non-)linear AR(MA), it performs significantly better as corroborated via numerical results on real channel measurements. Furthermore, compared to capacity-achieving codes, complexity is moved from receiver to transmitter making this approach suitable for receiving nodes with limited resources such as internet of things (IoT) devices.Keywords
This publication has 9 references indexed in Scilit:
- DQN-Based Adaptive Modulation Scheme Over Wireless Communication ChannelsIEEE Communications Letters, 2020
- Deep Reinforcement Learning-Based Modulation and Coding Scheme Selection in Cognitive Heterogeneous NetworksIEEE Transactions on Wireless Communications, 2019
- Hyperparameter Optimization for Deep Reinforcement Learning in Vehicle Energy Management2019
- Nonlinear Mobile Link Adaptation Using Modified FLNN and Channel Sounder ArrangementIEEE Access, 2017
- Robust Adaptive Modulation and Coding (AMC) Selection in LTE Systems Using Reinforcement Learning2014
- A flexible framework based on reinforcement learning for adaptive modulation and coding in OFDM wireless systems2012
- A Comprehensive Overview and Characterization of Wireless Channels for Networked Robotic and Control SystemsJournal of Robotics, 2011
- Adaptive coding for time-varying channels using outdated fading estimatesIEEE Transactions on Communications, 1999
- Variable-rate variable-power MQAM for fading channelsIEEE Transactions on Communications, 1997