Imperfect CSI-Based Resource Management in Cognitive IoT Networks: A Deep Recurrent Reinforcement Learning Framework
- 27 April 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cognitive Communications and Networking
- Vol. 9 (5) , 1271-1281
Abstract
The proliferation of the Internet of Things (IoT) technology for wide range of wireless applications increase raw data, leads to spectrum scarcity, and also burdens available spectrum resources. Cognitive Radio (CR) is one of the key enablers to build future IoT systems, which has the ability to exploit dynamic networking characteristics to optimize network performance. One of the critical challenges is to obtain perfect Channel State Information (CSI) to efficiently allocate the transmission power and frequency resources among IoT nodes. In this paper, we focus on resource management optimization problem which is transformed into Markov Decision Process (MDP) and solved with proposed Deep Recurrent Reinforcement Learning (DRRL) based scheme with the consideration of energy-efficiency to deal with partial observability from limited information. Furthermore, to heighten the performance of proposed scheme, cooperative framework is introduced with Gated Recurrent Unit (GRU) layer to improve the resource allocation policy by accessing the historical information. Finally, extensive simulations corroborate the superiority of proposed scheme in terms of faster convergence and higher reward. The results also show that CSI imperfections is non-negligible, thus highlights the importance of robust and intelligent design that maintains users’ QoS.Keywords
Funding Information
- Department of Science and Technology, New Delhi, Government of India (SR/WOS-A/ET-52/2017)
This publication has 29 references indexed in Scilit:
- Narrowband Internet of Things Systems With Opportunistic D2D CommunicationIEEE Internet of Things Journal, 2017
- Energy Efficient Resource Allocation in Machine-to-Machine Communications With Multiple Access and Energy Harvesting for IoTIEEE Internet of Things Journal, 2017
- Multiband Spectrum Sensing and Resource Allocation for IoT in Cognitive 5G NetworksIEEE Internet of Things Journal, 2017
- A New Deep-Q-Learning-Based Transmission Scheduling Mechanism for the Cognitive Internet of ThingsIEEE Internet of Things Journal, 2017
- Gate-variants of Gated Recurrent Unit (GRU) neural networks2017
- Priority-based spectrum access in cognitive D2D networks for IoT2017
- Cognitive Internet of Things: A New Paradigm Beyond ConnectionIEEE Internet of Things Journal, 2014
- Imperfect CSI-Based Joint Resource Allocation in Multirelay OFDMA NetworksIEEE Transactions on Vehicular Technology, 2014
- Imperfect CSI Based Joint Bit Loading and Power Allocation for Deadline Constrained TransmissionIEEE Communications Letters, 2013
- Stochastic Power Adaptation with Multiagent Reinforcement Learning for Cognitive Wireless Mesh NetworksIEEE Transactions on Mobile Computing, 2012