Abstract
The rapid development of wireless traffic pushed the wireless community to research different solutions towards the efficient utilization of the available radio spectrum. However, a recent study shows that most of the dynamically allocated spectrum bands, experience significant under-utilization as Cognitive Radio (CR) technology still lacks intelligence. An intelligence in CRs can be incorporated with machine learning algorithms. Further, the perfect Channel State Information (CSI) is hardly obtained and CSI imperfections play a crucial role in Spectrum Management. Thus, for efficient utilization of available spectrum, a decentralized Multi-Agent Reinforcement Learning based resource allocation scheme has been proposed. A robust scheme is proposed which integrates machine learning and CR technology into a sophisticated Multi-Agent System (MAS). Moreover, assisted with cloud computing provides huge amount of storage space, reduces operating expenditures, and provides wider flexibility of cooperation. Hence, to foster the performance of the proposed scheme, a cooperative framework in MAS is introduced which enhances the performance of the proposed scheme in terms of network capacity, outage probability, and convergence speed. Numerical results verify the effectiveness of proposed scheme and show the non-negligible impact of imperfect CSI, thus highlighting the importance of robust designs that maintains users' QoS in practical wireless networks.
Funding Information
  • Department of Science and Technology, New Delhi, Government of India (SR/WOS-A/ET-52/2017)
  • Anusandhan National Research Foundation (EEQ/2017/000592)

This publication has 22 references indexed in Scilit: