Channel-Hopping Using Reinforcement Learning for Rendezvous in Asymmetric Cognitive Radio Networks
Open Access
- 5 December 2024
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 14 (23) , 11369
Abstract
This paper addresses the rendezvous problem in asymmetric cognitive radio networks (CRNs) by proposing a novel reinforcement learning (RL)-based channel-hopping algorithm. Traditional methods like the jump-stay (JS) algorithm, while effective, often struggle with high time-to-rendezvous (TTR) in asymmetric scenarios where secondary users (SUs) have varying channel availability. Our proposed RL-based algorithm leverages the actor-critic policy gradient method to learn optimal channel selection strategies by dynamically adapting to the environment and minimizing TTR. Extensive simulations demonstrate that the RL-based algorithm significantly reduces the expected TTR (ETTR) compared to the JS algorithm, particularly in asymmetric scenarios where M-sequence-based approaches are less effective. This suggests that RL-based approaches not only offer robustness in asymmetric environments but also provide a promising alternative in more predictable settings.Keywords
Funding Information
- Regional Innovation Strategy (RIS) (2021RIS-003)
- Hansung University (2021RIS-003)
This publication has 13 references indexed in Scilit:
- Identifier-Based Rendezvous Scheme for Asynchronous Cognitive Radio Wireless Networks2023
- Optical Orthogonal Code-Based Asynchronous Channel Hopping Sequence for Rendezvous in Cognitive Radio Networks2022
- PPoL: A Periodic Channel Hopping Sequence with Nearly Full Rendezvous Diversity2021
- On the Theoretical Gap of Channel Hopping Sequences With Maximum Rendezvous Diversity in the Multichannel Rendezvous ProblemIEEE/ACM Transactions on Networking, 2021
- A Reinforcement Learning Approach for the Multichannel Rendezvous Problem2019
- Prime Number Theory based Multi-Radio Rendezvous for Cognitive Radio Communication2019
- Channel Hopping Using ${p}$ -ary m-Sequence for Rendezvous in Cognitive Radio NetworksIEEE Wireless Communications Letters, 2019
- Multiple Radios for Fast Rendezvous in Heterogeneous Cognitive Radio NetworksIEEE Access, 2019
- A group-theoretic framework for rendezvous in heterogeneous cognitive radio networks2014
- Cognitive radio: making software radios more personalIEEE Wireless Communications, 1999