Relay Selection in Underwater Acoustic Cooperative Networks: A Contextual Bandit Approach
- 4 November 2016
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Communications Letters
- Vol. 21 (2) , 382-385
Abstract
Cooperative relay transmission is an attractive architecture for underwater acoustic networks. However, designing relay selection policies in the harsh underwater environment is difficult. In this letter, we model relay selection as a contextual bandit problem—an important extension of multi-armed bandit. Through this way, we can achieve relay selection based on a bit of contextual communication environment information about relay nodes instead of instantaneous or statistical channel state information. Our proposed relay selection technique enables highly stable performance of the cooperative system in a complex and changeable underwater environment, and the process of relay selection can be simplified and easily facilitate efficient cooperative transmission. Simulation results illustrate the effectiveness and the robustness of this relay selection technique.Keywords
Funding Information
- National Nature Science Foundation of China (61571387, 61503320)
- Graduate Student Innovation Project of Hebei Province (2016SJBS019)
This publication has 7 references indexed in Scilit:
- Exploiting Cooperative Relay for Reliable Communications in Underwater Acoustic Sensor Networks2014
- Effective Relay Selection for Underwater Cooperative Acoustic Networks2013
- Learning State Selection for Reconfigurable Antennas: A Multi-Armed Bandit ApproachIEEE Transactions on Antennas and Propagation, 2013
- Cooperative underwater acoustic communications [Accepted From Open Call]IEEE Communications Magazine, 2013
- A contextual-bandit approach to personalized news article recommendation2010
- Learning diverse rankings with multi-armed bandits2008
- Fundamentals of Ocean Acoustics1982