A Reinforcement-Learning-Based Beam Adaptation for Underwater Optical Wireless Communications
- 6 May 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (20) , 20270-20281
Abstract
Underwater optical wireless communications (UOWC) have recently appeared as an attractive solution for many applications such as remote controlling and sensing due to its advantages, such as high transmission rate, ultra-wide bandwidth, and low latency. However, due to the harsh underwater conditions, UOWC faces challenges such as water absorption, scattering, and pointing-acquisition-and-tracking (PAT) problems. This is mainly due to the dynamicity existing underwater. Consequently, this leads to packet loss and hence deteriorates the reliability and link quality of such networks. Such a problem can affect the degree of connectivity and end-to-end (E2E) performance of the communication system. The existing solutions in the literature are based on predefined models, assuming full knowledge of the environment. However, such models do not optimally treat the dynamicity existing underwater. This paper proposes novel beam adaptation methods based on reinforcement learning (RL) for point-to-point UOWC. The first method aims to optimize the light beamwidth; the second method focuses on adapting the beam orientation, whereas the last one optimizes both the light’s beamwidth and beam orientation. Our proposed RL-based solutions yield optimal positioning and beamwidth of the light source and improve the considered communication link’s success rate. They also guarantee better link quality in terms of Signal-to-Noise Ratio (SNR) compared to the uncertainty disk static method for four different underwater environments, including pure seawater, clean ocean, coastal ocean, and turbid harbor.Keywords
This publication has 25 references indexed in Scilit:
- Reinforcement Learning-Based Adaptive Transmission in Time-Varying Underwater Acoustic ChannelsIEEE Access, 2017
- Visible Light Communication Channel Modeling for Underwater Environments With Blocking and ShadowingIEEE Access, 2017
- Performance Analysis of Multi-Hop Underwater Wireless Optical Communication SystemsIEEE Photonics Technology Letters, 2017
- Underwater Optical Wireless CommunicationIEEE Access, 2016
- High frequency RF based non-contact underwater communication2012
- Re-evaluation of RF electromagnetic communication in underwater sensor networksIEEE Communications Magazine, 2010
- Underwater Acoustic Networks - Survey on Communication Challenges with Transmission Simulations2009
- Overview of networking protocols for underwater wireless communicationsIEEE Communications Magazine, 2009
- Underwater Acoustic Communications and Networking: Recent Advances and Future ChallengesMarine Technology Society Journal, 2008
- A survey of practical issues in underwater networksACM SIGMOBILE Mobile Computing and Communications Review, 2007