Joint Link Scheduling and Power Allocation in Imperfect and Energy-Constrained Underwater Wireless Sensor Networks
- 22 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 23 (10) , 9863-9880
Abstract
Underwater wireless sensor networks (UWSNs) stand as promising technologies facilitating diverse underwater applications. However, the major design issues of the considered system are the severely limited energy supply and unexpected node malfunctions. This paper aims to provide fair, efficient, and reliable (FER) communication to the imperfect and energy-constrained UWSNs (IC-UWSNs). Therefore, we formulate a FER-communication optimization problem (FERCOP) and propose ICRL-JSA to solve the formulated problem. ICRL-JSA is a deep multi-agent reinforcement learning (MARL)-based optimizer for IC-UWSNs through joint link scheduling and power allocation, which automatically learns scheduling algorithms without human intervention. However, conventional RL methods are unable to address the challenges posed by underwater environments and IC-UWSNs. To construct ICRL-JSA, we integrate deep Q-network into IC-UWSNs and propose an advanced training mechanism to deal with complex acoustic channels, limited energy supplies, and unexpected node malfunctions. Simulation results demonstrate the superiority of the proposed ICRL-JSA scheme with an advanced training mechanism compared to various benchmark algorithms.Keywords
All Related Versions
Funding Information
- National Key Research and Development Program of China (2021YFC2803000)
- National Key Basic Research Program (2020YFB050001)
- National Natural Science Foundation of China (62101211, 61971206)
- National Natural Science Foundation of China (U22A2009)
This publication has 53 references indexed in Scilit:
- A survey on energy efficiency in underwater wireless communicationsJournal of Network and Computer Applications, 2022
- UDARMF: An Underwater Distributed and Adaptive Resource Management FrameworkIEEE Internet of Things Journal, 2021
- A load-adaptive fair access protocol for MAC in underwater acoustic sensor networksJournal of Network and Computer Applications, 2021
- Channel Modeling for Underwater Acoustic Network SimulationIEEE Access, 2020
- Routing Protocol Design for Underwater Optical Wireless Sensor Networks: A Multiagent Reinforcement Learning ApproachIEEE Internet of Things Journal, 2020
- Self-Adaptive Resource Allocation in Underwater Acoustic Interference Channel: A Reinforcement Learning ApproachIEEE Internet of Things Journal, 2019
- A Machine Learning-Based Algorithm for Joint Scheduling and Power Control in Wireless NetworksIEEE Internet of Things Journal, 2018
- Wireless Sensor Networks in oil and gas industry: Recent advances, taxonomy, requirements, and open challengesJournal of Network and Computer Applications, 2018
- Learning How to Communicate in the Internet of Things: Finite Resources and HeterogeneityIEEE Access, 2016
- Human-level control through deep reinforcement learningNature, 2015