UDARMF: An Underwater Distributed and Adaptive Resource Management Framework
- 15 July 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (10) , 7196-7210
Abstract
Providing qualified and sustainable communications is one of the key challenges for the Internet of Underwater Things (IoUT) facing constrained energy supplements, nonstationary environments, and severe communication interference. Owing to spatial separation, several nodes can (and are often required to) make transmissions simultaneously to maximize network capacity. However, existing transmission solutions often face the dilemma between maximizing local capacity and global concurrency. We break this dilemma via UDARMF, an underwater distributed and adaptive resource management framework, which maximizes network capacity by supporting an increased number of communications in the network. It is a distributed deep multiagent reinforcement learning framework that uses an observation encoder and a local utility network to coordinate the collaboration among underwater nodes by adaptively tuning its transmit parameters. We designed experiments to compare UDARMF with baselines in network capacity, concurrency, and energy efficiency. Extensive experiments were conducted to find the appropriate hyperparameters to achieve the optimal network performances. We also analyze the performance of UDARMF and baselines over diverse communication and lifetime requirements, communication environment, and energy storage. Simple closed-form approximations of UDARMF are given to reveal that an energy-constrained network’s capacity increases with available energy, following a linear trend on the logarithmic scale. Experimental results demonstrate that compared to other methods, UDARMF achieves a much better tradeoff between network capacity and concurrency, at which the lifetime requirements are satisfied. The proposed framework and the closed-form approximations are likely to become valuable tools in designing and analyzing IoUT.Keywords
Funding Information
- National Natural Science Foundation of China (61631008, 61971206, U1813217)
- Fundamental Research Funds for the Central Universities (2017TD-18)
- National Key Research and Development Program of China (2018YFC1405800)
This publication has 49 references indexed in Scilit:
- An overview of the internet of underwater thingsJournal of Network and Computer Applications, 2012
- QoS2010
- Practical Experiences and Design Considerations on Medium Access Control Protocols for Wireless Sensor Networks2010
- Overview of channel models for underwater wireless communication networksPhysical Communication, 2008
- On the relationship between capacity and distance in an underwater acoustic communication channelACM SIGMOBILE Mobile Computing and Communications Review, 2007
- Chaotic Behavior and Pollution Dispersion Characteristics in Engineered Tidal Embayments: A Numerical Investigation1Jawra Journal of the American Water Resources Association, 2007
- The challenges of building scalable mobile underwater wireless sensor networks for aquatic applicationsIEEE Network, 2006
- Underwater acoustic sensor networks: research challengesAd Hoc Networks, 2005
- SLOCUM: an underwater glider propelled by environmental energyIEEE Journal of Oceanic Engineering, 2001
- Reinforcement Learning: An IntroductionIEEE Transactions on Neural Networks, 1998