Underwater Searching and Multiround Data Collection via AUV Swarms: An Energy-Efficient AoI-Aware MAPPO Approach
Top Cited Papers
- 28 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 11 (7) , 12768-12782
Abstract
Autonomous underwater vehicles (AUVs) play a crucial role in data collection for underwater acoustic sensor networks (UWASNs). The limited capacity of individual AUV and the need for low-latency data collection necessitate the deployment of AUV swarms to achieve efficient and secure cooperative data collection. However, most existing works assume prior knowledge of sensor node locations, which is impractical in real-world AUV networks. Additionally, continuous data collection needs to be considered due to the sustained operation of sensors and cluster head replacement. To address these challenges, we propose a target uncertainty map assisted data collection scheme for AUV swarms based on the multi-agent proximal policy optimization (MAPPO) algorithm. Specifically, the target uncertainty map is established by leveraging current and past search and collection results, guiding the AUV swarm to prioritize areas with higher probabilities of containing sensor nodes. Moreover, a digital pheromone mechanism incorporating repulsive and attractive pheromones is designed to establish an artificial potential field for adjusting the target uncertainty map. To further enable a comprehensive exploration of unknown environments, we introduce the age of information (AoI) as an indicator. Additionally, we consider the energy consumption associated with data collection to strike a balance between collection and energy efficiency, and derive a lower bound on the policy improvement achieved by the MAPPO algorithm. Simulation results have validated that the proposed scheme has a superior performance compared to the baselines, achieving an approximately 15% increase in the collection rate while reducing the energy consumption of data collection and AoI as well.Keywords
Funding Information
- National Natural Science Foundation China (U23A20281, 61971257, 62325108)
- Young Elite Scientist Sponsorship Program by CAST (2020QNRC001)
- Technology Innovation Institute LLC
- NSF (CNS-2107216, CNS-2128368, CMMI-2222810, ECCS-2302469)
- U.S. Department of Transportation, Toyota and Amazon
This publication has 40 references indexed in Scilit:
- Multi-Agent Reinforcement Learning based Secure Searching and Data Collection in AUV Swarms2023
- Reliable Data Collection Techniques in Underwater Wireless Sensor Networks: A SurveyIEEE Communications Surveys & Tutorials, 2021
- Localization Algorithm for Underwater Sensor Network: A ReviewIEEE Internet of Things Journal, 2021
- Internet of Underwater Things and Big Marine Data Analytics—A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2021
- AoI-Inspired Collaborative Information Collection for AUV-Assisted Internet of Underwater ThingsIEEE Internet of Things Journal, 2021
- Value-Based Hierarchical Information Collection for AUV-Enabled Internet of Underwater ThingsIEEE Internet of Things Journal, 2020
- An AUV-Assisted Data Gathering Scheme Based on Clustering and Matrix Completion for Smart OceanIEEE Internet of Things Journal, 2020
- FFRP: Dynamic Firefly Mating Optimization Inspired Energy Efficient Routing Protocol for Internet of Underwater Wireless Sensor NetworksIEEE Access, 2020
- Localization and Detection of Targets in Underwater Wireless Sensor Using Distance and Angle Based AlgorithmsIEEE Access, 2019
- LRP: Link quality‐aware queue‐based spectral clustering routing protocol for underwater acoustic sensor networksInternational Journal of Communication Systems, 2016