A Federated Deep Reinforcement Learning-Based Trust Model in Underwater Acoustic Sensor Networks
- 4 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 23 (5) , 5150-5161
Abstract
Underwater acoustic sensor networks (UASNs) have been widely deployed in many areas, such as marine ranching, naval applications, and marine disaster warning systems. The security of UASNs, particularly insider threats, is of growing concern. Internal attacks carried out via compromised normal nodes are more damaging and stealthy than external attacks, such as signal stealing, data decryption, and identity forgery. As a security mechanism for internal threat detection based on interaction data, trust models have proven to enhance the security of UASNs. However, traditional trust models lack sufficient scalability when faced with movable underwater devices, heterogeneous network environments, and variable attack patterns. Therefore, in this paper, a novel trust model based on federated deep reinforcement learning is proposed for UASNs. First, the evidence acquisition mechanism, including communication, energy, and data evidence, is improved based on existing ones to better accommodate the topological dynamics of UASNs. Second, acquired trust evidence is fed into the corresponding deep reinforcement learning-based local trust model to accomplish trust prediction and model training. Finally, a federated learning-based update method periodically aggregates and updates the parameters of the local models. The experimental results prove that the proposed scheme exhibits satisfactory performance in terms of improving trust prediction accuracy and energy efficiency.Keywords
Funding Information
- National Natural Science Foundation of China (U22A2011, 62072072, 62102132)
- Open fund of State Key Laboratory of Acoustics (SKLA202302)
- Chinese Government Scholarship (202106710055, 202006250167)
- China Scholarship Council
This publication has 37 references indexed in Scilit:
- A Survey on Trust Models in Heterogeneous NetworksIEEE Communications Surveys & Tutorials, 2022
- Heterogeneous Trust-based Social Recommendation via Reliable and Informative Motif-based Attention2022
- Federated against the cold: A trust-based federated learning approach to counter the cold start problem in recommendation systemsInformation Sciences, 2022
- Blockchain-Enabled Trust Management Model for the Internet of VehiclesIEEE Internet of Things Journal, 2021
- A Provenance-Aware Distributed Trust Model for Resilient Unmanned Aerial Vehicle NetworksIEEE Internet of Things Journal, 2020
- Federated Deep Reinforcement Learning for Internet of Things With Decentralized Cooperative Edge CachingIEEE Internet of Things Journal, 2020
- Federated Learning in Mobile Edge Networks: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2020
- Mining Heterogeneous Influence and Indirect Trust for RecommendationIEEE Access, 2020
- BLTM: Beta and LQI Based Trust Model for Wireless Sensor NetworksIEEE Access, 2019
- Underwater acoustic networksIEEE Journal of Oceanic Engineering, 2000