Securing Trust-Based Resilient Algorithms Against Smart Malicious Agents
- 11 July 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Control Systems Letters
- Vol. 9, 1922-1927
Abstract
In this work, we study the problem of legitimate in-neighborhood learning with multi-agent systems, where stochastic observations of trust between agents are available. Unlike previous works, we consider two types of malicious agents: naive and smart. Naive malicious agents always behave maliciously, while smart malicious agents can intermittently disguise themselves as legitimate agents. We identify a security vulnerability of the standard threshold design =1/2, which is commonly used in trust aggregation approaches. This design fails to account for the deceptive behavior of smart malicious agents, making the approach vulnerable to their attacks. To address this, we propose a threshold design that explicitly accounts for such agents. Specifically, we provide a sufficient condition for the existence of a constant threshold that enables legitimate agents to identify their legitimate in-neighbors over time, despite the presence of smart malicious agents. In addition, we show that the proposed threshold design ensures geometrically decaying misclassification probabilities. Finally, we present numerical examples to validate our theoretical results and demonstrate how the design enhances the security of existing trust-based resilient algorithms against smart malicious agents.Keywords
Funding Information
- National Natural Science Foundation of China (62203218)
- Natural Science Foundation of Jiangsu Province of China (BK20220884)
This publication has 13 references indexed in Scilit:
- Resilient Average Consensus With Adversaries via Distributed Detection and RecoveryIEEE Transactions on Automatic Control, 2024
- Trustworthy Distributed Average Consensus Based on Locally Assessed Trust EvaluationsIEEE Transactions on Automatic Control, 2024
- Resilient Containment Control of Multi-Agent Networks in Adversarial Environment2023
- Can Competition Outperform Collaboration? The Role of Misbehaving AgentsIEEE Transactions on Automatic Control, 2023
- Resilience to Malicious Activity in Distributed Optimization for Cyberphysical Systems2022
- An overview on multi-agent consensus under adversarial attacksAnnual Reviews in Control, 2022
- Trust is the Cure to Distributed Consensus with Adversaries2019
- Guaranteeing spoof-resilient multi-robot networksAutonomous Robots, 2017
- Resilient Asymptotic Consensus in Robust NetworksIEEE Journal on Selected Areas in Communications, 2013
- Concentration of Measure for the Analysis of Randomized Algorithms2009