Decentralized Optimization Resilient Against Local Data Poisoning Attacks
- 8 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 70 (1) , 81-96
Abstract
We study the problem of decentralized optimization in the presence of adversarial attacks. In this problem, we consider a collection of nodes connected through a network, each equipped with a local function. These nodes are asked to collaboratively compute the global optimizer, i.e., the point that minimizes the aggregated local functions, using their local information and messages exchanged with their neighbors. Moreover, each node should agree on the said minimizer despite an adversary that can arbitrarily change the local functions of a fraction of the nodes. We present RAGD, the Resilient Averaging Gradient Descent algorithm, a decentralized, consensus+outlier filtering algorithm that is resilient to such attacks on local functions. We demonstrate that, as long as the portion of attacked nodes does not exceed a given threshold, RAGD guarantees that all nodes will be able to have a good estimate of the said minimizer. We verify the performance of the RAGD algorithm via numerical examples.Keywords
Funding Information
- Army Research Laboratory (W911NF-17-2-0196)
- NSF (2139304, 2146838, 2007714)
This publication has 32 references indexed in Scilit:
- Communication-Efficient and Byzantine-Robust Distributed Learning With Error FeedbackIEEE Journal on Selected Areas in Information Theory, 2021
- Byzantine-Resilient SGD in High Dimensions on Heterogeneous Data2021
- Data Poisoning Attacks Against Federated Learning Systems2020
- Tutorial on Dynamic Average Consensus: The Problem, Its Applications, and the AlgorithmsIEEE Control Systems, 2019
- Fast Decentralized Learning Via Hybrid Consensus Admm2018
- Robust Multi-agent Optimization: Coping with Byzantine Agents with Input Redundancy2016
- Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition2016
- Non-invasive Spoofing Attacks for Anti-lock Braking Systems2013
- Distributed average consensus with least-mean-square deviationJournal of Parallel and Distributed Computing, 2007
- The real Byzantine Generals2005