Decentralized linearized alternating direction method of multipliers
- 1 May 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15206149,p. 5447-5451
Abstract
This paper develops a decentralized linearized alternating direction method of multipliers (LADMM) that minimizes the sum of local cost functions in a multi-agent network. Through linearizing the local cost functions agents can obtain their local solutions with simple algebraic operations and gradient descent steps. We prove that the algorithm linearly converges to the optimal solution given that the local cost functions are strongly convex and have Lipschitz gradients. The decentralized LADMM has similar computations as the distributed (sub)gradient method but outperforms the latter, which is unable to achieve linear rate of convergence and convergence to the exact optimal solution simultaneously. Compared to its non-linearized counterpart that suffers from high computation burden, the decentralized LADMM has a comparable rate of convergence according to both theoretical analysis and numerical experiments.Keywords
This publication has 11 references indexed in Scilit:
- On the Linear Convergence of the ADMM in Decentralized Consensus OptimizationIEEE Transactions on Signal Processing, 2014
- Fast Distributed Gradient MethodsIEEE Transactions on Automatic Control, 2014
- Monitoring and Optimization for Power Grids: A Signal Processing PerspectiveIEEE Signal Processing Magazine, 2013
- Dual Averaging for Distributed Optimization: Convergence Analysis and Network ScalingIEEE Transactions on Automatic Control, 2011
- Inexact Alternating Direction Methods for Image RecoverySIAM Journal on Scientific Computing, 2011
- Distributed Sparse Linear RegressionIEEE Transactions on Signal Processing, 2010
- Distributed Compressive Spectrum Sensing in Cooperative Multihop Cognitive NetworksIEEE Journal of Selected Topics in Signal Processing, 2010
- Distributed Subgradient Methods for Multi-Agent OptimizationIEEE Transactions on Automatic Control, 2009
- Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic SignalsIEEE Transactions on Signal Processing, 2007
- Fastest Mixing Markov Chain on a GraphSIAM Review, 2004