On linear convergence of a distributed dual gradient algorithm for linearly constrained separable convex problems
Authors:
Preprint
Abstract
In this paper we propose a distributed dual gradient algorithm for minimizing linearly constrained separable convex problems and analyze its rate of convergence. In particular, we prove that under the assumption of strong convexity and Lipshitz continuity of the gradient of the primal objective function we have a global error bound type property for the dual problem. Using this error bound property we devise a new fully distributed dual gradient scheme, i.e. a gradient scheme based on a weighted step size, for which we derive global linear rate of convergence for both dual and primal suboptimality and for primal feasibility violation. Many real applications, e.g. distributed model predictive control, network utility maximization or optimal power flow, can be posed as linearly constrained separable convex problems for which dual gradient type methods from literature have sublinear convergence rate. In the present paper we prove for the first time that in fact we can achieve linear convergence rate for such algorithms when they are used for solving these applications. Numerical simulations are also provided to confirm our theory.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- On the linear convergence of the alternating direction method of multipliersMathematical Programming, 2016
- A class of distributed optimization methods with event-triggered communicationComputational Optimization and Applications, 2013
- Accelerated gradient methods and dual decomposition in distributed model predictive controlAutomatica, 2013
- Distributed predictive control: A non-cooperative algorithm with neighbor-to-neighbor communication for linear systemsAutomatica, 2012
- Parallel and distributed optimization methods for estimation and control in networksJournal of Process Control, 2011
- Cooperative distributed model predictive controlSystems & Control Letters, 2010
- Interior-Point Lagrangian Decomposition Method for Separable Convex OptimizationJournal of Optimization Theory and Applications, 2009
- Error bounds and convergence analysis of feasible descent methods: a general approachAnnals of Operations Research, 1993
- A class of convergent primal-dual subgradient algorithms for decomposable convex programsMathematical Programming, 1986
- Bounds for error in the solution set of a perturbed linear programLinear Algebra and its Applications, 1973