A Distributed Algorithm for Convex Constrained Optimization Under Noise
Authors:
- 9 December 2015
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 61 (9) , 2496-2511
Abstract
We present a novel distributed algorithm for convex constrained optimization problems that are subject to noise corruption and uncertainties. The proposed scheme can be classified as a distributed stochastic approximation method, where a unique feature here is that we allow for multiple noise terms to appear in both the computation and communication stages of the distributed iterative process. Specifically, we consider problems that involve multiple agents optimizing a separable convex objective function subject to convex local constraints and linear coupling constraints. This is a richer class of problems compared to those that can be handled by existing distributed stochastic approximation methods which consider only consensus constraints and fewer sources of noise. The proposed algorithm utilizes the augmented Lagrangian (AL) framework, which has been widely used recently to solve deterministic optimization problems in a distributed way. We show that the proposed method generates sequences of primal and dual variables that converge to their respective optimal sets almost surely.Keywords
Funding Information
- NSF CNS (1261828)
- ONR (N000141410479)
This publication has 43 references indexed in Scilit:
- On stochastic gradient and subgradient methods with adaptive steplength sequencesAutomatica, 2012
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- Simulation-based optimal sensor scheduling with application to observer trajectory planningAutomatica, 2007
- Adaptive stochastic approximation by the simultaneous perturbation methodIEEE Transactions on Automatic Control, 2000
- A diagonal quadratic approximation method for large scale linear programsOperations Research Letters, 1992
- Distributed asynchronous deterministic and stochastic gradient optimization algorithmsIEEE Transactions on Automatic Control, 1986
- Stochastic approximation method with gradient averaging for unconstrained problemsIEEE Transactions on Automatic Control, 1983
- A dual algorithm for the solution of nonlinear variational problems via finite element approximationComputers & Mathematics with Applications, 1976
- Stochastic Estimation of the Maximum of a Regression FunctionThe Annals of Mathematical Statistics, 1952
- A Stochastic Approximation MethodThe Annals of Mathematical Statistics, 1951