Online distributed optimization via dual averaging
Authors:
- 1 December 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 01912216,p. 1484-1489
Abstract
This paper presents a regret analysis on a distributed online optimization problem computed over a network of agents. The goal is to distributively optimize a global objective function which can be decomposed into the summation of convex cost functions associated with each agent. Since the agents face uncertainties in the environment, their cost functions change at each time step. We extend a distributed algorithm based on dual subgradient averaging to the online setting. The proposed algorithm yields an upper bound on regret as a function of the underlying network topology, specifically its connectivity. The regret of an algorithm is the difference between the cost of the sequence of decisions generated by the algorithm and the performance of the best fixed decision in hindsight. A model for distributed sensor estimation is proposed and the corresponding simulation results are presented.Keywords
This publication has 15 references indexed in Scilit:
- Distributed delayed stochastic optimization2012
- Stability analysis of nonlinear networks via M-matrix theory: Beyond linear consensus2012
- Online Learning and Online Convex OptimizationFoundations and Trends in Machine Learning, 2012
- Dual Averaging for Distributed Optimization: Convergence Analysis and Network ScalingIEEE Transactions on Automatic Control, 2011
- Decentralized Online Convex Programming with local information2011
- Distributed Stochastic Subgradient Projection Algorithms for Convex OptimizationJournal of Optimization Theory and Applications, 2010
- Incremental Stochastic Subgradient Algorithms for Convex OptimizationSIAM Journal on Optimization, 2009
- Logarithmic regret algorithms for online convex optimizationMachine Learning, 2007
- Primal-dual subgradient methods for convex problemsMathematical Programming, 2007
- Complex networks: Structure and dynamicsPhysics Reports, 2006