Domain Decomposition for Stochastic Optimal Control
Authors:
- Matanya B. HorowitzMHMatanya B. Horowitz
- Ivan PapushaIPIvan Papusha
- Joel W. BurdickJBJoel W. Burdick
Preprint
Abstract
This work proposes a method for solving linear stochastic optimal control (SOC) problems using sum of squares and semidefinite programming. Previous work had used polynomial optimization to approximate the value function, requiring a high polynomial degree to capture local phenomena. To improve the scalability of the method to problems of interest, a domain decomposition scheme is presented. By using local approximations, lower degree polynomials become sufficient, and both local and global properties of the value function are captured. The domain of the problem is split into a non-overlapping partition, with added constraints ensuring $C^1$ continuity. The Alternating Direction Method of Multipliers (ADMM) is used to optimize over each domain in parallel and ensure convergence on the boundaries of the partitions. This results in improved conditioning of the problem and allows for much larger and more complex problems to be addressed with improved performance.
Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- GloptiPoly 3: moments, optimization and semidefinite programmingOptimization Methods and Software, 2009
- Efficient computation of optimal actionsProceedings of the National Academy of Sciences of the United States of America, 2009
- Pre- and Post-Processing Sum-of-Squares Programs in PracticeIEEE Transactions on Automatic Control, 2009
- Controlled Markov Processes and Viscosity Solutions2006
- Linear Theory for Control of Nonlinear Stochastic SystemsPhysical Review Letters, 2005
- Path integrals and symmetry breaking for optimal control theoryJournal of Statistical Mechanics: Theory and Experiment, 2005
- Analysis of switched and hybrid systems - beyond piecewise quadratic methods2004
- Computation of piecewise quadratic Lyapunov functions for hybrid systemsIEEE Transactions on Automatic Control, 1998
- Multiplier methods: A surveyAutomatica, 1976
- A nullstellensatz and a positivstellensatz in semialgebraic geometryMathematische Annalen, 1974