Suboptimal Stabilizing Controllers for Linearly Solvable System
Preprint
Abstract
This paper presents a novel method to synthesize stochastic control Lyapunov functions for a class of nonlinear, stochastic control systems. In this work, the classical nonlinear Hamilton-Jacobi-Bellman partial differential equation is transformed into a linear partial differential equation for a class of systems with a particular constraint on the stochastic disturbance. It is shown that this linear partial differential equation can be relaxed to a linear differential inclusion, allowing for approximating polynomial solutions to be generated using sum of squares programming. It is shown that the resulting solutions are stochastic control Lyapunov functions with a number of compelling properties. In particular, a-priori bounds on trajectory suboptimality are shown for these approximate value functions. The result is a technique whereby approximate solutions may be computed with non-increasing error via a hierarchy of semidefinite optimization problems.Keywords
All Related Versions
- Version 1, 2015-09-26, ArXiv
- Published version: , 7157.
This publication has 9 references indexed in Scilit:
- Reinforcement Learning With Sequences of Motion Primitives for Robust ManipulationIEEE Transactions on Robotics, 2012
- Efficient computation of optimal actionsProceedings of the National Academy of Sciences of the United States of America, 2009
- Nonlinear Optimal Control via Occupation Measures and LMI-RelaxationsSIAM Journal on Control and Optimization, 2008
- Controlled Markov Processes and Viscosity Solutions2006
- Linear Theory for Control of Nonlinear Stochastic SystemsPhysical Review Letters, 2005
- Relative entropy and efficiency measure for diffusion-mediated transport processesJournal of Physics A: General Physics, 2005
- Global Optimization with Polynomials and the Problem of MomentsSIAM Journal on Optimization, 2001
- NONLINEAR OPTIMAL CONTROL: A CONTROL LYAPUNOV FUNCTION AND RECEDING HORIZON PERSPECTIVEAsian Journal of Control, 1999
- User’s guide to viscosity solutions of second order partial differential equationsBulletin of the American Mathematical Society, 1992