Price decomposition in large-scale stochastic optimal control
Preprint
Abstract
We are interested in optimally driving a dynamical system that can be influenced by exogenous noises. This is generally called a Stochastic Optimal Control (SOC) problem and the Dynamic Programming (DP) principle is the natural way of solving it. Unfortunately, DP faces the so-called curse of dimensionality: the complexity of solving DP equations grows exponentially with the dimension of the information variable that is sufficient to take optimal decisions (the state variable). For a large class of SOC problems, which includes important practical problems, we propose an original way of obtaining strategies to drive the system. The algorithm we introduce is based on Lagrangian relaxation, of which the application to decomposition is well-known in the deterministic framework. However, its application to such closed-loop problems is not straightforward and an additional statistical approximation concerning the dual process is needed. We give a convergence proof, that derives directly from classical results concerning duality in optimization, and enlghten the error made by our approximation. Numerical results are also provided, on a large-scale SOC problem. This idea extends the original DADP algorithm that was presented by Barty, Carpentier and Girardeau (2010).Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- Monte-Carlo Valuation of American Options: Facts and New Algorithms to Improve Existing Methods2012
- Decomposition of large-scale stochastic optimal control problemsRAIRO - Operations Research, 2010
- A stochastic gradient type algorithm for closed-loop problemsMathematical Programming, 2007
- On complexity of multistage stochastic programsOperations Research Letters, 2006
- Bundle Methods in Stochastic Optimal Power Management: A Disaggregated Approach Using PreconditionersComputational Optimization and Applications, 2001
- Valuing American Options by Simulation: A Simple Least-Squares ApproachThe Review of Financial Studies, 2001
- Stochastic optimization of unit commitment: a new decomposition frameworkIEEE Transactions on Power Systems, 1996
- Auxiliary problem principle and decomposition of optimization problemsJournal of Optimization Theory and Applications, 1980
- Information exchange between independent stochastic systemsJournal of Optimization Theory and Applications, 1980
- Optimal operation of multireservoir power systems with stochastic inflowsWater Resources Research, 1980