General Decentralized Stochastic Optimal Control via Change of Measure: Applications to the Witsenhausen Counterexample
Authors:
- Bhagyashri TelsangBTBhagyashri Telsang
- Seddik DjouadiSDSeddik Djouadi
- Charalambos D. CharalambousCharalambos D. Charalambous
Preprint
Abstract
In this paper we present global and person-by-person (PbP) optimality conditions for general decentralized stochastic dynamic optimal control problems, using a discrete-time version of Girsanov's change of measure. The PbP optimality conditions are applied to the Witsenhausen counterexample to show that the two strategies satisfy two coupled nonlinear integral equations. Further, we prove a fixed point theorem in a function space, establishing existence and uniqueness of solutions to the integral equations. We also provide numerical solutions of the two integral equations using the Gauss Hermite Quadrature scheme, and include a detail comparison to other numerical methods of the literature. The numerical solutions confirm Witsehausen's observation that, for certain choices of parameters, linear or affine strategies are optimal, while for other choices of parameters nonlinear strategies outperformed affine strategies.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Optimization formulation and monotonic solution method for the Witsenhausen problemAutomatica, 2015
- Information Structures, the Witsenhausen Counterexample, and Communicating Using Actions2014
- A convex characterization of distributed control problems in spatially invariant systems with communication constraintsSystems & Control Letters, 2005
- Numerical solutions to the Witsenhausen counterexample by approximating networksIEEE Transactions on Automatic Control, 2001
- The Witsenhausen counterexample: a hierarchical search approach for nonconvex optimization problemsIEEE Transactions on Automatic Control, 2001
- Certain nonlinear partially observable stochastic optimal control problems with explicit control laws equivalent to LEQG/LQG problemsIEEE Transactions on Automatic Control, 1997
- Stochastic Control of Partially Observable Systems1992
- Control of partially observed diffusionsJournal of Optimization Theory and Applications, 1991
- Equivalent stochastic control problemsMathematics of Control, Signals, and Systems, 1988
- Zeros of the Hermite polynomials and weights for Gauss’ mechanical quadrature formulaBulletin of the American Mathematical Society, 1948