Centralized Versus Decentralized Optimization of Distributed Stochastic Differential Decision Systems With Different Information Structures-Part I: A General Theory
- 2 June 2016
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automatic Control
- Vol. 62 (3) , 1194-1209
Abstract
Decentralized optimization of distributed stochastic dynamical systems with two or more controls of the decision makers (DMs) has been an active area of research for over half a century. Although, such decentralized optimization problems are often formulated utilizing static team and person-by-person (PbP) optimality criteria, the corresponding static team theory results have not been extended to dynamical systems. In this first part of the two-part paper, we derive team and PbP optimality conditions for distributed stochastic differential systems, when the controls of the DMs generate actions based on different information structures. The necessary conditions are given by a Hamiltonian System described by coupled backward and forward stochastic differential equations (SDEs) and a conditional Hamiltonian, conditioned on the information structures available to the controls of the DMs. The sufficient conditions state that PbP optimality implies team optimality, if the Hamiltonian is convex in the state and/or actions spaces of the controls of the DMs. We show existence of relaxed team optimal strategies, when the information structures are not affected by the controls of the DMs. Throughout the paper we discuss similarities to analogous optimality conditions of centralized decision or control of stochastic systems, and we note a connections to mean field stochastic optimal control problems.Keywords
All Related Versions
Funding Information
- QNRF (NPRP 6-784-2-329)
This publication has 31 references indexed in Scilit:
- Stochastic Minimum Principle for Partially Observed Systems Subject to Continuous and Jump Diffusion Processes and Driven by Relaxed ControlsSIAM Journal on Control and Optimization, 2013
- Minimax games for stochastic systems subject to relative entropy uncertainty: applications to SDEs on Hilbert spacesMathematics of Control, Signals, and Systems, 2006
- Minimum principle for partially observable nonlinear risk-sensitive control problems using measure-valued decompositionsStochastics and Stochastic Reports, 1996
- The second order minimum principle and adjoint processStochastics and Stochastic Reports, 1994
- Static team problems--Part I: Sufficient conditions and the exponential cost criterionIEEE Transactions on Automatic Control, 1982
- Team decision theory for linear continuous-time systemsIEEE Transactions on Automatic Control, 1980
- On delayed sharing patternsIEEE Transactions on Automatic Control, 1978
- Dynamic programming approach to decentralized stochastic control problemsIEEE Transactions on Automatic Control, 1975
- Linear-quadratic-gaussian control with one-step-delay sharing patternIEEE Transactions on Automatic Control, 1974
- On the equivalence of information structures in static and dynamic teamsIEEE Transactions on Automatic Control, 1973