A Numerical Method for Solving Singular Stochastic Control Problems
Authors:
- 1 August 2004
- journal article
- Published by Institute for Operations Research and the Management Sciences (INFORMS) in Operations Research
- Vol. 52 (4) , 563-582
Abstract
Singular stochastic control has found diverse applications in operations management, economics, and finance. However, in all but the simplest of cases, singular stochastic control problems cannot be solved analytically. In this paper, we propose a method for numerically solving a class of singular stochastic control problems. We combine finite element methods that numerically solve partial differential equations with a policy update procedure based on the principle of smooth pasting to iteratively solve Hamilton-Jacobi-Bellman equations associated with the stochastic control problem. A key feature of our method is that the presence of singular controls simplifies the procedure. We illustrate the method on two examples of singular stochastic control problems, one drawn from economics and the other from queueing systems.Keywords
This publication has 15 references indexed in Scilit:
- Revenue Management of a Make-to-Stock QueueManufacturing & Service Operations Management, 2002
- Infinite-Dimensional Linear Programming Approach to SingularStochastic ControlSIAM Journal on Control and Optimization, 1997
- INVESTMENT AND EMPLOYMENT DYNAMICS IN THE SHORT RUN AND THE LONG RUNOxford Economic Papers, 1997
- Heavy Traffic Convergence of a Controlled, Multiclass Queueing SystemSIAM Journal on Control and Optimization, 1996
- Heavy Traffic Analysis of a Controlled Multiclass Queueing Network via Weak Convergence MethodsSIAM Journal on Control and Optimization, 1996
- Numerical Methods for Stochastic Singular Control ProblemsSIAM Journal on Control and Optimization, 1991
- Scheduling networks of queues: Heavy traffic analysis of a simple open networkQueueing Systems, 1989
- Brownian Models of Queueing Networks with Heterogeneous Customer Populations1988
- Some solvable stochastic control problemst†Stochastics, 1980
- Lifetime Portfolio Selection under Uncertainty: The Continuous-Time CaseReview of Economics and Statistics, 1969