K. Suresh Kumar
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
K. Suresh Kumar has a total of 19 co-authors. Here are the top co-authors by number of shared publications:
- Vivek Shripad Borkar
Department of Electrical Engineering, Indian Institute of Technology Bombay, Powai, Mumbai, 400076, India
8 shared publications - Ari Arapostathis
Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, Texas 78712
4 shared publications - Chandan Pal
Department of Mathematics, Indian Institute of Science, Bangalore, India
4 shared publications - Anup Biswas
Department of Mathematics, Indian Institute of Science Education and Research, Pune, India
3 shared publications - Mrinal K. Ghosh
Department of Mathematics Indian Institute of Science Bangalore-12 India
3 shared publications - Arunabha Bagchi
University of Twente
1 shared publication
Latest Publications
- Open Access
Small noise perturbations of stochastic ergodic control problems
Using small noise limit approach, we study degenerate stochastic ergodic control problems and as a byproduct obtain error bounds for the $\varepsilon$-optimal controls. We also establish tunneling for a special ergodic control problem and give a representation of the ergodic value using the tunneled Markov chain.
Open AccessSmall noise perturbations of stochastic ergodic control problems
Using small noise limit approach, we study degenerate stochastic ergodic control problems and as a byproduct obtain error bounds for the $\varepsilon$-optimal controls. We also establish tunneling for a special ergodic control problem and give a representation of the ergodic value using the tunneled Markov chain.
- 7 January 2023
- Published by Elsevier in Systems & Control Letters
- Vol. 172
Nonzero-sum risk-sensitive stochastic differential games: A multi-parameter eigenvalue problem approach
- 7 January 2023
- Published by Elsevier in Systems & Control Letters
- Vol. 172
Nonzero-sum risk-sensitive stochastic differential games: A multi-parameter eigenvalue problem approach
- Open Access
Simultaneous Small Noise Limit for Singularly Perturbed Slow-Fast Coupled Diffusions
We consider a simultaneous small noise limit for a singularly perturbed coupled diffusion described by \begin{eqnarray*} dX^{\varepsilon}_t &=& b(X^{\varepsilon}_t, Y^{\varepsilon}_t)dt + \varepsilon^{\alpha}dB_t, dY^{\varepsilon}_t &=& - \frac{1}{\varepsilon} \nabla_yU(X^{\varepsilon}_t, Y^{\varepsilon}_t)dt + \frac{s(\varepsilon)}{\sqrt{\varepsilon}} dW_t, \end{eqnarray*} where $B_t, W_t$ are independent Brownian motions on ${\mathbb R}^d$ and ${\mathbb R}^m$ respectively, $b : \mathbb{R}^d \times \mathbb{R}^m \rightarrow \mathbb{R}^d$, $U : \mathbb{R}^d \times \mathbb{R}^m \rightarrow \mathbb{R}$ and $s :(0,\infty) \rightarrow (0,\infty)$. We impose regularity assumptions on $b$, $U$ and let $0 < \alpha < 1.$ When $s(\varepsilon)$ goes to zero slower than a prescribed rate as $\varepsilon \rightarrow 0$, we characterize all weak limit points of $X^{\varepsilon}$, as $\varepsilon \rightarrow 0$, as solutions to a differential equation driven by a measurable vector field. Under an additional assumption on the behaviour of $U(x, \cdot)$ at its global minima we characterize all limit points as Filippov solutions to the differential equation.Open AccessSimultaneous Small Noise Limit for Singularly Perturbed Slow-Fast Coupled Diffusions
We consider a simultaneous small noise limit for a singularly perturbed coupled diffusion described by \begin{eqnarray*} dX^{\varepsilon}_t &=& b(X^{\varepsilon}_t, Y^{\varepsilon}_t)dt + \varepsilon^{\alpha}dB_t, dY^{\varepsilon}_t &=& - \frac{1}{\varepsilon} \nabla_yU(X^{\varepsilon}_t, Y^{\varepsilon}_t)dt + \frac{s(\varepsilon)}{\sqrt{\varepsilon}} dW_t, \end{eqnarray*} where $B_t, W_t$ are independent Brownian motions on ${\mathbb R}^d$ and ${\mathbb R}^m$ respectively, $b : \mathbb{R}^d \times \mathbb{R}^m \rightarrow \mathbb{R}^d$, $U : \mathbb{R}^d \times \mathbb{R}^m \rightarrow \mathbb{R}$ and $s :(0,\infty) \rightarrow (0,\infty)$. We impose regularity assumptions on $b$, $U$ and let $0 < \alpha < 1.$ When $s(\varepsilon)$ goes to zero slower than a prescribed rate as $\varepsilon \rightarrow 0$, we characterize all weak limit points of $X^{\varepsilon}$, as $\varepsilon \rightarrow 0$, as solutions to a differential equation driven by a measurable vector field. Under an additional assumption on the behaviour of $U(x, \cdot)$ at its global minima we characterize all limit points as Filippov solutions to the differential equation. - Open Access
Risk-sensitive control of reflected diffusion processes on orthrant
In this article, we prove the existence of optimal risk-sensitive control with state constraints. We use near monotone assumption on the running cost to prove the existence of optimal risk-sensitive control.
Open AccessRisk-sensitive control of reflected diffusion processes on orthrant
In this article, we prove the existence of optimal risk-sensitive control with state constraints. We use near monotone assumption on the running cost to prove the existence of optimal risk-sensitive control.
- 30 June 2016
- Published by Springer Nature in Indian Journal of Pure and Applied Mathematics
- Vol. 47 (2) , 343-355
A class of stochastic differential equations with pathwise unique solutions
- 30 June 2016
- Published by Springer Nature in Indian Journal of Pure and Applied Mathematics
- Vol. 47 (2) , 343-355
A class of stochastic differential equations with pathwise unique solutions
- Open Access
Nonzero-sum risk-sensitive stochastic differential games
We study two person nonzero-sum stochastic differential games with risk-sensitive discounted and ergodic cost criteria. Under certain conditions we establish a Nash equilibrium in Markov strategies for the discounted cost criterion and a Nash equilibrium in stationary strategies for the ergodic cost criterion. We achieve our results by studying the relevant systems of coupled HJB equations.
Open AccessNonzero-sum risk-sensitive stochastic differential games
We study two person nonzero-sum stochastic differential games with risk-sensitive discounted and ergodic cost criteria. Under certain conditions we establish a Nash equilibrium in Markov strategies for the discounted cost criterion and a Nash equilibrium in stationary strategies for the ergodic cost criterion. We achieve our results by studying the relevant systems of coupled HJB equations.
- Open Access
Nonzero-Sum Risk Sensitive Stochastic Games for Continuous Time Markov Chains
We study nonzero-sum stochastic games for continuous time Markov chains on a denumerable state space with risk sensitive discounted and ergodic cost criteria. For the discounted cost criterion we first show that the corresponding system of coupled HJB equations has an appropriate solution. Then under an additional additive structure on the transition rate matrix and payoff functions, we establish the existence of a Nash equilibrium in Markov strategies. For the ergodic cost criterion we assume a Lyapunov type stability assumption and a small cost condition. Under these assumptions we show that the corresponding system of coupled HJB equations admits a solution which leads to the existence of Nash equilibrium in stationary strategies.
Open AccessNonzero-Sum Risk Sensitive Stochastic Games for Continuous Time Markov Chains
We study nonzero-sum stochastic games for continuous time Markov chains on a denumerable state space with risk sensitive discounted and ergodic cost criteria. For the discounted cost criterion we first show that the corresponding system of coupled HJB equations has an appropriate solution. Then under an additional additive structure on the transition rate matrix and payoff functions, we establish the existence of a Nash equilibrium in Markov strategies. For the ergodic cost criterion we assume a Lyapunov type stability assumption and a small cost condition. Under these assumptions we show that the corresponding system of coupled HJB equations admits a solution which leads to the existence of Nash equilibrium in stationary strategies.
- Open Access
Zero-sum Risk-sensitive Stochastic Games for Continuous Time Markov Chains
We study infinite horizon discounted-cost and ergodic-cost risk-sensitive zero-sum stochastic games for controlled continuous time Markov chains on a countable state space. For the discounted-cost game we prove the existence of value and saddle-point equilibrium in the class of Markov strategies under nominal conditions. For the ergodic-cost game we prove the existence of values and saddle point equilibrium by studying the corresponding Hamilton-Jacobi-Isaacs equation under a certain Lyapunov condition.
Open AccessZero-sum Risk-sensitive Stochastic Games for Continuous Time Markov Chains
We study infinite horizon discounted-cost and ergodic-cost risk-sensitive zero-sum stochastic games for controlled continuous time Markov chains on a countable state space. For the discounted-cost game we prove the existence of value and saddle-point equilibrium in the class of Markov strategies under nominal conditions. For the ergodic-cost game we prove the existence of values and saddle point equilibrium by studying the corresponding Hamilton-Jacobi-Isaacs equation under a certain Lyapunov condition.
- 5 August 2015
- Published by Taylor & Francis in Stochastic Analysis and Applications
- Vol. 33 (5) , 863-881
Risk-Sensitive Ergodic Control of Continuous Time Markov Processes With Denumerable State Space
In this article, we study risk-sensitive control problem with controlled continuous time Markov chain state dynamics. Using multiplicative dynamic programming principle along with the atomic structure of the state dynamics, we prove the existence and a characterization of optimal risk-sensitive control under geometric ergodicity of the state dynamics along with a smallness condition on the running cost.
- 5 August 2015
- Published by Taylor & Francis in Stochastic Analysis and Applications
- Vol. 33 (5) , 863-881
Risk-Sensitive Ergodic Control of Continuous Time Markov Processes With Denumerable State Space
In this article, we study risk-sensitive control problem with controlled continuous time Markov chain state dynamics. Using multiplicative dynamic programming principle along with the atomic structure of the state dynamics, we prove the existence and a characterization of optimal risk-sensitive control under geometric ergodicity of the state dynamics along with a smallness condition on the running cost.
- 15 May 2015
- Published by Springer Nature in Journal of Theoretical Probability
- Vol. 29 (4) , 1458-1484
Risk-Sensitive Control and an Abstract Collatz–Wielandt Formula
- 15 May 2015
- Published by Springer Nature in Journal of Theoretical Probability
- Vol. 29 (4) , 1458-1484
Risk-Sensitive Control and an Abstract Collatz–Wielandt Formula