Ulrich Rieder
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Ulrich Rieder has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Nicole Bäuerle
Department of Mathematics, Karlsruhe Institute of Technology, Karlsruhe, Germany
25 shared publications Karl Hinderer
Karlsruher Institut für Technologie (KIT)
14 shared publicationsMichael Stieglitz
Karlsruher Institut für Technologie (KIT)
14 shared publications- Christoph Wopperer
UniCredit Group
1 shared publication - Jens Winter
Institute of Optimization and Operations Research, Universität Ulm, Ulm, Germany
1 shared publication - Marc Wittlinger
Institute of Mathematical Finance Ulm University Helmholtzstrasse 18 89081 Ulm Germany
1 shared publication
Latest Publications
- Open Access
- 1 January 2020
- Published by Institute of Mathematics, Polish Academy of Sciences in Banach Center Publications
- Vol. 122, 25-39
Markov decision processes under ambiguity
We consider statistical Markov Decision Processes where the decision maker is risk averse against model ambiguity. The latter is given by an unknown parameter which influences the transition law and the cost functions. Risk aversion is measured either by
- 1 January 2020
- Published by Institute of Mathematics, Polish Academy of Sciences in Banach Center Publications
- Vol. 122, 25-39
Open AccessMarkov decision processes under ambiguity
We consider statistical Markov Decision Processes where the decision maker is risk averse against model ambiguity. The latter is given by an unknown parameter which influences the transition law and the cost functions. Risk aversion is measured either by
- Open Access
Markov Decision Processes under Ambiguity
We consider statistical Markov Decision Processes where the decision maker is risk averse against model ambiguity. The latter is given by an unknown parameter which influences the transition law and the cost functions. Risk aversion is either measured by the entropic risk measure or by the Average Value at Risk. We show how to solve these kind of problems using a general minimax theorem. Under some continuity and compactness assumptions we prove the existence of an optimal (deterministic) policy and discuss its computation. We illustrate our results using an example from statistical decision theory.
Open AccessMarkov Decision Processes under Ambiguity
We consider statistical Markov Decision Processes where the decision maker is risk averse against model ambiguity. The latter is given by an unknown parameter which influences the transition law and the cost functions. Risk aversion is either measured by the entropic risk measure or by the Average Value at Risk. We show how to solve these kind of problems using a general minimax theorem. Under some continuity and compactness assumptions we prove the existence of an optimal (deterministic) policy and discuss its computation. We illustrate our results using an example from statistical decision theory.
- Open Access
Partially Observable Risk-Sensitive Stopping Problems in Discrete Time
In this paper we consider stopping problems with partial observation under a general risk-sensitive optimization criterion for problems with finite and infinite time horizon. Our aim is to maximize the certainty equivalent of the stopping reward. We develop a general theory and discuss the Bayesian risk-sensitive house selling problem as a special example. In particular we are able to study the influence of the attitude towards risk of the decision maker on the optimal stopping rule.
Open AccessPartially Observable Risk-Sensitive Stopping Problems in Discrete Time
In this paper we consider stopping problems with partial observation under a general risk-sensitive optimization criterion for problems with finite and infinite time horizon. Our aim is to maximize the certainty equivalent of the stopping reward. We develop a general theory and discuss the Bayesian risk-sensitive house selling problem as a special example. In particular we are able to study the influence of the attitude towards risk of the decision maker on the optimal stopping rule.
- 18 February 2017
- Published by Springer Nature
- p. 47-58
Vollständigkeit und äquivalente Martingalmaße
- 1 February 2017
- Published by Elsevier in Stochastic Processes and their Applications
- Vol. 127 (2) , 622-642
Zero-sum risk-sensitive stochastic games
- 1 February 2017
- Published by Elsevier in Stochastic Processes and their Applications
- Vol. 127 (2) , 622-642
Zero-sum risk-sensitive stochastic games
- Open Access
Partially Observable Risk-Sensitive Markov Decision Processes
We consider the problem of minimizing a certainty equivalent of the total or discounted cost over a finite and an infinite time horizon which is generated by a Partially Observable Markov Decision Process (POMDP). The certainty equivalent is defined by $U^{-1}(EU(Y))$ where $U$ is an increasing function. In contrast to a risk-neutral decision maker this optimization criterion takes the variability of the cost into account. It contains as a special case the classical risk-sensitive optimization criterion with an exponential utility. We show that this optimization problem can be solved by embedding the problem into a completely observable Markov Decision Process with extended state space and give conditions under which an optimal policy exists. The state space has to be extended by the joint conditional distribution of current unobserved state and accumulated cost. In case of an exponential utility, the problem simplifies considerably and we rediscover what in previous literature has been named information state. However, since we do not use any change of measure techniques here, our approach is simpler. A small numerical example, namely the classical repeated casino game with unknown success probability is considered to illustrate the influence of the certainty equivalent and its parameters.Open AccessPartially Observable Risk-Sensitive Markov Decision Processes
We consider the problem of minimizing a certainty equivalent of the total or discounted cost over a finite and an infinite time horizon which is generated by a Partially Observable Markov Decision Process (POMDP). The certainty equivalent is defined by $U^{-1}(EU(Y))$ where $U$ is an increasing function. In contrast to a risk-neutral decision maker this optimization criterion takes the variability of the cost into account. It contains as a special case the classical risk-sensitive optimization criterion with an exponential utility. We show that this optimization problem can be solved by embedding the problem into a completely observable Markov Decision Process with extended state space and give conditions under which an optimal policy exists. The state space has to be extended by the joint conditional distribution of current unobserved state and accumulated cost. In case of an exponential utility, the problem simplifies considerably and we rediscover what in previous literature has been named information state. However, since we do not use any change of measure techniques here, our approach is simpler. A small numerical example, namely the classical repeated casino game with unknown success probability is considered to illustrate the influence of the certainty equivalent and its parameters. - Open Access
Zero-sum Risk-Sensitive Stochastic Games
In this paper we consider two-person zero-sum risk-sensitive stochastic dynamic games with Borel state and action spaces and bounded reward. The term risk-sensitive refers to the fact that instead of the usual risk neutral optimization criterion we consider the exponential certainty equivalent. The discounted reward case on a finite and an infinite time horizon is considered, as well as the ergodic reward case. Under continuity and compactness conditions we prove that the value of the game exists and solves the Shapley equation and we show the existence of optimal (non-stationary) strategies. In the ergodic reward case we work with a local minorization property and a Lyapunov condition and show that the value of the game solves the Poisson equation. Moreover, we prove the existence of optimal stationary strategies. A simple example highlights the influence of the risk-sensitivity parameter. Our results generalize findings in Basu/Ghosh 2014 and answer an open question posed there.
Open AccessZero-sum Risk-Sensitive Stochastic Games
In this paper we consider two-person zero-sum risk-sensitive stochastic dynamic games with Borel state and action spaces and bounded reward. The term risk-sensitive refers to the fact that instead of the usual risk neutral optimization criterion we consider the exponential certainty equivalent. The discounted reward case on a finite and an infinite time horizon is considered, as well as the ergodic reward case. Under continuity and compactness conditions we prove that the value of the game exists and solves the Shapley equation and we show the existence of optimal (non-stationary) strategies. In the ergodic reward case we work with a local minorization property and a Lyapunov condition and show that the value of the game solves the Poisson equation. Moreover, we prove the existence of optimal stationary strategies. A simple example highlights the influence of the risk-sensitivity parameter. Our results generalize findings in Basu/Ghosh 2014 and answer an open question posed there.
- 1 January 2016
- Published by Springer Nature
- p. 389-410
Bayesian Control Models
- 1 January 2016
- Published by Springer Nature
- p. 411-434
Examples of Bayesian Control Models
- 1 January 2016
- Published by Springer Nature
- p. 371-387
Markov Renewal Programs