William H. Alexander
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
William H. Alexander has a total of 1 co-authors. Here are the top co-authors by number of shared publications:
Joshua W. Brown
1 shared publication
Latest Publications
- 1 June 2010
- Published by MIT Press in Neural Computation
- Vol. 22 (6) , 1511-1527
Hyperbolically Discounted Temporal Difference Learning
Hyperbolic discounting of future outcomes is widely observed to underlie choice behavior in animals. Additionally, recent studies (Kobayashi & Schultz, 2008 ) have reported that hyperbolic discounting is observed even in neural systems underlying choice. However, the most prevalent models of temporal discounting, such as temporal difference learning, assume that future outcomes are discounted exponentially. Exponential discounting has been preferred largely because it can be expressed recursively, whereas hyperbolic discounting has heretofore been thought not to have a recursive definition. In this letter, we define a learning algorithm, hyperbolically discounted temporal difference (HDTD) learning, which constitutes a recursive formulation of the hyperbolic model.
- 1 June 2010
- Published by MIT Press in Neural Computation
- Vol. 22 (6) , 1511-1527
Hyperbolically Discounted Temporal Difference Learning
Hyperbolic discounting of future outcomes is widely observed to underlie choice behavior in animals. Additionally, recent studies (Kobayashi & Schultz, 2008 ) have reported that hyperbolic discounting is observed even in neural systems underlying choice. However, the most prevalent models of temporal discounting, such as temporal difference learning, assume that future outcomes are discounted exponentially. Exponential discounting has been preferred largely because it can be expressed recursively, whereas hyperbolic discounting has heretofore been thought not to have a recursive definition. In this letter, we define a learning algorithm, hyperbolically discounted temporal difference (HDTD) learning, which constitutes a recursive formulation of the hyperbolic model.