Responsive elastic computing
Authors:
Open Access
- 15 June 2009
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 55-64
Abstract
Two production models are candidates for e-science computing: grids enable hardware and software sharing; clouds propose dynamic resource provisioning (elastic computing). Organized sharing is a fundamental requirement for large scientific collaborations; responsiveness, the ability to provide good response time, is a fundamental requirement for seamless integration of the large scale computing resources into everyday use. This paper focuses on a model-free resource provisioning strategy supporting both scenarios. The provisioning problem is modeled as a continuous action-state space, multi-objective reinforcement learning problem, under realistic hypotheses; the high level goals of users, administrators, and shareholders are captured through simple utility functions. We propose an implementation of this reinforcement learning framework, including an approximation of the value function through an Echo State Network, and we validate it on a real dataset.Keywords
This publication has 12 references indexed in Scilit:
- Utility-Based Reinforcement Learning for Reactive Grids2008
- Grid Differentiated Services: A Reinforcement Learning Approach2008
- Scheduling for Responsive GridsJournal of Grid Computing, 2007
- On the use of hybrid reinforcement learning for autonomic resource allocationCluster Computing, 2007
- Analysis and modeling of job arrivals in a production gridACM SIGMETRICS Performance Evaluation Review, 2007
- Reinforcement Learning with Echo State Networks2006
- Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless CommunicationScience, 2004
- The Anatomy of the Grid: Enabling Scalable Virtual OrganizationsThe International Journal of High Performance Computing Applications, 2001
- Reinforcement Learning in Continuous Time and SpaceNeural Computation, 2000
- A parallel network that learns to play backgammonArtificial Intelligence, 1989