Compass: Cost of Migration-aware Placement in Storage Systems
- 1 May 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 50-59
Abstract
We investigate methodologies for placement and migration of logical data stores in virtualized storage systems leading to optimum system configuration in a dynamic workload scenario. The aim is to optimize the tradeoff between the performance or operational cost improvement resulting from changes in store placement, and the cost imposed by the involved data migration step. We propose a unified economic utility based framework in which the tradeoff can be formulated as a utility maximization problem where the utility of a configuration is defined as the difference between the benefit of a configuration and the cost of moving to the configuration. We present a storage management middleware framework and architecture Compass that allows systems designers to plug-in different placement as well as migration techniques for estimation of utilities associated with different configurations. The biggest obstacle in optimizing the placement benefit and migration cost tradeoff is the exponential number of possible configurations that one may have to evaluate. We present algorithms that explore the configuration space efficiently and compute a candidate set of configurations that optimize this cost-benefit tradeoff. Our algorithms have many desirable properties including local optimality. Comprehensive experimental studies demonstrate the efficacy of the proposed framework and exploration algorithms, as our algorithms outperform migration cost-oblivious placement strategies by up to 40% on real OLTP traces for many settings.Keywords
This publication has 11 references indexed in Scilit:
- On Store Placement for Response Time Minimization in Parallel Disks2006
- QoSMig: Adaptive Rate-Controlled Migration of Bulk Data in Storage Systems2005
- Issues and challenges in the performance analysis of real disk arraysIEEE Transactions on Parallel and Distributed Systems, 2004
- Performance virtualization for large-scale storage systems2004
- Downlink resource allocation and pricing for wireless networks2003
- On admission control for profit maximization of networked service providers2003
- On maximizing service-level-agreement profits2001
- File assignment in parallel I/O systems with minimal variance of service timeIEEE Transactions on Computers, 2000
- Analysis and characterization of large‐scale Web server access patterns and performanceWorld Wide Web, 1999
- Data partitioning and load balancing in parallel disk systemsThe VLDB Journal, 1998