Towards self-tuning data placement in parallel database systems
Authors:
Open Access
- 16 May 2000
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM SIGMOD Record
- Vol. 29 (2) , 225-236
Abstract
Parallel database systems are increasingly being deployed to support the performance demands of end-users. While declustering data across multiple nodes facilitates parallelism, initial data placement may not be optimal due to skewed workloads and changing access patterns. To prevent performance degradation, the placement of data must be reorganized, and this must be done on-line to minimize disruption to the system. In this paper, we consider a dynamic self-tuning approach to reorganization in a shared nothing system. We introduce a new index-based method that faciliates fast and efficient migration of data. Our solution incorporates a globally height-balanced structure and load tracking at different levels of granularity. We conducted an extensive performance study, and implemented the methods on the Fujitsu AP3000 machine. Both the simulation and empirical results demonstratic that our proposed method is indeed scalable and effective in correcting any deterioration in system throughput.Keywords
This publication has 11 references indexed in Scilit:
- Indexing the edges---a simple and yet efficient approach to high-dimensional indexing2000
- Data partitioning and load balancing in parallel disk systemsThe VLDB Journal, 1998
- Parallel database processing on a 100 Node PC cluster1997
- Beowulf: harnessing the power of parallelism in a pile-of-PCs1997
- Two techniques for on-line index modification in shared nothing parallel databases1996
- On-line reorganization of sparsely-populated B+-trees1996
- A case for NOW (Networks of Workstations)IEEE Micro, 1995
- Distributing a search tree among a growing number of processors1994
- Lazy updates for distributed search structure1993
- Algorithms for creating indexes for very large tables without quiescing updatesACM SIGMOD Record, 1992