Multi-level indexing in a distributed self-organized storage system
Authors:
- 1 June 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 1089778X,p. 989-994
Abstract
In many systems providing storage and retrieval operations on data, indices are used to make these operations more efficient. Distributed storage systems provide means to distribute the burden of storing and retrieving data onto multiple different computers. Routing indices can answer the central question in these systems: Where should one look for a specified data item? To be able to query for different columns in a relation or different entries in tuples, indexing for multiple dimensions is necessary. Our group applies a swarm-based approach to distributed storage leading to a new class of distributed systems, which are fully self-organized in their behavior and lack any shared global data structures. In this paper, we research whether multiple levels of routing indices can be maintained and used in such a distributed and self-organized storage service. To achieve this, we look into different types of indices and evaluate them in an experiment.Keywords
This publication has 13 references indexed in Scilit:
- Selforganisation in a Storage for Semantic InformationJournal of Software, 2009
- Towards LarKC: A Platform for Web-Scale Reasoning2008
- Ant Colony Optimization and Swarm Intelligence2004
- Routing indices for peer-to-peer systems2003
- A new approach to scalable Linda-systems based on swarms2003
- EDUTELLA2002
- The evolving field of distributed storageIEEE Internet Computing, 2001
- The state of the art in distributed query processingACM Computing Surveys, 2000
- Generative communication in LindaACM Transactions on Programming Languages and Systems, 1985
- Organization and maintenance of large ordered indexesActa Informatica, 1972