Indexed fast network proximity querying
Authors:
Open Access
- 1 April 2018
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the VLDB Endowment
- Vol. 11 (8) , 840-852
Abstract
Node proximity queries are among the most common operations on network databases. A common measure of node proximity is random walk based proximity, which has been shown to be less susceptible to noise and missing data. Real-time processing of random-walk based proximity queries poses significant computational challenges for larger graphs with over billions of nodes and edges, since it involves solution of large linear systems of equations. Due to the importance of this operation, significant effort has been devoted to developing efficient methods for random-walk based node proximity computations. These methods either aim to speed up iterative computations by exploiting numerical properties of random walks, or rely on computation and storage of matrix inverses to avoid computation during query processing. Although both approaches have been well studied, the speedup achieved by iterative approaches does not translate to real-time query processing, and the storage requirements of inversion-based approaches prohibit their use on very large graph databases. We present a novel approach to significantly reducing the computational cost of random walk based node proximity queries with scalable indexing. Our approach combines domain graph-partitioning based indexing with fast iterative computations during query processing using Chebyshev polynomials over the complex elliptic plane. This approach combines the query processing benefits of inversion techniques with the memory and storage benefits of iterative approache. Using real-world networks with billions of nodes and edges, and top- k proximity queries as the benchmark problem, we show that our algorithm, I-C hopper , significantly outperforms existing methods. Specifically, it drastically reduces convergence time of the iterative procedure, while also reducing storage requirements for indexing.Keywords
This publication has 32 references indexed in Scilit:
- Fast incremental and personalized PageRankProceedings of the VLDB Endowment, 2010
- The power of protein interaction networks for associating genes with diseasesBioinformatics, 2010
- Associating Genes and Protein Complexes with Disease via Network PropagationPLOS Computational Biology, 2010
- Using PageRank to Locally Partition a GraphInternet Mathematics, 2007
- Hypergraph-partitioning-based decomposition for parallel sparse-matrix vector multiplicationIEEE Transactions on Parallel and Distributed Systems, 1999
- A Parallel Algorithm for Multilevel Graph Partitioning and Sparse Matrix OrderingJournal of Parallel and Distributed Computing, 1998
- An Approximate Minimum Degree Ordering AlgorithmSIAM Journal on Matrix Analysis and Applications, 1996
- The hierarchical basis multigrid method and incomplete LU decomposition1994
- Chebyshev acceleration techniques for solving nonsymmetric eigenvalue problemsMathematics of Computation, 1984
- The Tchebychev iteration for nonsymmetric linear systemsNumerische Mathematik, 1977