PEFP: Efficient k-hop Constrained s-t Simple Path Enumeration on FPGA
Preprint
Abstract
Graph plays a vital role in representing entities and their relationships in a variety of fields, such as e-commerce networks, social networks and biological networks. Given two vertices s and t, one of the fundamental problems in graph databases is to investigate the relationships between s and t. A well-studied problem in such area is k-hop constrained s-t simple path enumeration. Nevertheless, all existing algorithms targeting this problem follow the DFS-based paradigm, which cannot scale up well. Moreover, using hardware devices like FPGA to accelerate graph computation has become popular. Motivated by this, in this paper, we propose the first FPGA-based algorithm PEFP to solve the problem of k-hop constrained s-t simple path enumeration efficiently. On the host side, we propose a preprocessing algorithm Pre-BFS to reduce the graph size and search space. On the FPGA side in PEFP, we propose a novel DFS-based batching technique to save on-chip memory efficiently. In addition, we also propose caching techniques to cache necessary data in BRAM, which overcome the latency bottleneck brought by the read/write operations from/to FPGA DRAM. Finally, we propose a data separation technique to enable dataflow optimization for the path verification module; hence the sub-stages in that module can be executed in parallel. Comprehensive experiments show that PEFP outperforms the state-of-the-art algorithm JOIN by more than 1 order of magnitude by average, and up to 2 orders of magnitude in terms of preprocessing time, query processing time and total time, respectively.Keywords
All Related Versions
This publication has 12 references indexed in Scilit:
- A General Purpose Algorithm for Counting Simple Cycles and Simple Paths of Any LengthAlgorithmica, 2019
- Finding Top-k Shortest Paths with DiversityIEEE Transactions on Knowledge and Data Engineering, 2017
- The multi-criteria constrained shortest path problemTransportation Research Part E: Logistics and Transportation Review, 2017
- Computing and Listing st-Paths in Public Transportation NetworksTheory of Computing Systems, 2017
- Mathematical formulations and exact algorithm for the multitrip cumulative capacitated single-vehicle routing problemEuropean Journal of Operational Research, 2016
- Efficiently Listing Bounded Length st-Paths2015
- Optimal Listing of Cycles and st-Paths in Undirected Graphs2013
- Improved algorithms for the k simple shortest paths and the replacement paths problemsInformation Processing Letters, 2009
- A query language for biological networksBioinformatics, 2005
- Eigenvalues of Random Power law GraphsAnnals of Combinatorics, 2003