Exploiting NVM in large-scale graph analytics
Authors:
Open Access
- 4 October 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-9
Abstract
Data center applications like graph analytics require servers with ever larger memory capacities. DRAM scaling, however, is not able to match the increasing demands for capacity. Emerging byte-addressable, non-volatile memory technologies (NVM) offer a more scalable alternative, with memory that is directly addressable to software, but at a higher latency and lower bandwidth. Using an NVM hardware emulator, we study the suitability of NVM in meeting the memory demands of four state of the art graph analytics frameworks, namely Graphlab, Galois, X-Stream and Graphmat. We evaluate their performance with popular algorithms (Pagerank, BFS, Triangle Counting and Collaborative filtering) by allocating memory exclusive from DRAM (DRAM-only) or emulated NVM (NVM-only). While all of these applications are sensitive to higher latency or lower bandwidth of NVM, resulting in performance degradation of up to 4x with NVM-only (compared to DRAM-only), we show that the performance impact is somewhat mitigated in the frameworks that exploit CPU memory-level parallelism and hardware prefetchers. Further, we demonstrate that, in a hybrid memory system with NVM and DRAM, intelligent placement of application data based on their relative importance may help offset the overheads of the NVM-only solution in a cost-effective manner (i.e., using only a small amount of DRAM). Specifically, we show that, depending on the algorithm, Graphmat can achieve close to DRAM-only performance (within 1.2x) by placing only 6.7% to 31.5% of its total memory footprint in DRAM.Keywords
This publication has 23 references indexed in Scilit:
- GraphMatProceedings of the VLDB Endowment, 2015
- Let's Talk About Storage & Recovery Methods for Non-Volatile Memory Database Systems2015
- Mojim2015
- Evaluating Phase Change Memory for Enterprise Storage SystemsACM Transactions on Storage, 2014
- X-Stream2013
- PreSETACM SIGARCH Computer Architecture News, 2012
- Clearing the clouds2012
- Efficient algorithms for large-scale local triangle countingACM Transactions on Knowledge Discovery From Data, 2010
- Large-Scale Parallel Collaborative Filtering for the Netflix Prize2008
- Microarchitecture Optimizations for Exploiting Memory-Level ParallelismACM SIGARCH Computer Architecture News, 2004