Mars
Authors:
Open Access
- 25 October 2008
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 260-269
Abstract
We design and implement Mars, a MapReduce framework, on graphics processors (GPUs). MapReduce is a distributed programming framework originally proposed by Google for the ease of development of web search applications on a large number of commodity CPUs. Compared with CPUs, GPUs have an order of magnitude higher computation power and memory bandwidth, but are harder to program since their architectures are designed as a special-purpose co-processor and their programming interfaces are typically for graphics applications. As the first attempt to harness GPU's power for MapReduce, we developed Mars on an NVIDIA G80 GPU, which contains over one hundred processors, and evaluated it in comparison with Phoenix, the state-of-the-art MapReduce framework on multi-core CPUs. Mars hides the programming complexity of the GPU behind the simple and familiar MapReduce interface. It is up to 16 times faster than its CPU-based counterpart for six common web applications on a quad-core machine. Copyright 2008 ACMKeywords
This publication has 15 references indexed in Scilit:
- Relational joins on graphics processors2008
- MapReduceCommunications of the ACM, 2008
- Efficient gather and scatter operations on graphics processors2007
- Fast Schedulability Analysis Using Commodity Graphics Hardware13th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA 2007), 2007
- Map-reduce-merge2007
- Accelerator2006
- The Direct3D 10 systemACM Transactions on Graphics, 2006
- Brook for GPUsACM Transactions on Graphics, 2004
- Fast computation of database operations using graphics processors2004
- Fast matrix multiplies using graphics hardware2001