GDM
Authors:
Open Access
- 16 June 2014
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM SIGMETRICS Performance Evaluation Review
- Vol. 42 (1) , 533-545
Abstract
GPGPUs are evolving from dedicated accelerators towards mainstream commodity computing resources. During the transition, the lack of system management of device memory space on GPGPUs has become a major hurdle. In existing GPGPU systems, device memory space is still managed explicitly by individual applications, which not only increases the burden of programmers but can also cause application crashes, hangs, or low performance. In this paper, we present the design and implementation of GDM, a fully functional GPGPU device memory manager to address the above problems and unleash the computing power of GPGPUs in general-purpose environments. To effectively coordinate the device memory usage of different applications, GDM takes control over device memory allocations and data transfers to and from device memory, leveraging a buffer allocated in each application's virtual memory. GDM utilizes the unique features of GPGPU systems and relies on several effective optimization techniques to guarantee the efficient usage of device memory space and to achieve high performance. We have evaluated GDM and compared it against state-of-the-art GPGPU system software on a range of workloads. The results show that GDM can prevent applications from crashes, including those induced by device memory leaks, and improve system performance by up to 43%.Keywords
Funding Information
- Division of Computing and Communication Foundations (CCF-0913050, OCI-1147522, CNS-1162165)
- Division of Computer and Network Systems (CCF-0913050, OCI-1147522, CNS-1162165)
- Office of Cyberinfrastructure (CCF-0913050, OCI-1147522, CNS-1162165)
This publication has 17 references indexed in Scilit:
- The Yin and Yang of processing data warehousing queries on GPU devicesProceedings of the VLDB Endowment, 2013
- GPUfs2013
- Accelerating pathology image data cross-comparison on CPU-GPU hybrid systemsProceedings of the VLDB Endowment, 2012
- Supporting virtual memory in GPGPU without supporting precise exceptions2012
- PTask2011
- SCOPEProceedings of the VLDB Endowment, 2008
- Die Stacking (3D) Microarchitecture2006
- The GPU enters computing's mainstreamComputer, 2003
- Third Generation Computer SystemsACM Computing Surveys, 1971
- Virtual MemoryACM Computing Surveys, 1970