Exploring the Diversity of Multiple Job Deployments over GPUs for Efficient Resource Sharing
Authors:
- 17 January 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 777-782
Abstract
Graphic Processing Units (GPUs) are gradually becoming mainstream computing resource for efficient execution of applications both on-premises and in the cloud. Currently however, most HPC applications are unable to leverage the large computing capabilities they provide leading to issues of resource under-utilization. Various GPU sharing approaches have been proposed which leverage either software or hardware level mechanisms like MPS or MIG in NVIDIA GPUs. However, combining both the software and hardware level technologies in an effort to mitigate resource under-utilization issues is yet to be fully explored. In this paper, we conduct a case study on scheduling memory intensive and compute intensive applications on an NVIDIA A30 GPU. We compare the performance when using only hardware level sharing mechanisms and when using both hardware and software level mechanisms. We observed that by combining both mechanisms, we improved total execution times by up to 14% for a single run whilst improving peak bandwidth utilization by about 39% for SCAN application.Keywords
Funding Information
- National Research Foundation of Korea
This publication has 6 references indexed in Scilit:
- MISO2022
- Compiler-assisted scheduling for multi-instance GPUs2022
- Horus: Interference-Aware and Prediction-Based Scheduling in Deep Learning SystemsIEEE Transactions on Parallel and Distributed Systems, 2022
- DynamoML: Dynamic Resource Management Operators for Machine Learning Workloads2021
- GSLICE2020
- Rodinia: A benchmark suite for heterogeneous computing2009