Performance Characteristics of an SDN-Enhanced Job Management System for Cluster Systems with Fat-Tree Interconnect
- 1 December 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 781-786
Abstract
In the era of cloud computing, data centers that accommodate a series of user-requested jobs with a diversity of resource usage pattern need to have the capability of efficiently distributing resources to each user job, based on individual resource usage patterns. In particular, for high-performance computing as a cloud service which allows many users to benefit from a large-scale computing system, a new framework for resource management that treats not only the CPU resources, but also the network resources in the data center is essential. In this paper, an SDN-enhanced JMS that efficiently handles both network and CPU resources and as a result accelerates the execution time of user jobs is introduced as a building block technology for such a HPC cloud. Our evaluation shows that the SDN-enhanced JMS efficiently leverages the fat-tree interconnect of cluster systems running behind the cloud to suppress the collision of communications generated by different jobs.Keywords
This publication has 5 references indexed in Scilit:
- Prototyping and evaluation of a network-aware Job Management System on a cluster system2013
- An Architectural Design of a Job Management System Leveraging Software Defined Network2013
- OpenFlowACM SIGCOMM Computer Communication Review, 2008
- G-lambda: Coordination of a Grid scheduler and lambda path service over GMPLSFuture Generation Computer Systems, 2006
- Job scheduling under the Portable Batch System1995