Using XDMoD to facilitate XSEDE operations, planning and analysis
Open Access
- 22 July 2013
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-8
Abstract
The XDMoD auditing tool provides, for the first time, a comprehensive tool to measure both utilization and performance of high-end cyberinfrastructure (CI), with initial focus on XSEDE. Here, we demonstrate, through several case studies, its utility for providing important metrics regarding resource utilization and performance of TeraGrid/XSEDE that can be used for detailed analysis and planning as well as improving operational efficiency and performance. Measuring the utilization of high-end cyberinfrastructure such as XSEDE helps provide a detailed understanding of how a given CI resource is being utilized and can lead to improved performance of the resource in terms of job throughput or any number of desired job characteristics. In the case studies considered here, a detailed historical analysis of XSEDE usage data using XDMoD clearly demonstrates the tremendous growth in the number of users, overall usage, and scale of the simulations routinely carried out. Not surprisingly, physics, chemistry, and the engineering disciplines are shown to be heavy users of the resources. However, as the data clearly show, molecular biosciences are now a significant and growing user of XSEDE resources, accounting for more than 20 percent of all SUs consumed in 2012. XDMoD shows that the resources required by the various scientific disciplines are very different. Physics, Astronomical sciences, and Atmospheric sciences tend to solve large problems requiring many cores. Molecular biosciences applications on the other hand, require many cycles but do not employ core counts that are as large. Such distinctions are important in guiding future cyberinfrastructure design decisions. XDMoD's implementation of a novel application kernel-based auditing system to measure overall CI system performance and quality of service is shown, through several examples, to provide a useful means to automatically detect under performing hardware and software. This capability is especially critical given the complex composition of today's advanced CI. Examples include an application kernel based on a widely used quantum chemistry program that uncovered a software bug in the I/O stack of a commercial parallel file system, which was subsequently fixed by the vendor in the form of a software patch that is now part of their standard release. This error, which resulted in dramatically increased execution times as well as outright job failure, would likely have gone unnoticed for sometime and was only uncovered as a result of implementation of XDMoD's suite of application kernels.Keywords
Funding Information
- Office of Cyberinfrastructure (OCI 1025159)
This publication has 9 references indexed in Scilit:
- Achieve better performance with PEAK on XSEDE resources2012
- Performance metrics and auditing framework using application kernels for high‐performance computer systemsConcurrency and Computation: Practice and Experience, 2012
- Deep and wide metrics for HPC resource capability and project usage2011
- Sustained systems performance monitoring at the U. S. Department of Defense high performance computing modernization program2011
- Cyberinfrastructure Usage Modalities on the TeraGrid2011
- Measuring TeraGrid: workload characterization for a high-performance computing federationThe International Journal of High Performance Computing Applications, 2011
- NWChem: A comprehensive and scalable open-source solution for large scale molecular simulationsComputer Physics Communications, 2010
- The Inca Test Harness and Reporting Framework2005
- The ganglia distributed monitoring system: design, implementation, and experienceParallel Computing, 2004