On the Root Causes of Cross-Application I/O Interference in HPC Storage Systems
Authors:
- Orcun YildizOYOrcun Yildiz
- Matthieu DorierMDMatthieu Dorier
- Shadi IbrahimSIShadi Ibrahim
- Rob RossRRRob Ross
- Gabriel AntoniuGAGabriel Antoniu
- 1 May 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15302075,p. 750-759
Abstract
As we move toward the exascale era, performance variability in HPC systems remains a challenge. I/O interference, a major cause of this variability, is becoming more important every day with the growing number of concurrent applications that share larger machines. Earlier research efforts on mitigating I/O interference focus on a single potential cause of interference (e.g., the network). Yet the root causes of I/O interference can be diverse. In this work, we conduct an extensive experimental campaign to explore the various root causes of I/O interference in HPC storage systems. We use microbenchmarks on the Grid'5000 testbed to evaluate how the applications' access pattern, the network components, the file system's configuration, and the backend storage devices influence I/O interference. Our studies reveal that in many situations interference is a result of bad flow control in the I/O path, rather than being caused by some single bottleneck in one of its components. We further show that interference-free behavior is not necessarily a sign of optimal performance. To the best of our knowledge, our work provides the first deep insight into the role of each of the potential root causes of interference and their interplay. Our findings can help developers and platform owners improve I/O performance and motivate further research addressing the problem across all components of the I/O stack.Keywords
This publication has 19 references indexed in Scilit:
- I/O-Aware Batch Scheduling for Petascale Computing Systems2015
- Scheduling the I/O of HPC Applications Under Congestion2015
- AGIOS: Application-Guided I/O Scheduling for Parallel File Systems2013
- Damaris: How to Efficiently Leverage Multicore Parallelism to Achieve Scalable, Jitter-free I/O2012
- Enabling event tracing at leadership-class scale through I/O forwarding middleware2012
- Server-side I/O coordination for parallel file systems2011
- Accelerating I/O Forwarding in IBM Blue Gene/P Systems2010
- CA-NFSACM Transactions on Storage, 2009
- A Novel network request scheduler for a large scale storage systemComputer Science - Research and Development, 2009
- Scalable I/O forwarding framework for high-performance computing systems2009