Toward simulation-time data analysis and I/O acceleration on leadership-class systems
- 1 October 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 9-14
Abstract
The performance mismatch between computing and I/O components of current-generation HPC systems has made I/O the critical bottleneck for scientific applications. It is therefore critical to make data movement as efficient as possible, and, to facilitate simulation-time data analysis and visualization to reduce the data written to storage. These will be of paramount importance to enabling us to glean novel insights from simulations. We present our work in GLEAN, a flexible framework for data-analysis and I/O acceleration at extreme scale. GLEAN leverages the data semantics of applications, and fully exploits the diverse system topologies and characteristics. We discuss the performance of GLEAN for simulation-time analysis and I/O acceleration with simulations at scale on leadership class systems.Keywords
This publication has 6 references indexed in Scilit:
- Scalable implicit finite element solver for massively parallel processing with demonstration to 160K cores2009
- DataStager2009
- Adaptable, metadata rich IO methods for portable high performance IO2009
- DART2008
- Analytics challenge---Remote runtime steering of integrated terascale simulation and visualization2006
- FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear FlashesThe Astrophysical Journal Supplement Series, 2000