Scalable parallel building blocks for custom data analysis
Authors:
- 1 October 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 105-112
Abstract
We present a set of building blocks that provide scalable data movement capability to computational scientists and visualization researchers for writing their own parallel analysis. The set includes scalable tools for domain decomposition, process assignment, parallel I/O, global reduction, and local neighborhood communicationtasks that are common across many analysis applications. The global reduction is performed with a new algorithm, described in this paper, that efficiently merges blocks of analysis results into a smaller number of larger blocks. The merging is configurable in the number of blocks that are reduced in each round, the number of rounds, and the total number of resulting blocks. We highlight the use of our library in two analysis applications: parallel streamline generation and parallel Morse-Smale topological analysis. The first case uses an existing local neighborhood communication algorithm, whereas the latter uses the new merge algorithm.Keywords
This publication has 27 references indexed in Scilit:
- Toward a General I/O Layer for Parallel-Visualization ApplicationsIEEE Computer Graphics and Applications, 2011
- Parallel k-Means Clustering for Quantitative Ecoregion Delineation Using Large Data SetsProcedia Computer Science, 2011
- Direct numerical simulation of flame stabilization downstream of a transverse fuel jet in cross-flowProceedings of the Combustion Institute, 2011
- An Information-Theoretic Framework for Flow VisualizationIEEE Transactions on Visualization and Computer Graphics, 2010
- Streaming‐Enabled Parallel Dataflow Architecture for Multicore SystemsComputer Graphics Forum, 2010
- Adaptable, metadata rich IO methods for portable high performance IO2009
- A Practical Approach to Morse-Smale Complex Computation: Scalability and GeneralityIEEE Transactions on Visualization and Computer Graphics, 2008
- Efficient Computation and Visualization of Coherent Structures in Fluid Flow ApplicationsIEEE Transactions on Visualization and Computer Graphics, 2007
- Parallel netCDF2003
- Scalable rendering on PC clustersIEEE Computer Graphics and Applications, 2001