In-situ Feature-Based Objects Tracking for Large-Scale Scientific Simulations
Authors:
- 1 November 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 736-740
Abstract
Emerging scientific simulations on leadership class systems are generating huge amounts of data. However, the increasing gap between computation and disk I/O speeds makes traditional data analytics pipelines based on post-processing cost prohibitive and often infeasible. In this paper, we investigate an alternate approach that aims to bring the analytics closer to the data using data staging and the in-situ execution of data analysis operations. Specifically, we present the design, implementation and evaluation of a framework that can support in-situ feature-based object tracking on distributed scientific datasets. Central to this framework is the scalable decentralized and online clustering (DOC) and cluster tracking algorithm, which executes in-situ (on different cores) and in parallel with the simulation processes, and retrieves data from the simulations directly via on-chip shared memory. The results from our experimental evaluation demonstrate that the in-situ approach significantly reduces the cost of data movement, that the presented framework can support scalable feature-based object tracking, and that it can be effectively used for in-situ analytics for large scale simulations.Keywords
This publication has 12 references indexed in Scilit:
- Enabling In-situ Execution of Coupled Scientific Workflow on Multi-core Platform2012
- Parallel in situ indexing for data-intensive computing2011
- Toward simulation-time data analysis and I/O acceleration on leadership-class systems2011
- The ParaView Coprocessing Library: A scalable, general purpose in situ visualization library2011
- Moving the Code to the Data - Dynamic Code Deployment Using ActiveSpaces2011
- In Situ Visualization for Large-Scale Combustion SimulationsIEEE Computer Graphics and Applications, 2010
- DataStager2009
- Robust clustering analysis for the management of self-monitoring distributed systemsCluster Computing, 2008
- Architectural challenges and solutions for petascale postprocessingJournal of Physics: Conference Series, 2007
- Tracking and visualizing turbulent 3D featuresIEEE Transactions on Visualization and Computer Graphics, 1997