Enabling high‐speed asynchronous data extraction and transfer using DART
Authors:
- 23 March 2010
- journal article
- research article
- Published by Wiley in Concurrency and Computation: Practice and Experience
- Vol. 22 (9) , 1181-1204
Abstract
As the complexity and scale of applications grow, managing and transporting the large amounts of data they generate are quickly becoming a significant challenge. Moreover, the interactive and real‐time nature of emerging applications, as well as their increasing runtime, make online data extraction and analysis a key requirement in addition to traditional data I/O and archiving. To be effective, online data extraction and transfer should impose minimal additional synchronization requirements, should have minimal impact on the computational performance and communication latencies, maintain overall quality of service, and ensure that no data is lost. In this paper we present Decoupled and Asynchronous Remote Transfers (DART), an efficient data transfer substrate that effectively addresses these requirements. DART is a thin software layer built on RDMA technology to enable fast, low‐overhead, and asynchronous access to data from a running simulation, and supports high‐throughput, low‐latency data transfers. DART has been integrated with applications simulating fusion plasma in a Tokamak, being developed at the Center for Plasma Edge Simulation (CPES), a DoE Office of Fusion Energy Science (OFES) Fusion Simulation Project (FSP). A performance evaluation using the Gyrokinetic Toroidal Code and XGC‐1 particle‐in‐cell‐based FSP simulations running on the Cray XT3/XT4 system at Oak Ridge National Laboratory demonstrates how DART can effectively and efficiently offload simulation data to local service and remote analysis nodes, with minimal overheads on the simulation itself. Copyright © 2010 John Wiley & Sons, Ltd.Keywords
This publication has 10 references indexed in Scilit:
- LIVE data workspace: A flexible, dynamic and extensible platform for petascale applications2007
- Implementation and Performance of Portals 3.3 on the Cray XT32005 IEEE International Conference on Cluster Computing, 2005
- Numerical study of neoclassical plasma pedestal in a tokamak geometryPhysics of Plasmas, 2004
- Grid -Based Parallel Data Streaming implemented for the Gyrokinetic Toroidal Code2003
- The Kangaroo approach to data movement on the Grid2002
- Data sieving and collective I/O in ROMIO1999
- Turbulent Transport Reduction by Zonal Flows: Massively Parallel SimulationsScience, 1998
- Disk-directed I/O for MIMD multiprocessorsACM Transactions on Computer Systems, 1997
- Server-directed collective I/O in Panda1995
- High-performance I/O for massively parallel computers: problems and prospectsComputer, 1994