Mochi: A Case Study in Translational Computer Science for High-Performance Computing Data Management
- 1 July 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Computing in Science & Engineering
- Vol. 25 (4) , 35-41
Abstract
High-performance computing (HPC) has become an indispensable tool for solving diverse problems in science and engineering. Harnessing the power of HPC is not just a matter of efficient computation, however; it also calls for the efficient management of vast quantities of scientific data. This presents daunting challenges: rapidly evolving storage technology has motivated a shift toward increasingly complex, heterogeneous storage architectures that are difficult to optimize, and scientific data management needs have become every bit as diverse as the application domains that drive them. There is a clear need for agile, adaptable storage solutions that can be customized for the task and platform at hand. This motivated the establishment of the Mochi composable data service project. The Mochi project provides a library of robust, reusable, modular, and connectable data management components and microservices along with a methodology for composing them into specialized distributed data services. Mochi enables rapid deployment of custom data services with a high degree of developer productivity while still effectively leveraging cutting-edge HPC hardware. This article explores how the principles of translational computer science have been applied in practice in Mochi to achieve these goals.Keywords
This publication has 13 references indexed in Scilit:
- HEPnOS: a Specialized Data Service for High Energy Physics Analysis2023
- Towards elastic in situ analysis for high-performance computing simulationsJournal of Parallel and Distributed Computing, 2023
- Translational Computer Science for Science and EngineeringComputing in Science & Engineering, 2021
- DAOS: A Scale-Out High Performance Storage Stack for Storage Class Memory2020
- Mochi: Composing Data Services for High-Performance Computing EnvironmentsJournal of Computer Science and Technology, 2020
- Translational Research in Computer ScienceComputer, 2019
- Mercury: Enabling remote procedure call for high-performance computing2013
- Scalable I/O forwarding framework for high-performance computing systems2009
- BMI: a network abstraction layer for parallel I/O2005
- A high-performance, portable implementation of the MPI message passing interface standardParallel Computing, 1996