Bin Dong
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Bin Dong has a total of 24 co-authors. Here are the top co-authors by number of shared publications:
Suren Byna
The Ohio State University
5 shared publications- Houjun Tang
Lawrence Berkeley National Laboratory, California, USA
2 shared publications - Kesheng Wu
Lawrence Berkeley National Laboratory, California, USA
2 shared publications Alex Popescu
1 shared publication- Dana Robinson
The HDF Group, Champaign, USA
1 shared publication - David Thorsley
Samsung Research Labs, Mountain View, CA, USA
1 shared publication
Latest Publications
- 27 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 439-446
The Art of Sparsity: Mastering High-Dimensional Tensor Storage
Sparse tensors are prevalent in many applications. While numerous approaches have emerged to optimize the organization of sparse tensors, with the goal of reducing storage requirements and enhancing access performance, a comprehensive examination of the associated time and space complexities has been notably lacking. This study bridges this gap by conducting both theoretical and empirical investigations into various strategies for storing sparse tensors. Our major findings are as follows: (1) Linear address-based organization provides the best balance between storage size and access time; (2) Sparse high-dimensional tensor data can be transformed into lower-dimensional tensors, facilitating efficient storage and access; (3) In the absence of dimension transformation, tree-structured organizations offer compelling performance in low-dimensional tensors and exceptional performance in high-dimensional tensors.
- 27 May 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 439-446
The Art of Sparsity: Mastering High-Dimensional Tensor Storage
Sparse tensors are prevalent in many applications. While numerous approaches have emerged to optimize the organization of sparse tensors, with the goal of reducing storage requirements and enhancing access performance, a comprehensive examination of the associated time and space complexities has been notably lacking. This study bridges this gap by conducting both theoretical and empirical investigations into various strategies for storing sparse tensors. Our major findings are as follows: (1) Linear address-based organization provides the best balance between storage size and access time; (2) Sparse high-dimensional tensor data can be transformed into lower-dimensional tensors, facilitating efficient storage and access; (3) In the absence of dimension transformation, tree-structured organizations offer compelling performance in low-dimensional tensors and exceptional performance in high-dimensional tensors.
- 14 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 35 (5) , 844-861
PROV-IO: A Cross-Platform Provenance Framework for Scientific Data on HPC Systems
Data provenance, or data lineage, describes the life cycle of data. In scientific workflows on HPC systems, scientists often seek diverse provenance (e.g., origins of data products, usage patterns of datasets). Unfortunately, existing provenance solutions cannot address the challenges due to their incompatible provenance models and/or system implementations. In this paper, we analyze four representative scientific workflows in collaboration with the domain scientists to identify concrete provenance needs. Based on the first-hand analysis, we propose a provenance framework called PROV-IO$^+$ , which includes an I/O-centric provenance model for describing scientific data and the associated I/O operations and environments precisely. Moreover, we build a prototype of PROV-IO$^+$ to enable end-to-end provenance support on real HPC systems with little manual effort. The PROV-IO$^+$ framework can support both containerized and non-containerized workflows on different HPC platforms with flexibility in selecting various classes of provenance. Our experiments with realistic workflows show that PROV-IO$^+$ can address the provenance needs of the domain scientists effectively with reasonable performance (e.g., less than 3.5% tracking overhead for most experiments). Moreover, PROV-IO$^+$ outperforms a state-of-the-art system (i.e., ProvLake) in our experiments.- 14 March 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 35 (5) , 844-861
PROV-IO: A Cross-Platform Provenance Framework for Scientific Data on HPC Systems
Data provenance, or data lineage, describes the life cycle of data. In scientific workflows on HPC systems, scientists often seek diverse provenance (e.g., origins of data products, usage patterns of datasets). Unfortunately, existing provenance solutions cannot address the challenges due to their incompatible provenance models and/or system implementations. In this paper, we analyze four representative scientific workflows in collaboration with the domain scientists to identify concrete provenance needs. Based on the first-hand analysis, we propose a provenance framework called PROV-IO$^+$ , which includes an I/O-centric provenance model for describing scientific data and the associated I/O operations and environments precisely. Moreover, we build a prototype of PROV-IO$^+$ to enable end-to-end provenance support on real HPC systems with little manual effort. The PROV-IO$^+$ framework can support both containerized and non-containerized workflows on different HPC platforms with flexibility in selecting various classes of provenance. Our experiments with realistic workflows show that PROV-IO$^+$ can address the provenance needs of the domain scientists effectively with reasonable performance (e.g., less than 3.5% tracking overhead for most experiments). Moreover, PROV-IO$^+$ outperforms a state-of-the-art system (i.e., ProvLake) in our experiments.- Open Access
- 7 August 2023
- Published by Association for Computing Machinery (ACM)
- p. 155-167
AIIO: Using Artificial Intelligence for Job-Level and Automatic I/O Performance Bottleneck Diagnosis
Manually diagnosing the I/O performance bottleneck for a single application (hereinafter referred to as the "job level'') is a tedious and error-prone procedure requiring domain scientists to have deep knowledge of complex storage systems. However, existing automatic methods for I/O performance bottleneck diagnosis have one major issue: the granularity of the analysis is at the platform or group level and the diagnosis results cannot be applied to the individual application. To address this issue, we designed and developed a method named "Artificial Intelligence for I/O" (AIIO), which uses AI and its interpretation technology to diagnose I/O performance bottlenecks at the job level automatically. By considering the sparsity of I/O log files, employing multiple AI models for performance prediction, merging diagnosis results across multiple models, and generalizing its performance prediction and diagnosis functions, AIIO can accurately and robustly identify the bottleneck of an even unseen application. Experimental results show that real and unseen applications can use the diagnosis results from AIIO to improve their I/O performance by at most 146 times.
- 7 August 2023
- Published by Association for Computing Machinery (ACM)
- p. 155-167
Open AccessAIIO: Using Artificial Intelligence for Job-Level and Automatic I/O Performance Bottleneck Diagnosis
Manually diagnosing the I/O performance bottleneck for a single application (hereinafter referred to as the "job level'') is a tedious and error-prone procedure requiring domain scientists to have deep knowledge of complex storage systems. However, existing automatic methods for I/O performance bottleneck diagnosis have one major issue: the granularity of the analysis is at the platform or group level and the diagnosis results cannot be applied to the individual application. To address this issue, we designed and developed a method named "Artificial Intelligence for I/O" (AIIO), which uses AI and its interpretation technology to diagnose I/O performance bottlenecks at the job level automatically. By considering the sparsity of I/O log files, employing multiple AI models for performance prediction, merging diagnosis results across multiple models, and generalizing its performance prediction and diagnosis functions, AIIO can accurately and robustly identify the bottleneck of an even unseen application. Experimental results show that real and unseen applications can use the diagnosis results from AIIO to improve their I/O performance by at most 146 times.
- 1 July 2022
- Published by Elsevier in Computers & Geosciences
- Vol. 166
Real-time and post-hoc compression for data from Distributed Acoustic Sensing
- 1 July 2022
- Published by Elsevier in Computers & Geosciences
- Vol. 166
Real-time and post-hoc compression for data from Distributed Acoustic Sensing
- 17 January 2020
- Published by Springer Nature in Journal of Computer Science and Technology
- Vol. 35 (1) , 145-160
ExaHDF5: Delivering Efficient Parallel I/O on Exascale Computing Systems
- 17 January 2020
- Published by Springer Nature in Journal of Computer Science and Technology
- Vol. 35 (1) , 145-160
ExaHDF5: Delivering Efficient Parallel I/O on Exascale Computing Systems
- 17 May 2019
- Published by Springer Nature in Lecture Notes in Computer Science
- p. 61-80
SLOPE: Structural Locality-Aware Programming Model for Composing Array Data Analysis
- 17 May 2019
- Published by Springer Nature in Lecture Notes in Computer Science
- p. 61-80
SLOPE: Structural Locality-Aware Programming Model for Composing Array Data Analysis