TSE-IO: Two-Stage Extrapolative I/O Modeling and Tuning via Pairwise Learning
Open Access
- 2 November 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
Abstract
Collecting I/O data for parallel programs at large node scales is prohibitively expensive and has long been a major bottleneck for I/O performance modeling. Existing approaches typically depend on extensive training samples collected on large-scale systems, which incur high cost and generalize poorly across applications and environments. To address these challenges, we propose TSE-IO, a T wo- S tage framework for E xtrapolative I/O performance modeling and tuning. TSE-IO decomposes cross-scale performance prediction into two linked tasks: first, extrapolating application-level I/O behavior from small-scale measurements to the target scale. And second, predicting target-scale performance by jointly modeling the extrapolated behavior and tunable I/O-stack configurations. For the second stage, TSE-IO introduces a pairwise formulation that combines delta-feature matching with anchor-based inference to transfer configuration-induced performance patterns learned at small scales to unseen target scales. Experimental results show that, when trained solely on measurements collected from 1-16 nodes, TSE-IO extrapolates the I/O time of IOR, S3D-IO, Flash-IO, FLASH, and LAMMPS to 128 nodes (2,048 processes), achieving a MAPE below 20% for the majority of evaluated workloads. After tuning, five representative applications exhibit significant I/O performance improvements, achieving speedups ranging from 16.38 × to 65.38 ×, and from 1.00 × to 2.79 × compared with expert user settings across different workloads, thereby demonstrating the effectiveness and generality of TSE-IO.Keywords
This publication has 15 references indexed in Scilit:
- Auto-tuning for HPC storage stack: an optimization perspectiveCCF Transactions on High Performance Computing, 2024
- Artificial neural networks based predictions towards the auto-tuning and optimization of parallel IO bandwidth in HPC systemCluster Computing, 2022
- Seismic data IO and sorting optimization in HPC through ANNs prediction based auto-tuning for ExSeisDatNeural Computing and Applications, 2022
- Pairwise Difference Regression: A Machine Learning Meta-algorithm for Improved Prediction and Uncertainty Quantification in Chemical SearchJournal of Chemical Information and Modeling, 2021
- Applying neural networks to predict HPC-I/O bandwidth over seismic data on lustre file system for ExSeisDatCluster Computing, 2021
- Adaptive request scheduling for the I/O forwarding layer using reinforcement learningFuture Generation Computer Systems, 2020
- Auto-Tuning MPI Collective Operations on Large-Scale Parallel Systems2019
- Autotuning in High-Performance Computing ApplicationsProceedings of the IEEE, 2018
- FLASH: An Adaptive Mesh Hydrodynamics Code for Modeling Astrophysical Thermonuclear FlashesThe Astrophysical Journal Supplement Series, 2000
- Overview of the MPI-IO Parallel I/O Interface1996