LCFI: A Fault Injection Tool for Studying Lossy Compression Error Propagation in HPC Programs
Preprint
Abstract
Error-bounded lossy compression is becoming more and more important to today's extreme-scale HPC applications because of the ever-increasing volume of data generated. Error-bounded lossy compressors have been widely used in in situ visualization, data stream intensity reduction, storage reduction, I/O performance improvement, checkpoint/restart acceleration, memory footprint reduction, etc. Although many works have optimized ratio, quality, and performance for different error-bounded lossy compressors, there is none of the existing works attempting to systematically understand the impact of lossy compression errors on HPC application due to error propagation. In this paper, we propose and develop a lossy compression fault injection tool, called LCFI. To the best of our knowledge, this is the first tool that help both lossy compressor developers and users to systematically and comprehensively understand the impact of lossy compression errors on any given HPC programs. The contributions of this work are threefold. (1) We propose an efficient approach to inject lossy compression faults according to a statistical analysis of compression errors for different state-of-the-art error-bounded lossy compressors. (2) We build a fault injector which is highly applicable, customizable, ease-to-use in generating top-down comprehensive results. We use a simple sample program to demonstrate the use of LCFI. (3) We evaluate LCFI on four representative HPC benchmark programs with different lossy compression errors and derive several important insights based on our observations.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- A statistical analysis of lossily compressed climate model dataComputers & Geosciences, 2020
- Use cases of lossy compression for floating-point data in scientific data setsThe International Journal of High Performance Computing Applications, 2019
- TTHRESH: Tensor Compression for Multidimensional Visual DataIEEE Transactions on Visualization and Computer Graphics, 2019
- Multilevel techniques for compression and reduction of scientific data—the univariate caseComputing and Visualization in Science, 2018
- Data Reduction Techniques for Simulation, Visualization and Data AnalysisComputer Graphics Forum, 2018
- Exploring the feasibility of lossy compression for PDE simulationsThe International Journal of High Performance Computing Applications, 2018
- Fixed-Rate Compressed Floating-Point ArraysIEEE Transactions on Visualization and Computer Graphics, 2014
- FPC: A High-Speed Compressor for Double-Precision Floating-Point DataIEEE Transactions on Computers, 2008
- Fast and Efficient Compression of Floating-Point DataIEEE Transactions on Visualization and Computer Graphics, 2006
- The JPEG still picture compression standardIEEE Transactions on Consumer Electronics, 1992