Combining Checkpointing and Data Compression to Accelerate Adjoint-Based Optimization Problems
Authors:
- Navjot KukrejaNKNavjot Kukreja
- Jan HueckelheimJHJan Hueckelheim
- Fabio LuporiniFLFabio Luporini
Preprint
Abstract
Seismic inversion and imaging are adjoint-based optimization problems that process up to terabytes of data, regularly exceeding the memory capacity of available computers. Data compression is an effective strategy to reduce this memory requirement by a certain factor, particularly if some loss in accuracy is acceptable. A popular alternative is checkpointing, where data is stored at selected points in time, and values at other times are recomputed as needed from the last stored state. This allows arbitrarily large adjoint computations with limited memory, at the cost of additional recomputations. In this paper, we combine compression and checkpointing for the first time to compute a realistic seismic inversion. The combination of checkpointing and compression allows larger adjoint computations compared to using only compression, and reduces the recomputation overhead significantly compared to using only checkpointing.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Optimizing Lossy Compression Rate-Distortion from Automatic Online Selection between SZ and ZFPIEEE Transactions on Parallel and Distributed Systems, 2019
- Efficient Lossy Compression for Scientific Data Based on Pointwise Relative Error BoundIEEE Transactions on Parallel and Distributed Systems, 2018
- An Asynchronous Two-Level Checkpointing Method to Solve Adjoint Problems on Hierarchical Memory SpacesComputing in Science & Engineering, 2018
- Optimal Multistage Algorithm for Adjoint ComputationSIAM Journal on Scientific Computing, 2016
- Towards efficient backward-in-time adjoint computations using data compression techniquesComputer Methods in Applied Mechanics and Engineering, 2015
- Fixed-Rate Compressed Floating-Point ArraysIEEE Transactions on Visualization and Computer Graphics, 2014
- 3D Frequency-Domain Seismic Inversion with Controlled SloppinessSIAM Journal on Scientific Computing, 2014
- Why Modern CPUs Are Starving and What Can Be Done about ItComputing in Science & Engineering, 2010
- MultiStage Approaches for Optimal Offline CheckpointingSIAM Journal on Scientific Computing, 2009
- A review of the adjoint-state method for computing the gradient of a functional with geophysical applicationsGeophysical Journal International, 2006