R. Shane Goff
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
R. Shane Goff has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Ashlyn Lee
High Performance Computing Division, Los Alamos National Laboratory, United States of America and Colorado State University, United States of America
1 shared publication - Benjamin Stormer
High Performance Computing Division, Los Alamos National Laboratory, United States of America and U. Texas at Austin, United States of America
1 shared publication - Claude H. (Rusty) Davis Iv
Los Alamos National Laboratory, Los Alamos, NM, USA
1 shared publication - Jordan Ogas
High Performance Computing Division, Los Alamos National Laboratory, United States of America
1 shared publication - Reid Priedhorsky
Los Alamos National Laboratory
1 shared publication - Z. Noah Hounshel
High Performance Computing Division, Los Alamos National Laboratory, United States of America and U. North Carolina Wilmington, United States of America
1 shared publication
Latest Publications
- Open Access
- 12 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 135-146
Charliecloud’s layer-free, Git-based container build cache
A popular approach to deploying scientific applications in high performance computing (HPC) is Linux containers, which package an application and all its dependencies as a single unit. This image is built by interpreting instructions in a machine-readable recipe, which is faster with a build cache that stores instruction results for re-use. The standard approach (used e.g. by Docker and Podman) is a many-layered union filesystem, encoding differences between layers as tar archives. We describe a new approach, implemented in Charliecloud: store changing images in a Git repository. Our experiments show this performs similarly to layered caches on both build time and disk usage, with a considerable advantage for many-instruction recipes. Our approach also has structural advantages: better diff format, lower cache overhead, and better file de-duplication. These results show that a Git-based cache for layer-free container implementations is not only possible but may outperform the layered approach on important dimensions.
- 12 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 135-146
Open AccessCharliecloud’s layer-free, Git-based container build cache
A popular approach to deploying scientific applications in high performance computing (HPC) is Linux containers, which package an application and all its dependencies as a single unit. This image is built by interpreting instructions in a machine-readable recipe, which is faster with a build cache that stores instruction results for re-use. The standard approach (used e.g. by Docker and Podman) is a many-layered union filesystem, encoding differences between layers as tar archives. We describe a new approach, implemented in Charliecloud: store changing images in a Git repository. Our experiments show this performs similarly to layered caches on both build time and disk usage, with a considerable advantage for many-instruction recipes. Our approach also has structural advantages: better diff format, lower cache overhead, and better file de-duplication. These results show that a Git-based cache for layer-free container implementations is not only possible but may outperform the layered approach on important dimensions.