Deirdre Womack
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Deirdre Womack has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Aaron Jezghani
OIT - PACE, Georgia Institute of Technology, Atlanta, GA, GA, USA
2 shared publications - Dan Zhou
Georgia Institute of Technology, Atlanta, USA
2 shared publications - Eric Coulter
Georgia Institute of Technology, USA
2 shared publications - Fang Liu
Georgia Institute of Technology, Atlanta, GA, USA
2 shared publications - Kenneth Suda
Georgia Institute of Technology, Atlanta, USA
2 shared publications - Michael D. Weiner
Partnership for an Advanced Computing Environment, Georgia Institute of Technology, Atlanta, GA, USA
2 shared publications
Latest Publications
- Open Access
- 17 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Exploring Research Dataset-Sharing Strategies for Concurrent AI Workflows
Artificial Intelligence (AI) and Machine Learning (ML) workflows are increasingly prevalent in High Performance Computing (HPC) centers, requiring additional support from campus research computing centers like Georgia Institute of Technology (GT) Partnership for an Advanced Computing Environment (PACE). AI datasets usually contain many small files and a large total size; it wastes storage space if every researcher downloads copies. Hence a shared dataset is desired. The challenge is how to share the AI dataset to support multiple concurrent AI workflows efficiently. HPC filesystem choices, low-level filesystem configuration, and AI pipeline data loader selection play essential roles. This paper demonstrates a systematic performance test to guide us in implementing a shared AI data service at PACE.
- 17 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-4
Open AccessExploring Research Dataset-Sharing Strategies for Concurrent AI Workflows
Artificial Intelligence (AI) and Machine Learning (ML) workflows are increasingly prevalent in High Performance Computing (HPC) centers, requiring additional support from campus research computing centers like Georgia Institute of Technology (GT) Partnership for an Advanced Computing Environment (PACE). AI datasets usually contain many small files and a large total size; it wastes storage space if every researcher downloads copies. Hence a shared dataset is desired. The challenge is how to share the AI dataset to support multiple concurrent AI workflows efficiently. HPC filesystem choices, low-level filesystem configuration, and AI pipeline data loader selection play essential roles. This paper demonstrates a systematic performance test to guide us in implementing a shared AI data service at PACE.
- Open Access
- 12 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 591-597
ICE 2.0: Restructuring and Growing an Instructional HPC Cluster
The Partnership for an Advanced Computing Environment (PACE) at Georgia Tech (GT) has been running two campus-wide cluster resources available for academic courses and workshops for five years. The initial design focused on creating a federated resource for a wide range of educational topics, based on a PACE and College of Computing (COC) partnership. Due to funding, this took the form of separate resources, one funded by PACE, and another by COC. These "Instructional Cluster Environments", PACE-ICE and COC-ICE, became very popular with instructors at GT but led to a high maintenance cost due to the split nature of the environments. With the transition to the Slurm scheduler, PACE collaborated with COC to merge the two clusters into one, ICE. This work details the strategies used to sensibly merge the two production systems, including the storage architecture, shared system policies, and scheduler priority configurations that honor funding complexities.
- 12 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 591-597
Open AccessICE 2.0: Restructuring and Growing an Instructional HPC Cluster
The Partnership for an Advanced Computing Environment (PACE) at Georgia Tech (GT) has been running two campus-wide cluster resources available for academic courses and workshops for five years. The initial design focused on creating a federated resource for a wide range of educational topics, based on a PACE and College of Computing (COC) partnership. Due to funding, this took the form of separate resources, one funded by PACE, and another by COC. These "Instructional Cluster Environments", PACE-ICE and COC-ICE, became very popular with instructors at GT but led to a high maintenance cost due to the split nature of the environments. With the transition to the Slurm scheduler, PACE collaborated with COC to merge the two clusters into one, ICE. This work details the strategies used to sensibly merge the two production systems, including the storage architecture, shared system policies, and scheduler priority configurations that honor funding complexities.