OLCF’s Advanced Computing Ecosystem (ACE): FY24 Efforts for the DOE Integrated Research Infrastructure (IRI) Program

Authors:
Open Access
Publisher website
Google Scholar
Abstract
This report highlights significant strides made by Oak Ridge National Laboratory’s Oak Ridge LeadershipComputing Facility (OLCF) in advancing computational research and infrastructure. Through the AdvancedComputing Ecosystem (ACE) strategic initiative, OLCF has been successfully integrated with DOE’sIntegrated Research Infrastructure (IRI) program, establishing itself as a critical framework for enhancingscientific computing capabilities across various domains. This report outlines the activities, accomplishments,and future directions of ACE, emphasizing its role in developing cutting-edge technologies, supportingscience pilots, and fostering collaborations that drive scientific innovation.One of the key achievements of ACE in FY24 has been the establishment of a robust testbed environmentthat facilitates the development and validation of new computing technologies. This testbed, integratedinto the larger IRI ecosystem through Energy Sciences Network (ESnet), allows for seamless collaborationamong DOE’s Advanced Scientific Computing Research (ASCR) facilities, including the Argonne LeadershipComputing Facility (ALCF), the National Energy Research Scientific Computing Center (NERSC), andJefferson Lab (JLab). The testbed has been instrumental in enabling science pilots to experiment withinnovative methodologies in a controlled environment, thereby accelerating the translation of research intopractical applications.ACE has been instrumental in advancing a series of science pilots using computational resources fromOLCF. These pilots span a wide range of scientific domains, from basic energy sciences to biological andenvironmental research, demonstrating the versatility and impact of the ACE framework. By integratingcutting-edge technologies, such as AI-driven analytics and real-time data processing, with HPC, these pilotshave enabled significant advancements in scientific workflows. For instance, projects like LCLStreamand DELERIA have showcased the potential of ACE in optimizing experimental designs, acceleratingdata analysis, and driving innovations that are critical for addressing some of the most complex scientificchallenges of IRI pathfinder projects.ACE has also made significant progress in foundational technology development, particularly in areas suchas data movement, interface design, and scheduling. These advancements have been key in addressingthe complex requirements of modern scientific workflows, ensuring that OLCF remains at the forefront ofhigh-performance computing (HPC). The report details several ongoing projects, including the developmentof the OLCF Facility API, Data Streaming technologies, and the Zambeze distributed orchestration system,which together provide a secure and flexible framework for managing computational resources across adistributed infrastructure.In addition to technical achievements, ACE has played a central role in outreach and engagement activi-ties. Through participation in conferences, hackathons, and training sessions, the ACE team has activelycontributed to the broader scientific community. These efforts have not only facilitated the exchange ofknowledge but have also strengthened collaborations with other DOE facilities and research institutions,further enhancing the impact of the ACE program.Looking ahead, the report outlines strategic plans for FY25, which include continued support for sciencepilots, further integration with ASCR facilities, and the exploration of new technologies. These initiatives aredesigned to ensure that ACE remains a dynamic and adaptable platform, capable of meeting the evolvingneeds of the scientific community. The ongoing collaboration with ORNL’s INTERSECT initiative and theplanned technology refreshes underscore ACE’s commitment to maintaining its leadership in HPC.
Funding Information
  • USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
  • DOE (AC05-00OR22725)

This publication has 9 references indexed in Scilit: