KMKetan Maheshwari

Ketan Maheshwari

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Ketan Maheshwari has a total of 259 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    OLCF’s Advanced Computing Ecosystem (ACE): FY25 Update for Ongoing Efforts

    by Brian Etz, Sarp Oral, Rafael Ferreira Da Silva, Ryan Adamson, Anees Al-Najjar, Tom Beck, Ashley Barker, Michael Brim, Paul Bryant, Christian Engelmann, et al.

  • Open Access

    Evaluating HPC Scheduling Strategies for Urgent Workloads

    by Ketan Maheshwari, Anderson Borch, Jordan Webb, Brian Etz, Ross Miller, Frédéric Suter, Sarp Oral, Rafael Ferreira da Silva


  • Open Access

    An LLM-enabled Workflow for Understanding and Evolving HPC Scheduling Practices

    by Anderson Borch, Ketan Maheshwari, Justin Wozniak, Rafael Ferreira da Silva

  • Open Access

    Bundled for Success: A WfBench-Driven Assessment of Texera

    by Meng Wang, Shiva Jahangiri, Ketan Maheshwari, Chen Li

  • Open Access

    Workflows for Science: A comprehensive guide for ensemble workflow tools usage with applications on OLCF systems

    by Antigoni Georgiadou, Oak Ridge Oak Ridge National Laboratory (Ornl), Henry Monge Camacho, Tanvir Sohail, Swarnava Ghosh, Dilip Asthagiri, Dmytro Bykov, Tushar Athawale, Mikhail Titov, Matteo Turilli, et al.

    The growing demand for robust computational and workflow environments for scientific applications and user communities at the Oak Ridge Leadership Computing Facility (OLCF) has prompted collaboration with ensemble tools development teams and facility users to produce this technical paper. We connect science applications to the RADICAL-Pilot (RP) workflow tool to execute ensemble instantiations using the Frontier supercomputer. The documented installation, usage, and execution demonstrates how RP streamlines scientific workflows at OLCF. We outline the specific steps OLCF users can follow to integrate this tool with their applications and advance their research. This document stands as a comprehensive guide to OLCF users of ensemble workflow tools with examples on real applications using the Frontier supercomputer.

  • Open Access

    OLCF’s Advanced Computing Ecosystem (ACE): FY24 Efforts for the DOE Integrated Research Infrastructure (IRI) Program

    by Sarp Oral, Rafael Ferreira Da Silva, Subil Abraham, Ryan Adamson, Valentine Anantharaj, Tom Beck, Ashley Barker, Katie Bethea, Joshua Brown, Michael Brim, et al.

    This report highlights significant strides made by Oak Ridge National Laboratory’s Oak Ridge LeadershipComputing Facility (OLCF) in advancing computational research and infrastructure. Through the AdvancedComputing Ecosystem (ACE) strategic initiative, OLCF has been successfully integrated with DOE’sIntegrated Research Infrastructure (IRI) program, establishing itself as a critical framework for enhancingscientific computing capabilities across various domains. This report outlines the activities, accomplishments,and future directions of ACE, emphasizing its role in developing cutting-edge technologies, supportingscience pilots, and fostering collaborations that drive scientific innovation.One of the key achievements of ACE in FY24 has been the establishment of a robust testbed environmentthat facilitates the development and validation of new computing technologies. This testbed, integratedinto the larger IRI ecosystem through Energy Sciences Network (ESnet), allows for seamless collaborationamong DOE’s Advanced Scientific Computing Research (ASCR) facilities, including the Argonne LeadershipComputing Facility (ALCF), the National Energy Research Scientific Computing Center (NERSC), andJefferson Lab (JLab). The testbed has been instrumental in enabling science pilots to experiment withinnovative methodologies in a controlled environment, thereby accelerating the translation of research intopractical applications.ACE has been instrumental in advancing a series of science pilots using computational resources fromOLCF. These pilots span a wide range of scientific domains, from basic energy sciences to biological andenvironmental research, demonstrating the versatility and impact of the ACE framework. By integratingcutting-edge technologies, such as AI-driven analytics and real-time data processing, with HPC, these pilotshave enabled significant advancements in scientific workflows. For instance, projects like LCLStreamand DELERIA have showcased the potential of ACE in optimizing experimental designs, acceleratingdata analysis, and driving innovations that are critical for addressing some of the most complex scientificchallenges of IRI pathfinder projects.ACE has also made significant progress in foundational technology development, particularly in areas suchas data movement, interface design, and scheduling. These advancements have been key in addressingthe complex requirements of modern scientific workflows, ensuring that OLCF remains at the forefront ofhigh-performance computing (HPC). The report details several ongoing projects, including the developmentof the OLCF Facility API, Data Streaming technologies, and the Zambeze distributed orchestration system,which together provide a secure and flexible framework for managing computational resources across adistributed infrastructure.In addition to technical achievements, ACE has played a central role in outreach and engagement activi-ties. Through participation in conferences, hackathons, and training sessions, the ACE team has activelycontributed to the broader scientific community. These efforts have not only facilitated the exchange ofknowledge but have also strengthened collaborations with other DOE facilities and research institutions,further enhancing the impact of the ACE program.Looking ahead, the report outlines strategic plans for FY25, which include continued support for sciencepilots, further integration with ASCR facilities, and the exploration of new technologies. These initiatives aredesigned to ensure that ACE remains a dynamic and adaptable platform, capable of meeting the evolvingneeds of the scientific community. The ongoing collaboration with ORNL’s INTERSECT initiative and theplanned technology refreshes underscore ACE’s commitment to maintaining its leadership in HPC.


  • Open Access

    Workflows Community Summit 2024: Future Trends and Challenges in Scientific Workflows

    by Rafael Ferreira Da Silva, Usdoe, Deborah Bard, Kyle Chard, Shaun De Witt, Ian Foster, Tom Gibbs, Carole Goble, William Godoy, Johan Gustafsson, et al.

    The 2024 Workflows Community Summit report presents the outcomes of a three-day international gathering that brought together 109 experts from 18 countries to discuss future trends and challenges in scientific workflows. The summit focused on six key areas: time-sensitive workflows, convergence of AI and HPC workflows, multi-facility workflows, heterogeneous HPC environments, user experience and interfaces, and FAIR computational workflows. Discussions highlighted emerging challenges such as integrating AI with traditional HPC, managing workflows across diverse facilities, addressing heterogeneity in computing environments, and ensuring workflows are findable, accessible, interoperable, and reusable (FAIR). The report outlines recent advances, ongoing challenges, and provides recommendations for each topic area, emphasizing the need for standardization, improved interoperability, and the development of more sophisticated tools and frameworks to support the evolving landscape of scientific workflows in the era of exascale computing and AI integration.


  • Open Access

    Evaluating the Cloud for Capability Class Leadership Workloads

    by Jack Lange, Thomas Papatheodore, Todd Thomas, Chad Effler, Aaron Haun, Carlos Cunningham, Kyle Fenske, Rafael Ferreira Da Silva, Ketan Maheshwari, Junqi Yin, et al.

    The U.S. Department of Energy's Office of Scientific and Technical Information


  • Open Access

    Workflows Community Summit 2022: A Roadmap Revolution

    by Rafael Ferreira Da Silva, Rosa Badia, Venkat Bala, Deborah Bard, Peer-Timo Bremer, Ian Buckley, Silvina Caino-Lores, Kyle Chard, Carole Goble, Shantenu Jha, et al.

    Scientific workflows have become integral tools in broad scientific computing use cases. Science discovery is increasingly dependent on workflows to orchestrate large and complex scientific experiments that range from execution of a cloud-based data preprocessing pipeline to multi-facility instrument-to-edge-to-HPC computational workflows. Given the changing landscape of scientific computing (often referred to as a computing continuum) and the evolving needs of emerging scientific applications, it is paramount that the development of novel scientific workflows and system functionalities seek to increase the efficiency, resilience, and pervasiveness of existing systems and applications. Specifically, the proliferation of machine learning/artificial intelligence (ML/AI) workflows, need for processing large scale datasets produced by instruments at the edge, intensification of near real-time data processing, support for long-term experiment campaigns, and emergence of quantum computing as an adjunct to HPC, have significantly changed the functional and operational requirements of workflow systems. Workflow systems now need to, for example, support data streams from the edge-to-cloud-to-HPC enable the management of many small-sized files, allow data reduction while ensuring high accuracy, orchestrate distributed services (workflows, instruments, data movement, provenance, publication, etc.) across computing and user facilities, among others. Further, to accelerate science, it is also necessary that these systems implement specifications/standards and APIs for seamless (horizontal and vertical) integration between systems and applications, as well as enabling the publication of workflows and their associated products according to the FAIR principles.This document reports on discussions and findings from the 2022 international edition of the Workflows Community Summit that took place on November 29 and 30, 2022. The two-day summit included 106 participants, from a group of international researchers and developers (Australia, Austria, Belgium, Brazil, Canada, Colombia, Egypt, France, Germany, Italy, Japan, Netherlands, Norway, Poland, Spain, Switzerland, United Kingdom, United States) from distinct workflow management systems and users, and representatives from funding agencies and industry.