Cloud abstractions for AI workloads

Authors:
  • MCMarco Canini
    Marco Canini
  • TBTheophilus A. Benson
    Theophilus A. Benson
  • RBRicardo Bianchini
    Ricardo Bianchini
  • ÍGÍñigo Goiri
    Íñigo Goiri
  • DKDejan Kostić
    Dejan Kostić
  • PPPeter Pietzuch
    Peter Pietzuch
  • SPSimon Peter
    Simon Peter

Abstract
AI workloads, often hosted in multi-tenant cloud environments, require vast computational resources but suffer inefficiencies due to limited tenant-provider coordination. Tenants lack infrastructure insights, while providers lack workload details to optimize tasks like partitioning, scheduling, and fault tolerance. We propose HarmonAIze to redefine cloud abstractions, enabling cooperative optimization for improved performance, efficiency, resiliency, and sustainability. We outline key opportunities and challenges this vision faces.