Rodrigo Fonseca
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Rodrigo Fonseca has a total of 77 co-authors. Here are the top co-authors by number of shared publications:
- Ricardo Bianchini
Microsoft Corporation, Redmond, WA, USA
9 shared publications - Íñigo Goiri
Microsoft, Redmond, USA
7 shared publications - Esha Choukse
Microsoft, Redmond, USA
6 shared publications - Chetan Bansal
Microsoft, Redmond, Washington, USA
5 shared publications - Chaojie Zhang
Microsoft Corporation, Redmond, WA, USA
4 shared publications - Daniel S. Berger
Microsoft and University of Washington, Redmond, USA
4 shared publications
Latest Publications
- Open Access
- 14 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1212-1227
Unipool: Efficient Management of Pre-Provisioned Resources for Container Platforms
- 14 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1212-1227
Open AccessUnipool: Efficient Management of Pre-Provisioned Resources for Container Platforms
- Open Access
- 19 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 817-830
M od S erve : Modality- and Stage-Aware Resource Disaggregation for Scalable Multimodal Model Serving
- 19 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 817-830
Open AccessM od S erve : Modality- and Stage-Aware Resource Disaggregation for Scalable Multimodal Model Serving
- Open Access
- 15 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 2203-2215
Workload Intelligence: Workload-Aware IaaS abstraction for Cloud Efficiency
- 15 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 2203-2215
Open AccessWorkload Intelligence: Workload-Aware IaaS abstraction for Cloud Efficiency
- Open Access
- 13 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 81-86
Intent-based System Design and Operation
- 13 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 81-86
Open AccessIntent-based System Design and Operation
- Top Cited Papers
- 5 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 45 (4) , 54-59
Splitwise: Efficient Generative LLM Inference Using Phase Splitting
Generative Large Language Model (LLM) applications are rapidly growing, leading to widespread deployment of expensive, power-hungry GPUs. Growing power demands of AI in the cloud industry has become a global problem [5]. Our analysis shows that LLM inference involves two distinct phases: a compute-intensive prefill phase and a memory-intensive decode phase, each with different resource needs. Running them together introduces inefficient scheduling. Furthermore, unlike prefill phase, the decode phase can run on lower-cost and lowerpower hardware. Building on these insights, we propose Splitwise, a scheduling technique that splits prefill and decode phases across different machines to achieve better throughput. Additionally, Splitwise allows phase-specific hardware optimization. By efficiently transferring request state between machines, Splitwise achieves up to 2.35× more throughput within the same power and cost budgets, or 1.4× higher throughput at 20% lower cost and same power.
- 5 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 45 (4) , 54-59
Top Cited PapersSplitwise: Efficient Generative LLM Inference Using Phase Splitting
Generative Large Language Model (LLM) applications are rapidly growing, leading to widespread deployment of expensive, power-hungry GPUs. Growing power demands of AI in the cloud industry has become a global problem [5]. Our analysis shows that LLM inference involves two distinct phases: a compute-intensive prefill phase and a memory-intensive decode phase, each with different resource needs. Running them together introduces inefficient scheduling. Furthermore, unlike prefill phase, the decode phase can run on lower-cost and lowerpower hardware. Building on these insights, we propose Splitwise, a scheduling technique that splits prefill and decode phases across different machines to achieve better throughput. Additionally, Splitwise allows phase-specific hardware optimization. By efficiently transferring request state between machines, Splitwise achieves up to 2.35× more throughput within the same power and cost budgets, or 1.4× higher throughput at 20% lower cost and same power.
- 23 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 45 (4) , 19-28
Enabling Sustainable Cloud Computing With Low-Carbon Server Design
To combat climate change, we must reduce carbon emissions from hyperscale cloud computing. We find that compute servers cause the majority of a general-purpose cloud’s emissions. Thus, we motivate designing carbon-efficient compute server Stock Keeping Units (SKUs), or GreenSKUs, using recently-available low-carbon components. We build three GreenSKU prototypes, integrating energy-efficient CPUs, reused old DRAM via CXL, and reused old SSDs. We reveal challenges that limit GreenSKUs’ carbon savings at scale and may prevent their adoption by cloud providers. To address these challenges, we develop a novel framework, GSF (GreenSKU Framework), that enables cloud providers to systematically evaluate GreenSKUs’ carbon savings at scale. By implementing GSF within Microsoft Azure’s production constraints, we demonstrate that GreenSKUs reduce net cloud emissions by 8%, which is globally significant. This work is the first to demonstrate and quantify how carbon-efficient server designs translate to measurable cloud-scale emissions reductions, enabling meaningful contributions to cloud sustainability goals.
- 23 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 45 (4) , 19-28
Enabling Sustainable Cloud Computing With Low-Carbon Server Design
To combat climate change, we must reduce carbon emissions from hyperscale cloud computing. We find that compute servers cause the majority of a general-purpose cloud’s emissions. Thus, we motivate designing carbon-efficient compute server Stock Keeping Units (SKUs), or GreenSKUs, using recently-available low-carbon components. We build three GreenSKU prototypes, integrating energy-efficient CPUs, reused old DRAM via CXL, and reused old SSDs. We reveal challenges that limit GreenSKUs’ carbon savings at scale and may prevent their adoption by cloud providers. To address these challenges, we develop a novel framework, GSF (GreenSKU Framework), that enables cloud providers to systematically evaluate GreenSKUs’ carbon savings at scale. By implementing GSF within Microsoft Azure’s production constraints, we demonstrate that GreenSKUs reduce net cloud emissions by 8%, which is globally significant. This work is the first to demonstrate and quantify how carbon-efficient server designs translate to measurable cloud-scale emissions reductions, enabling meaningful contributions to cloud sustainability goals.
- Open Access
- 14 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 218-224
Towards Resource-Efficient Compound AI Systems
- 14 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 218-224
Open AccessTowards Resource-Efficient Compound AI Systems
- Top Cited PapersOpen Access
- 30 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 1266-1281
TAPAS: Thermal- and Power-Aware Scheduling for LLM Inference in Cloud Platforms
- 30 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 1266-1281
Top Cited PapersOpen AccessTAPAS: Thermal- and Power-Aware Scheduling for LLM Inference in Cloud Platforms
- Open Access
- 19 November 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (6) , 1-20
Dense Server Design for Immersion Cooling
The growing demands for computational power in cloud computing have led to a significant increase in the deployment of high-performance servers. The growing power consumption of servers and the heat they produce is on track to outpace the capacity of conventional air cooling systems, necessitating more efficient cooling solutions such as liquid immersion cooling. The superior heat exchange capabilities of immersion cooling both eliminates the need for bulky heat sinks, fans, and air flow channels while also unlocking the potential go beyond conventional 2D blade servers to three-dimensional designs. In this work, we present a computational framework to explore designs of servers in three-dimensional space, specifically targeting the maximization of server density within immersion cooling tanks. Our tool is designed to handle a variety of physical and electrical server design constraints. We demonstrate our optimized designs can reduce server volume by 25--52% compared to traditional flat server designs. This increased density reduces land usage as well as the amount of liquid used for immersion, with significant reduction in the carbon emissions embodied in datacenter buildings. We further create physical prototypes to simulate dense server designs and perform real-world experiments in an immersion cooling tank demonstrating they operate at safe temperatures. This approach marks a critical step forward in sustainable and efficient datacenter management.
- 19 November 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (6) , 1-20
Open AccessDense Server Design for Immersion Cooling
The growing demands for computational power in cloud computing have led to a significant increase in the deployment of high-performance servers. The growing power consumption of servers and the heat they produce is on track to outpace the capacity of conventional air cooling systems, necessitating more efficient cooling solutions such as liquid immersion cooling. The superior heat exchange capabilities of immersion cooling both eliminates the need for bulky heat sinks, fans, and air flow channels while also unlocking the potential go beyond conventional 2D blade servers to three-dimensional designs. In this work, we present a computational framework to explore designs of servers in three-dimensional space, specifically targeting the maximization of server density within immersion cooling tanks. Our tool is designed to handle a variety of physical and electrical server design constraints. We demonstrate our optimized designs can reduce server volume by 25--52% compared to traditional flat server designs. This increased density reduces land usage as well as the amount of liquid used for immersion, with significant reduction in the carbon emissions embodied in datacenter buildings. We further create physical prototypes to simulate dense server designs and perform real-world experiments in an immersion cooling tank demonstrating they operate at safe temperatures. This approach marks a critical step forward in sustainable and efficient datacenter management.
- Open Access
- 10 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 388-398
LM-PACE: Confidence Estimation by Large Language Models for Effective Root Causing of Cloud Incidents
Major cloud providers have employed advanced AI-based solutions like large language models to aid humans in identifying the root causes of cloud incidents. Even though AI-driven assistants are be- coming more common in the process of analyzing root causes, their usefulness in supporting on-call engineers is limited by their unstable accuracy. This limitation arises from the fundamental challenges of the task, the tendency of language model-based methods to produce hallucinate information, and the difficulty in distinguishing these well-disguised hallucinations. To address this challenge, we propose a novel confidence estimation method to assign reliable confidence scores to root cause recommendations, aiding on-call engineers in deciding whether to trust the model’s predictions. We made re- training-free confidence estimation on out-of-domain tasks possible via retrieval augmentation. To elicit better-calibrated confidence es- timates, we adopt a two-stage prompting procedure and a learnable transformation, which reduces the estimated calibration error (ECE) to 31% of the direct prompting baseline on a dataset comprising over 100,000 incidents from Microsoft. Additionally, we demonstrate that our method is applicable across various root cause prediction models. Our study takes an important move towards reliably and effectively embedding LLMs into cloud incident management systems
- 10 July 2024
- Published by Association for Computing Machinery (ACM)
- p. 388-398
Open AccessLM-PACE: Confidence Estimation by Large Language Models for Effective Root Causing of Cloud Incidents
Major cloud providers have employed advanced AI-based solutions like large language models to aid humans in identifying the root causes of cloud incidents. Even though AI-driven assistants are be- coming more common in the process of analyzing root causes, their usefulness in supporting on-call engineers is limited by their unstable accuracy. This limitation arises from the fundamental challenges of the task, the tendency of language model-based methods to produce hallucinate information, and the difficulty in distinguishing these well-disguised hallucinations. To address this challenge, we propose a novel confidence estimation method to assign reliable confidence scores to root cause recommendations, aiding on-call engineers in deciding whether to trust the model’s predictions. We made re- training-free confidence estimation on out-of-domain tasks possible via retrieval augmentation. To elicit better-calibrated confidence es- timates, we adopt a two-stage prompting procedure and a learnable transformation, which reduces the estimated calibration error (ECE) to 31% of the direct prompting baseline on a dataset comprising over 100,000 incidents from Microsoft. Additionally, we demonstrate that our method is applicable across various root cause prediction models. Our study takes an important move towards reliably and effectively embedding LLMs into cloud incident management systems