Ricardo Bianchini
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ricardo Bianchini has a total of 83 co-authors. Here are the top co-authors by number of shared publications:
- Rodrigo Fonseca
Microsoft Corporation, Redmond, WA, USA
9 shared publications - Íñigo Goiri
Microsoft, Redmond, USA
8 shared publications - Esha Choukse
Microsoft, Redmond, USA
6 shared publications - Chaojie Zhang
Microsoft Corporation, Redmond, WA, USA
5 shared publications - Daniel S. Berger
Microsoft and University of Washington, Redmond, USA
5 shared publications - Celine Irvene
Microsoft, USA
4 shared publications
Latest Publications
- Open Access
- 15 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 2203-2215
Workload Intelligence: Workload-Aware IaaS abstraction for Cloud Efficiency
- 15 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 2203-2215
Open AccessWorkload Intelligence: Workload-Aware IaaS abstraction for Cloud Efficiency
- Open Access
- 13 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 81-86
Intent-based System Design and Operation
- 13 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 81-86
Open AccessIntent-based System Design and Operation
- Open Access
- 11 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 98-105
Cloud abstractions for AI workloads
- 11 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 98-105
Open AccessCloud abstractions for AI workloads
- Top Cited Papers
- 5 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 45 (4) , 54-59
Splitwise: Efficient Generative LLM Inference Using Phase Splitting
Generative Large Language Model (LLM) applications are rapidly growing, leading to widespread deployment of expensive, power-hungry GPUs. Growing power demands of AI in the cloud industry has become a global problem [5]. Our analysis shows that LLM inference involves two distinct phases: a compute-intensive prefill phase and a memory-intensive decode phase, each with different resource needs. Running them together introduces inefficient scheduling. Furthermore, unlike prefill phase, the decode phase can run on lower-cost and lowerpower hardware. Building on these insights, we propose Splitwise, a scheduling technique that splits prefill and decode phases across different machines to achieve better throughput. Additionally, Splitwise allows phase-specific hardware optimization. By efficiently transferring request state between machines, Splitwise achieves up to 2.35× more throughput within the same power and cost budgets, or 1.4× higher throughput at 20% lower cost and same power.
- 5 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 45 (4) , 54-59
Top Cited PapersSplitwise: Efficient Generative LLM Inference Using Phase Splitting
Generative Large Language Model (LLM) applications are rapidly growing, leading to widespread deployment of expensive, power-hungry GPUs. Growing power demands of AI in the cloud industry has become a global problem [5]. Our analysis shows that LLM inference involves two distinct phases: a compute-intensive prefill phase and a memory-intensive decode phase, each with different resource needs. Running them together introduces inefficient scheduling. Furthermore, unlike prefill phase, the decode phase can run on lower-cost and lowerpower hardware. Building on these insights, we propose Splitwise, a scheduling technique that splits prefill and decode phases across different machines to achieve better throughput. Additionally, Splitwise allows phase-specific hardware optimization. By efficiently transferring request state between machines, Splitwise achieves up to 2.35× more throughput within the same power and cost budgets, or 1.4× higher throughput at 20% lower cost and same power.
- 23 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 45 (4) , 19-28
Enabling Sustainable Cloud Computing With Low-Carbon Server Design
To combat climate change, we must reduce carbon emissions from hyperscale cloud computing. We find that compute servers cause the majority of a general-purpose cloud’s emissions. Thus, we motivate designing carbon-efficient compute server Stock Keeping Units (SKUs), or GreenSKUs, using recently-available low-carbon components. We build three GreenSKU prototypes, integrating energy-efficient CPUs, reused old DRAM via CXL, and reused old SSDs. We reveal challenges that limit GreenSKUs’ carbon savings at scale and may prevent their adoption by cloud providers. To address these challenges, we develop a novel framework, GSF (GreenSKU Framework), that enables cloud providers to systematically evaluate GreenSKUs’ carbon savings at scale. By implementing GSF within Microsoft Azure’s production constraints, we demonstrate that GreenSKUs reduce net cloud emissions by 8%, which is globally significant. This work is the first to demonstrate and quantify how carbon-efficient server designs translate to measurable cloud-scale emissions reductions, enabling meaningful contributions to cloud sustainability goals.
- 23 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 45 (4) , 19-28
Enabling Sustainable Cloud Computing With Low-Carbon Server Design
To combat climate change, we must reduce carbon emissions from hyperscale cloud computing. We find that compute servers cause the majority of a general-purpose cloud’s emissions. Thus, we motivate designing carbon-efficient compute server Stock Keeping Units (SKUs), or GreenSKUs, using recently-available low-carbon components. We build three GreenSKU prototypes, integrating energy-efficient CPUs, reused old DRAM via CXL, and reused old SSDs. We reveal challenges that limit GreenSKUs’ carbon savings at scale and may prevent their adoption by cloud providers. To address these challenges, we develop a novel framework, GSF (GreenSKU Framework), that enables cloud providers to systematically evaluate GreenSKUs’ carbon savings at scale. By implementing GSF within Microsoft Azure’s production constraints, we demonstrate that GreenSKUs reduce net cloud emissions by 8%, which is globally significant. This work is the first to demonstrate and quantify how carbon-efficient server designs translate to measurable cloud-scale emissions reductions, enabling meaningful contributions to cloud sustainability goals.
- Open Access
- 14 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 218-224
Towards Resource-Efficient Compound AI Systems
- 14 May 2025
- Published by Association for Computing Machinery (ACM)
- p. 218-224
Open AccessTowards Resource-Efficient Compound AI Systems
- Top Cited PapersOpen Access
- 30 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 1266-1281
TAPAS: Thermal- and Power-Aware Scheduling for LLM Inference in Cloud Platforms
- 30 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 1266-1281
Top Cited PapersOpen AccessTAPAS: Thermal- and Power-Aware Scheduling for LLM Inference in Cloud Platforms
- Open Access
- 30 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 164-181
Coach: Exploiting Temporal Patterns for All-Resource Oversubscription in Cloud Platforms
Cloud platforms remain underutilized despite multiple proposals to improve their utilization (e.g., disaggregation, harvesting, and oversubscription). Our characterization of the resource utilization of virtual machines (VMs) in Azure reveals that, while CPU is the main underutilized resource, we need to provide a solution to manage all resources holistically. We also observe that many VMs exhibit complementary temporal patterns, which can be leveraged to improve the oversubscription of underutilized resources. Based on these insights, we propose Coach: a system that exploits temporal patterns for all-resource oversubscription in cloud platforms. Coach uses long-term predictions and an efficient VM scheduling policy to exploit temporally complementary patterns. We introduce a new general-purpose VM type, called CoachVM, where we partition each resource allocation into a guaranteed and an oversubscribed portion. Coach monitors the oversubscribed resources to detect contention and mitigate any potential performance degradation. We focus on memory management, which is particularly challenging due to memory's sensitivity to contention and the overhead required to reassign it between CoachVMs. Our experiments show that Coach enables platforms to host up to ~26% more VMs with minimal performance degradation.
- 30 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 164-181
Open AccessCoach: Exploiting Temporal Patterns for All-Resource Oversubscription in Cloud Platforms
Cloud platforms remain underutilized despite multiple proposals to improve their utilization (e.g., disaggregation, harvesting, and oversubscription). Our characterization of the resource utilization of virtual machines (VMs) in Azure reveals that, while CPU is the main underutilized resource, we need to provide a solution to manage all resources holistically. We also observe that many VMs exhibit complementary temporal patterns, which can be leveraged to improve the oversubscription of underutilized resources. Based on these insights, we propose Coach: a system that exploits temporal patterns for all-resource oversubscription in cloud platforms. Coach uses long-term predictions and an efficient VM scheduling policy to exploit temporally complementary patterns. We introduce a new general-purpose VM type, called CoachVM, where we partition each resource allocation into a guaranteed and an oversubscribed portion. Coach monitors the oversubscribed resources to detect contention and mitigate any potential performance degradation. We focus on memory management, which is particularly challenging due to memory's sensitivity to contention and the overhead required to reassign it between CoachVMs. Our experiments show that Coach enables platforms to host up to ~26% more VMs with minimal performance degradation.
- Open Access
- 19 November 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (6) , 1-20
Dense Server Design for Immersion Cooling
The growing demands for computational power in cloud computing have led to a significant increase in the deployment of high-performance servers. The growing power consumption of servers and the heat they produce is on track to outpace the capacity of conventional air cooling systems, necessitating more efficient cooling solutions such as liquid immersion cooling. The superior heat exchange capabilities of immersion cooling both eliminates the need for bulky heat sinks, fans, and air flow channels while also unlocking the potential go beyond conventional 2D blade servers to three-dimensional designs. In this work, we present a computational framework to explore designs of servers in three-dimensional space, specifically targeting the maximization of server density within immersion cooling tanks. Our tool is designed to handle a variety of physical and electrical server design constraints. We demonstrate our optimized designs can reduce server volume by 25--52% compared to traditional flat server designs. This increased density reduces land usage as well as the amount of liquid used for immersion, with significant reduction in the carbon emissions embodied in datacenter buildings. We further create physical prototypes to simulate dense server designs and perform real-world experiments in an immersion cooling tank demonstrating they operate at safe temperatures. This approach marks a critical step forward in sustainable and efficient datacenter management.
- 19 November 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Graphics
- Vol. 43 (6) , 1-20
Open AccessDense Server Design for Immersion Cooling
The growing demands for computational power in cloud computing have led to a significant increase in the deployment of high-performance servers. The growing power consumption of servers and the heat they produce is on track to outpace the capacity of conventional air cooling systems, necessitating more efficient cooling solutions such as liquid immersion cooling. The superior heat exchange capabilities of immersion cooling both eliminates the need for bulky heat sinks, fans, and air flow channels while also unlocking the potential go beyond conventional 2D blade servers to three-dimensional designs. In this work, we present a computational framework to explore designs of servers in three-dimensional space, specifically targeting the maximization of server density within immersion cooling tanks. Our tool is designed to handle a variety of physical and electrical server design constraints. We demonstrate our optimized designs can reduce server volume by 25--52% compared to traditional flat server designs. This increased density reduces land usage as well as the amount of liquid used for immersion, with significant reduction in the carbon emissions embodied in datacenter buildings. We further create physical prototypes to simulate dense server designs and perform real-world experiments in an immersion cooling tank demonstrating they operate at safe temperatures. This approach marks a critical step forward in sustainable and efficient datacenter management.
- 12 July 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 44 (5) , 30-36
Data Center Power and Energy Management: Past, Present, and Future
This paper overviews some of the key past developments in cloud datacenter power and energy management, where we are today, and what the future could be. This topic is gaining enormous, renewed interest in the context of the conflicting needs of the AI revolution and the climate crisis.
- 12 July 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 44 (5) , 30-36
Data Center Power and Energy Management: Past, Present, and Future
This paper overviews some of the key past developments in cloud datacenter power and energy management, where we are today, and what the future could be. This topic is gaining enormous, renewed interest in the context of the conflicting needs of the AI revolution and the climate crisis.