Disaggregated Memory in the Datacenter: A Survey
Open Access
- 28 February 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 20688-20712
Abstract
Datacenters of today have maintained the same architecture for decades. The building block of the datacenter remains the server, which tightly couples the necessary compute resources, memory, and storage to run its tasks. However, this traditional approach suffers from under-utilization of its resources, often caused by the over-provisioning of these resources when deploying applications. Datacenter operators allocate the worst-case amount of memory required for each deployed application, which lasts for the entirety of the application’s lifetime, even when not actually used. This causes servers to quickly, and falsely, run out of memory before their CPUs have been fully utilized. To address these problems, a new shift in the way datacenters are being built has been gaining more traction. Namely, memory disaggregation. Memory disaggregation can address these problems by decoupling the computational elements from the memory resources, allowing each to be provisioned and utilized separately. While the idea of memory disaggregation is not new, an increasing number of different proposals of memory disaggregation have seen the light in recent years. In this paper, we review many of these recent proposals, and study their architectures, implementations, and requirements. We also categorize them based on their features, and attempt to identify their strengths and shortcomings in an effort to highlight possible directions for future work and provide a reference for the research community.Keywords
Funding Information
- Alibaba Innovative Research Agreement
This publication has 66 references indexed in Scilit:
- Turning Centralized Coherence and Distributed Critical-Section Execution on their Head2015
- Workload Estimation for Improving Resource Management Decisions in the Cloud2015
- Collaborative Memories in Clusters: Opportunities and Challenges2014
- DVM: A Big Virtual Machine for Cloud ComputingIEEE Transactions on Computers, 2013
- x86-TSOCommunications of the ACM, 2010
- Disaggregated memory for expansion and sharing in blade serversACM SIGARCH Computer Architecture News, 2009
- Hitting the memory wallACM SIGARCH Computer Architecture News, 1995
- The directory-based cache coherence protocol for the DASH multiprocessorACM SIGARCH Computer Architecture News, 1990
- Memory coherence in shared virtual memory systemsACM Transactions on Computer Systems, 1989
- Memory access buffering in multiprocessorsACM SIGARCH Computer Architecture News, 1986