Lining up Garbage Collection and Application for a Far-Memory-Friendly Runtime
Open Access
- 25 August 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Computer Systems
- Vol. 43 (3) , 1-32
Abstract
Far-memory techniques that enable applications to use remote memory are increasingly appealing in modern data centers, supporting applications’ large memory footprint and improving machines’ resource utilization. Unfortunately, most far-memory techniques focus on OS-level optimizations and are agnostic to managed runtimes and garbage collections (GC) underneath applications written in high-level languages. With different object-access patterns from applications, GC can severely interfere with existing far-memory techniques, breaking remote memory prefetching algorithms and causing severe local-memory misses. We developed MemLiner, a runtime technique that improves the performance of far-memory systems by aligning memory accesses from application and GC threads so that they follow similar memory access paths, thereby (1) reducing the local-memory working set and (2) improving remote-memory prefetching through simplified memory access patterns. We implemented MemLiner in two widely used GCs in OpenJDK: G1 and Shenandoah. Our evaluation with a range of widely deployed cloud systems shows that MemLiner improves applications’ end-to-end performance by up to 3.3× and reduces applications’ tail latency by up to 220.0× .Keywords
Funding Information
- National Key Research and Development Program of China (2024YFE0204100)
This publication has 17 references indexed in Scilit:
- Tolerating Faults in Disaggregated Datacenters2017
- Attack of the killer microsecondsCommunications of the ACM, 2017
- Demystifying cloud benchmarking2016
- Interruptible tasks2015
- The RAMCloud Storage SystemACM Transactions on Computer Systems, 2015
- The Machine2015
- PIM-enabled instructions2015
- System-level implications of disaggregated memory2012
- The pauseless GC algorithm2005
- Garbage-first garbage collection2004