cuPTW: Leveraging Idle Compute Units for Massively Parallel GPU Page Table Walks
Open Access
- 20 July 2026
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGMETRICS Performance Evaluation Review
- Vol. 54 (1) , 126-128
Abstract
Virtual memory is essential for modern GPUs, yet address translation remains a major bottleneck. In irregular workloads, frequent TLB misses and costly page table walks (PTWs) dominate memory latency. We propose C ompute U nit P age T able W alk (cuPTW), which repurposes idle GPU compute resources to accelerate PTWs. By offloading requests to idle functional units, cuPTW transforms address translation into a massively parallel task. We further optimize this with cuPTW-SW, which caches walks in local data store (LDS) memory, and cuPTW-MT, which parallelizes walks across SIMD lanes. Evaluation shows that cuPTW-Full achieves a 4.43× average speedup (up to 76.09×) and improves PTW throughput by 9.92×. Compared to state-of-the-art designs, Marching Page Walks and SnakeByte, cuPTW-Full delivers a 2.08× and 1.97× performance gain, respectively.Keywords
Funding Information
- National Natural Science Foundation of China (62402411)
- CCF-Phytium Fund (CCF-Phytium202302)
- Guangdong Provincial Project (2023QN10X252)
This publication has 2 references indexed in Scilit: