Abstract
Virtual memory is essential for modern GPUs, yet address translation remains a major bottleneck. In irregular workloads, frequent TLB misses and costly page table walks (PTWs) dominate memory latency. We propose C ompute U nit P age T able W alk (cuPTW), which repurposes idle GPU compute resources to accelerate PTWs. By offloading requests to idle functional units, cuPTW transforms address translation into a massively parallel task. We further optimize this with cuPTW-SW, which caches walks in local data store (LDS) memory, and cuPTW-MT, which parallelizes walks across SIMD lanes. Evaluation shows that cuPTW-Full achieves a 4.43× average speedup (up to 76.09×) and improves PTW throughput by 9.92×. Compared to state-of-the-art designs, Marching Page Walks and SnakeByte, cuPTW-Full delivers a 2.08× and 1.97× performance gain, respectively.
Funding Information
  • National Natural Science Foundation of China (62402411)
  • CCF-Phytium Fund (CCF-Phytium202302)
  • Guangdong Provincial Project (2023QN10X252)

This publication has 2 references indexed in Scilit: