EGCR: an enhanced graph neural network for cache replacement
Authors:
- 9 February 2024
- conference paper
- Published by SPIE-Intl Soc Optical Eng
- Vol. 13073, 62-81
Abstract
Caching is a fundamental strategy in computer systems to minimize latency and enhance performance, crucial for achieving optimal program execution speed. The Cache Hit Ratio is a key metric, emphasizing the critical role of cache hits, which are significantly faster than misses. The challenge lies in efficient cache replacement strategies, determining which cache line to evict when introducing a new line. Current policies, often based on heuristics for common access patterns, fall short in diverse scenarios. In response, this paper introduces EGCR (Enhanced Graph Neural Network for Cache Replacement), a pioneering model integrating Graph Neural Networks (GNN) to intelligently adapt to varying workloads and enhance the Cache Hit Ratio. EGCR introduces a graph-based representation for cache-related data, dynamically learning to respond effectively to intricate access patterns. In empirical evaluations, EGCR consistently outperforms the current state of the art, demonstrating a remarkable 36% improvement in cache hit rates across 13 memory-intensive SPEC applications. This positions EGCR as a promising solution, effectively bridging traditional heuristics and the potential of GNNs for optimized Cache Hit Ratios in dynamic computing environments.Keywords
This publication has 9 references indexed in Scilit:
- GNN-GM: A Proactive Caching Scheme for Named Data Networking2022
- A GNN-based Approach to Optimize Cache Hit Ratio in NDN Networks2021
- Proceedings of the 52nd Annual IEEE/ACM International Symposium on Microarchitecture2019
- Back to the futureACM SIGARCH Computer Architecture News, 2016
- Characterizing Facebook's Memcached WorkloadIEEE Internet Computing, 2013
- Cache replacement based on reuse-distance prediction2007
- Adaptive insertion policies for high performance cachingACM SIGARCH Computer Architecture News, 2007
- SPEC CPU2006 benchmark descriptionsACM SIGARCH Computer Architecture News, 2006
- A study of replacement algorithms for a virtual-storage computerIBM Systems Journal, 1966