Kill the Program Counter
Open Access
- 4 April 2017
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 737-749
Abstract
Data prefetching and cache replacement algorithms have been intensively studied in the design of high performance microprocessors. Typically, the data prefetcher operates in the private caches and does not interact with the replacement policy in the shared Last-Level Cache (LLC). Similarly, most replacement policies do not consider demand and prefetch requests as different types of requests. In particular, program counter (PC)-based replacement policies cannot learn from prefetch requests since the data prefetcher does not generate a PC value. PC-based policies can also be negatively affected by compiler optimizations. In this paper, we propose a holistic cache management technique called Kill-the-PC (KPC) that overcomes the weaknesses of traditional prefetching and replacement policy algorithms. KPC cache management has three novel contributions. First, a prefetcher which approximates the future use distance of prefetch requests based on its prediction confidence. Second, a simple replacement policy provides similar or better performance than current state-of-the-art PC-based prediction using global hysteresis. Third, KPC integrates prefetching and replacement policy into a whole system which is greater than the sum of its parts. Information from the prefetcher is used to improve the performance of the replacement policy and vice-versa. Finally, KPC removes the need to propagate the PC through entire on-chip cache hierarchy while providing a holistic cache management approach with better performance than state-of-the-art PC-, and non-PC-based schemes. Our evaluation shows that KPC provides 8% better performance than the best combination of existing prefetcher and replacement policy for multi-core workloads.Keywords
Funding Information
- National Science Foundation (CCF-1320074 and I/UCRC-1439722)
This publication has 31 references indexed in Scilit:
- SparkBench2015
- Mitigating Prefetcher-Caused Pollution Using Informed Caching Policies for Prefetched BlocksACM Transactions on Architecture and Code Optimization, 2015
- B-Fetch: Branch Prediction Directed Prefetching for Chip-Multiprocessors2014
- Insertion and promotion for tree-based PseudoLRU last-level caches2013
- ARIACM Transactions on Architecture and Code Optimization, 2013
- Clearing the clouds2012
- Using SimPoint for accurate and efficient simulation2003
- Dead-block prediction & dead-block correlating prefetchers2001
- Hitting the memory wallACM SIGARCH Computer Architecture News, 1995
- An effective on-chip preloading scheme to reduce data access penalty1991