Run-time cache bypassing
Authors:
- 1 January 1999
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computers
- Vol. 48 (12) , 1338-1354
Abstract
The growing disparity between processor and memory performance has made cache misses increasingly expensive. Additionally, data and instruction caches are not always used efficiently, resulting in large numbers of cache misses. Therefore, the importance of cache performance improvements at each level of the memory hierarchy will continue to grow. In numeric programs, there are several known compiler techniques for optimizing data cache performance. However, integer (nonnumeric) programs often have irregular access patterns that are more difficult for the compiler to optimize. In the past, cache management techniques such as cache bypassing were implemented manually at the machine-language-programming level. As the available chip area grows, it makes sense to spend more resources to allow intelligent control over the cache management. In this paper, we present an approach to improving cache effectiveness, taking advantage of the growing chip area, utilizing run-time adaptive cache management techniques, optimizing both performance and cost of implementation. Specifically, we are aiming to increase data cache effectiveness for integer programs. We propose a microarchitecture scheme where the hardware determines data placement within the cache hierarchy based on dynamic referencing behavior. This scheme is fully compatible with existing Instruction Set Architectures. This paper examines the theoretical upper bounds on the cache hit ratio that cache bypassing can provide for integer applications, including several Windows applications with OS activity. Then, detailed trace-driven simulations of the integer applications are used to show that the implementation described in this paper can achieve performance close to that of the upper bound.Keywords
This publication has 17 references indexed in Scilit:
- Utilizing reuse information in data cache management1998
- Compiler-based prefetching for recursive data structures1996
- SPAID: software prefetching in pointer- and call-intensive environments1995
- A modified approach to data cache management1995
- A data cache with multiple caching strategies tuned to different types of locality1995
- Predicting and precluding problems with memory latencyIEEE Micro, 1994
- Tolerating data access latency with register preloading1992
- An effective on-chip preloading scheme to reduce data access penalty1991
- Cache MemoriesACM Computing Surveys, 1982
- A study of replacement algorithms for a virtual-storage computerIBM Systems Journal, 1966