A performance study of software and hardware data prefetching schemes
Authors:
Open Access
- 1 April 1994
- journal article
- Published by Association for Computing Machinery (ACM) in ACM SIGARCH Computer Architecture News
- Vol. 22 (2) , 223-232
Abstract
Prefetching, i.e., exploiting the overlap of processor computations with data accesses, is one of several approaches for tolerating memory latencies. Prefetching can be either hardware-based or software-directed or a combination of both. Hardware-based prefetching, requiring some support unit connected to the cache, can dynamically handle prefetches at run-time without compiler intervention. Software-directed approaches rely on compiler technology to insert explicit prefetch instructions. Mowry et al.'s software scheme [13, 14] and our hardware approach [1] are two representative schemes.In this paper, we evaluate approximations to these two schemes in the context of a shared-memory multiprocessor environment. Our qualitative comparisons indicate that both schemes are able to reduce cache misses in the domain of linear array references. When complex data access patterns are considered, the software approach has compile-time information to perform sophisticated prefetching whereas the hardware scheme has the advantage of manipulating dynamic information. The performance results from an instruction-level simulation of four benchmarks confirm these observations. Our simulations show that the hardware scheme introduces more memory traffic into the network and that the software scheme introduces a non-negligible instruction execution overhead. An approach combining software and hardware schemes is proposed; it shows promise in reducing the memory latency with least overhead.Keywords
This publication has 13 references indexed in Scilit:
- Design and evaluation of a compiler algorithm for prefetching1992
- SPLASHACM SIGARCH Computer Architecture News, 1992
- Tolerating latency through software-controlled prefetching in shared-memory multiprocessorsJournal of Parallel and Distributed Computing, 1991
- Data prefetching in multiprocessor vector cache memories1991
- An architecture for software-controlled data prefetching1991
- An effective on-chip preloading scheme to reduce data access penalty1991
- A data locality optimizing algorithm1991
- Improving direct-mapped cache performance by the addition of a small fully-associative cache and prefetch buffers1990
- Cache MemoriesACM Computing Surveys, 1982
- A New Solution to Coherence Problems in Multicache SystemsIEEE Transactions on Computers, 1978