The Entangling Instruction Prefetcher
Open Access
- 16 June 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Architecture Letters
- Vol. 19 (2) , 84-87
Abstract
Prefetching instructions in the instruction cache is a fundamental technique for designing high-performance computers. There are three key properties to consider when designing an efficient and effective prefetcher: timeliness, coverage, and accuracy. Timeliness is an essential property of a prefetcher. Bringing instructions too early increases the risk of the instructions being evicted from the cache before their use and requesting them too late can lead to the instructions arriving past their designated execution time. Coverage is important to reduce the number of instruction cache misses (there is enough prefetching), and accuracy to ensure that the prefetcher does not pollute the cache or interacts negatively with the other hardware mechanisms (there is not too much prefetching). This paper presents the Entangling Prefetcher for Instructions (EPI) that entangles instructions to provide timeliness. The prefetcher works by finding which instruction should trigger the prefetch for a subsequent instruction, accounting for the latency of each cache miss. The prefetcher is carefully adjusted to account for both coverage and accuracy. Our evaluation shows that EPI increases performance by 29.3% on average, with a coverage of 94.9% and accuracy of 77.4%.Keywords
Funding Information
- European Research Council (819134)
- Ramón y Cajal Research (RYC2018-025200-I)
This publication has 6 references indexed in Scilit:
- The Entangling Instruction PrefetcherIEEE Computer Architecture Letters, 2020
- Divide and Conquer Frontend Bottleneck2020
- A Primer on Hardware PrefetchingSynthesis Lectures on Computer Architecture, 2014
- RDIP2013
- Proactive instruction fetch2011
- Microprocessor Architecture2009