Dependence-aware Slice Execution to Boost MLP in Slice-out-of-order Cores
Authors:
Open Access
- 7 March 2022
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 19 (2) , 1-28
Abstract
Exploiting memory-level parallelism (MLP) is crucial to hide long memory and last-level cache access latencies. While out-of-order (OoO) cores, and techniques building on them, are effective at exploiting MLP, they deliver poor energy efficiency due to their complex and energy-hungry hardware. This work revisits slice-out-of-order (sOoO) cores as an energy-efficient alternative for MLP exploitation. sOoO cores achieve energy efficiency by constructing and executing slices of MLP-generating instructions out-of-order only with respect to the rest of instructions; the slices and the remaining instructions, by themselves, execute in-order. However, we observe that existing sOoO cores miss significant MLP opportunities due to their dependence-oblivious in-order slice execution, which causes dependent slices to frequently block MLP generation. To boost MLP generation, we introduce Freeway, a sOoO core based on a new dependence-aware slice execution policy that tracks dependent slices and keeps them from blocking subsequent independent slices and MLP extraction. The proposed core incurs minimal area and power overheads, yet approaches the MLP benefits of fully OoO cores. Our evaluation shows that Freeway delivers 12% better performance than the state-of-the-art sOoO core and is within 7% of the MLP limits of full OoO execution.Keywords
Funding Information
- Knut and Alice Wallenberg Foundation through the Wallenberg Academy Fellows Program
- European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation program (715283)
- Research Council of Norway (302279)
This publication has 42 references indexed in Scilit:
- An Evaluation of High-Level Mechanistic Core ModelsACM Transactions on Architecture and Code Optimization, 2014
- Towards more efficient execution2013
- Sniper2011
- Pin2005
- A study of source-level compiler algorithms for automatic construction of pre-execution codeACM Transactions on Computer Systems, 2004
- Automatically characterizing large scale program behavior2002
- Slice-processors2001
- Improving data cache performance by pre-executing instructions under a cache miss1997
- Hitting the memory wallACM SIGARCH Computer Architecture News, 1995
- Improving direct-mapped cache performance by the addition of a small fully-associative cache and prefetch buffers1990