COBRRA: COntention-aware cache Bypass with Request-Response Arbitration
Open Access
- 10 January 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Embedded Computing Systems
- Vol. 23 (1) , 1-30
Abstract
In modern multi-processor systems-on-chip (MPSoCs), requests from different processor cores, accelerators, and their responses from the lower-level memory contend for the shared cache bandwidth, making it a critical performance bottleneck. Prior research on shared cache management has considered requests from cores but has ignored crucial contributions from their responses. Prior cache bypass techniques focused on data reuse and neglected the system-level implications of shared cache contention. We propose COBRRA, a novel shared cache controller policy that mitigates the contention by aggressively bypassing selected responses from the lower-level memory and scheduling the remaining requests and responses to the cache efficiently. COBRRA is able to improve the average performance of a set of 15 SPEC workloads by 49% and 33% compared to the no-bypass baseline and the best-performing state-of-the-art bypass solution, respectively. Furthermore, COBRRA reduces the overall cache energy consumption by 38% and 31% compared to the no-bypass baseline and the most energy-efficient state-of-the-art bypass solution, respectively.Keywords
This publication has 46 references indexed in Scilit:
- Bandwidth-Aware On-Line Scheduling in SMT MulticoresIEEE Transactions on Computers, 2015
- SBAC2014
- Creating heterogeneity at run time by dynamic cache and bandwidth partitioning schemes2014
- OAP: An Obstruction-Aware Cache Management Policy for STT-RAM Last-Level Caches2013
- Improving Cache Management Policies Using Dynamic Reuse Distances2012
- Optimal bypass monitor for high performance last-level caches2012
- The gem5 simulatorACM SIGARCH Computer Architecture News, 2011
- Balancing thoughput and fairness in SMT processors2005
- Exploring high bandwidth pipelined cache architecture for scaled technology2003
- Memory access schedulingACM SIGARCH Computer Architecture News, 2000