Optimal Cache Partition-Sharing
Authors:
- Jacob BrockJBJacob Brock
- Chencheng YeCYChencheng Ye
- Chen DingCDChen Ding
- Yechen LiYLYechen Li
- Xiaolin WangXWXiaolin Wang
- Yingwei LuoYLYingwei Luo
- 1 September 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 01903918,p. 749-758
Abstract
When a cache is shared by multiple cores, its space may be allocated either by sharing, partitioning, or both. We call the last case partition-sharing. This paper studies partition-sharing as a general solution, and presents a theory an technique for optimizing partition-sharing. We present a theory and a technique to optimize partition sharing. The theory shows that the problem of partition-sharing is reducible to the problem of partitioning. The technique uses dynamic programming to optimize partitioning for overall miss ratio, and for two different kinds of fairness. Finally, the paper evaluates the effect of optimal cache sharing and compares it with conventional solutions for thousands of 4-program co-run groups, with nearly 180 million different ways to share the cache by each co-run group. Optimal partition-sharing is on average 26% better than free-for-all sharing, and 98% better than equal partitioning. We also demonstrate the trade-off between optimal partitioning and fair partitioning.Keywords
This publication has 12 references indexed in Scilit:
- Protection and utilization in shared cache through rationing2014
- Reuse-based online models for caches2013
- HOTL2013
- Modeling performance variation due to cache sharing2013
- Efficient Reuse Distance Analysis of Multicore Scaling for Loop-Based Parallel ProgramsACM Transactions on Computer Systems, 2013
- Linear-time Modeling of Program Working Set in Shared Cache2011
- Accelerating multicore reuse distance analysis with sampling and parallelization2010
- Is Reuse Distance Applicable to Data Locality Analysis on Chip Multiprocessors?2010
- Dynamic Partitioning of Shared Cache MemoryThe Journal of Supercomputing, 2004
- Improving disk cache hit-ratios through cache partitioningIEEE Transactions on Computers, 1992