Runtime-driven shared last-level cache management for task-parallel programs
Open Access
- 15 November 2015
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Abstract
Task-parallel programming models with input annotation-based concurrency extraction at runtime present a promising paradigm for programming multicore processors. Through management of dependencies, task assignments, and orchestration, these models markedly simplify the programming effort for parallelization while exposing higher levels of concurrency. In this paper we show that for multicores with a shared last-level cache (LLC), the concurrency extraction framework can be used to improve the shared LLC performance. Based on the input annotations for future tasks, the runtime instructs the hardware to prioritize data blocks with future reuse while evicting blocks with no future reuse. These instructions allow the hardware to preserve all the blocks for at least some of the future tasks and evict dead blocks. This leads to a considerable improvement in cache efficiency over what is achieved by hardware-only replacement policies, which can replace blocks for all future tasks resulting in poor hit-rates for all future tasks. The proposed hardware-software technique leads to a mean improvement of 18% in application performance and a mean reduction of 26% in misses over a shared LLC managed by the Least Recently Used replacement policy for a set of input-annotated task-parallel programs using the OmpSs programming model implemented on the NANOS++ runtime. In contrast, the state-of-the-art thread-based partitioning scheme suffers an average performance loss of 2% and an average increase of 15% in misses over the baseline.Keywords
Funding Information
- National Science Foundation (CNS- 0751153, CNS-1117726, OCI-1216809)
- U.S. Department of Energy (DE-FC02-12ER26104)
This publication has 36 references indexed in Scilit:
- Runtime-Guided Cache Coherence Optimizations in Multi-core Architectures2014
- Pacman2013
- OmpSs: A PROPOSAL FOR PROGRAMMING HETEROGENEOUS MULTI-CORE ARCHITECTURESParallel Processing Letters, 2011
- Quality of service shared cache management in chip multiprocessor architectureACM Transactions on Architecture and Code Optimization, 2010
- Full-System Simulation from Embedded to High-Performance Systems2010
- Serialization setsACM SIGPLAN Notices, 2009
- Multifacet's general execution-driven multiprocessor simulator (GEMS) toolsetACM SIGARCH Computer Architecture News, 2005
- Generating cache hints for improved program efficiencyJournal of Systems Architecture, 2005
- Dynamic Partitioning of Shared Cache MemoryThe Journal of Supercomputing, 2004
- Optimal partitioning of cache memoryIEEE Transactions on Computers, 1992