Runtime-Guided Cache Coherence Optimizations in Multi-core Architectures
Authors:
- Madhavan ManivannanMMMadhavan Manivannan
- Per StenstromPSPer Stenstrom
- 1 May 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 625-636
Abstract
Emerging task-based parallel programming models shield programmers from the daunting task of parallelism management by delegating the responsibility of mapping and scheduling of individual tasks to the runtime system. The runtime system can use semantic information about task dependencies supplied by the programmer and the mapping information of tasks to enable optimizations like data-flow based execution and locality-aware scheduling of tasks. However, should the cache coherence substrate have access to this information from the runtime system, it would enable aggressive optimizations of prevailing access patterns such as one-to-many producer-consumer sharing and migratory sharing. Such linkage has however not been studied before. We present a family of runtime guided cache coherence optimizations enabled by linking dependency and mapping information from the runtime system to the cache coherence substrate. By making this information available to the cache coherence substrate, we show that optimizations, such as downgrading and self-invalidation, that help reducing overheads associated with producer-consumer and migratory sharing can be supported with reasonable extensions to the baseline cache coherence protocol. Our experimental results establish that each optimization provides significant performance gain in isolation and can provide additional gains when combined. Finally, we evaluate these optimizations in the context of earlier proposed runtime-guided prefetching schemes and show that they can have synergistic effects.Keywords
This publication has 24 references indexed in Scilit:
- Locality-aware task management for unstructured parallelism2013
- The gem5 simulatorACM SIGARCH Computer Architecture News, 2011
- Task Superscalar: An Out-of-Order Task Pipeline2010
- Flexible architectural support for fine-grain scheduling2010
- A Look-Ahead Task Management Unit for Embedded Multi-Core Architectures2008
- Architectural Support for the Stream Execution Model on General-Purpose Processors2007
- Carbon2007
- CacheFlow: Cache Optimizations for Data Driven MultithreadingParallel Processing Letters, 2006
- Cooperative shared memoryACM Transactions on Computer Systems, 1993
- Munin: distributed shared memory based on type-specific memory coherence1990