Understanding Off-Chip Memory Contention of Parallel Programs in Multicore Systems
Authors:
- Bogdan Marius TudorBTBogdan Marius Tudor
- Yong Meng TeoYTYong Meng Teo
- Simon SeeSSSimon See
- 1 September 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 01903918,p. 602-611
Abstract
Memory contention is an important performance issue in current multicore architectures. In this paper, we focus on understanding how off-chip memory contention affects the performance of parallel applications. Using measurements conducted on state-of-the-art multicore systems, we observed that off-chip memory traffic is not always bursty, as it was previously reported in literature. Burstiness depends on the problem size. Small problem sizes lead to bursty memory traffic, and generate small off-chip contention. In contrast, when large program sizes cause memory contention, the memory traffic is non-bursty. Based on these observations, we propose an analytical model that relates the growth of memory contention to the number of active cores and to the problem size, for both uniform (UMA) and non-uniform memory access (NUMA) systems. Our model differs from measurements on average by less than 14\%. Contention for off-chip memory grows exponentially with the number of active cores, but adding additional memory controllers reduces the memory contention. For programs such as the penta diagonal solver SP from NPB benchmark, with a large matrix of $162^3$ elements (input size C), our analysis shows that memory contention increases the total number of processor cycles to execute the program by more than ten times on a machine with 24 cores.
Keywords
This publication has 20 references indexed in Scilit:
- Addressing shared resource contention in multicore processors via scheduling2010
- Scaling the bandwidth wall2009
- The PARSEC benchmark suite2008
- Self-Optimizing Memory ControllersACM SIGARCH Computer Architecture News, 2008
- Parallelism-Aware Batch SchedulingACM SIGARCH Computer Architecture News, 2008
- Improving Performance Isolation on Chip Multiprocessors via an Operating System Scheduler2007
- Virtual private caches2007
- Fair Queuing Memory Systems2006
- On the self-similar nature of Ethernet traffic (extended version)IEEE/ACM Transactions on Networking, 1994
- The NAS parallel benchmarks---summary and preliminary results1991