Raptor: Mitigating CPU-GPU False Sharing Under Unified Memory Systems
Authors:
- 24 October 2022
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
The introduction of Unified Memory (UM) technology has greatly increased the programmability of CPU-GPU heterogeneous systems. At the same time, Unified Memory systems have given rise to new performance challenges. Achieving the desired performance and energy efficiency on such systems requires careful consideration of data allocation and migration. This paper looks at the problem of false sharing under UM. We present Raptor, a system for fast and accurate detection of page-level false sharing in heterogeneous applications. The system employs binary code instrumentation and leverages hardware performance counters to track UM allocations and data access patterns and pinpoint energy inefficiencies created by the occurrence of false sharing. Experiments on a suite of heterogeneous applications show false sharing can be a common occurrence in collaborative design paradigms with tight coupling of CPU-GPU tasks. When false sharing is eliminated via a padding scheme, applications are able to achieve higher performance at lower clock frequencies, leading to improved energy efficiency by as much as 2.96× and by 1.62× and 1.47× on average on two contemporary CPU-GPU platforms.Keywords
This publication has 24 references indexed in Scilit:
- Remix: online detection and repair of cache contention for the JVM2016
- Observations and opportunities in architecting shared virtual memory for heterogeneous systems2016
- Automatic data layout generation and kernel mapping for CPU+GPU architectures2016
- Towards high performance paged memory for GPUs2016
- LASER: Light, Accurate Sharing dEtection and Repair2016
- Cheetah: detecting false sharing efficiently and effectively2016
- ScaAnalyzer2015
- Page Placement Strategies for GPUs within Heterogeneous Memory Systems2015
- PREDATOR2014
- SHERIFF2011