Pac-PIM: A Parallel Communication Framework for Commodity Processing-in-memory Systems
Open Access
- 16 December 2025
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 22 (4) , 1-25
Abstract
Processing-in-memory (PIM) is a promising paradigm to effectively alleviate the bottleneck of memory access for memory-intensive applications. UPMEM PIM-enabled DIMMs, the first commercially available PIM platform integrating processing elements (PEs) in DIMMs, exemplifies this trend. However, the communication overhead between the host and PIM-enabled DIMMs remains significant. Although previous studies have attempted to reduce this overhead between the host and PIM-enabled DIMMs, our detailed investigation reveals that, from the software perspective, the native communication framework fails to fully leverage its parallelism for communication. We propose to combine rank-level parallelism and process-level parallelism in the layered fashion to take advantage of these and avoid their respective drawbacks. And we revamp the native communication framework by integrating this combination to introduce Pac-PIM ( Pa rallel C ommunication Framework for PIM ). Our evaluation, conducted using real UPMEM PIM-enabled DIMMs and representative PIM-enabled applications, shows that Pac-PIM significantly improves communication performance in all scenarios, with an average speedup of 1.53× compared to the native communication framework with excellent scalability. In addition, Pac-PIM can further improve communication performance along with other optimizations.Keywords
Funding Information
- The Research Grants Council of Hong Kong SAR (CUHK14210323)
- JC STEM Lab of Intelligent Design Automation
- The Hong Kong Jockey Club Charities Trust
This publication has 42 references indexed in Scilit:
- Accelerating Triangle Counting with Real Processing-in-Memory Systems2025
- Accelerating Neural Network Inference With Processing-in-DRAM: From the Edge to the CloudIEEE Micro, 2022
- Benchmarking a New Paradigm: Experimental Analysis and Characterization of a Real Processing-in-Memory SystemIEEE Access, 2022
- Near-Memory Processing in Action: Accelerating Personalized Recommendation With AxDIMMIEEE Micro, 2021
- ABC-DIMM: Alleviating the Bottleneck of Communication in DIMM-based Near-Memory Processing with Inter-DIMM Broadcast2021
- The true Processing In Memory accelerator2019
- Google Workloads for Consumer Devices2018
- AIM2017
- A scalable processing-in-memory accelerator for parallel graph processing2015
- Balancing DRAM locality and parallelism in shared memory CMP systems2012