Benchmarking Memory-Centric Computing Systems: Analysis of Real Processing-In-Memory Hardware
Authors:
Top Cited Papers
- 18 October 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
Many modern workloads such as neural network inference and graph processing are fundamentally memory-bound. For such workloads, data movement between memory and CPU cores imposes a significant overhead in terms of both latency and energy. A major reason is that this communication happens through a narrow bus with high latency and limited bandwidth, and the low data reuse in memory-bound workloads is insufficient to amortize the cost of memory access. Fundamentally addressing this data movement bottleneck requires a paradigm where the memory system assumes an active role in computing by integrating processing capabilities. This paradigm is known as processing-in-memory (PIM). Recent research explores different forms of PIM architectures, motivated by the emergence of new technologies that integrate memory with a logic layer, where processing elements can be easily placed. Past works evaluate these architectures in simulation or, at best, with simplified hardware prototypes. In contrast, the UPMEM company has designed and manufactured the first publicly-available real-world PIM architecture. The UPMEM PIM architecture combines traditional DRAM memory arrays with general-purpose in-order cores, called DRAM Processing Units (DPUs), integrated in the same chip. This paper presents key takeaways from the first comprehensive analysis [1] of the first publicly-available real-world PIM architecture. First, we introduce our experimental characterization of the UPMEM PIM architecture using microbenchmarks, and present PrIM (Processing-In-Memory benchmarks), a benchmark suite of 16 workloads from different application domains (e.g., dense/sparse linear algebra, databases, data analytics, graph processing, neural networks, bioinformatics, image processing), which we identify as memory-bound. Second, we provide four key takeaways about the UPMEM PIM architecture, which stem from our study of the performance and scaling characteristics of PrIM benchmarks on the UPMEM PIM architecture, and their performance and energy consumption comparison to their state-of-the-art CPU and GPU counterparts. More insights about suitability of different workloads to the PIM system, programming recommendations for software designers, and suggestions and hints for hardware and architecture designers of future PIM systems are available in [1].Keywords
All Related Versions
This publication has 109 references indexed in Scilit:
- Active Memory Cube: A processing-in-memory architecture for exascale systemsIBM Journal of Research and Development, 2015
- Main Memory Scaling: Challenges and Solution Directions2015
- Logic operations in memory using a memristive Akers arrayMicroelectronics Journal, 2014
- MAGIC—Memristor-Aided LogicIEEE Transactions on Circuits and Systems II: Express Briefs, 2014
- The efficacy of error mitigation techniques for DRAM retention failuresACM SIGMETRICS Performance Evaluation Review, 2014
- Flipping bits in memory without accessing themACM SIGARCH Computer Architecture News, 2014
- RAIDRACM SIGARCH Computer Architecture News, 2012
- Phase change memory architecture and the quest for scalabilityCommunications of the ACM, 2010
- RooflineCommunications of the ACM, 2009
- The missing memristor foundNature, 2008