Aquabolt-XL HBM2-PIM, LPDDR5-PIM With In-Memory Processing, and AXDIMM With Acceleration Buffer
- 5 April 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 42 (3) , 20-30
Abstract
Processing-in-Memory has been proposed to improve performance of bandwidth intensive workloads as well as save energy reduction due to reduced compute-memory data movement. To realize PIM, Programmable computing units were integrated with memory cores on a HBM2 device to enable parallel processing and minimize data movement. A GPU system equipped with Samsung Aquabolt-XL HBM2-PIM devices improved micro-kernel General Matrix-Vector multiplication and speech recognition applications by 8.9 and 3.5 times, respectively, and reduced energy consumption by over 60%. In a Xilinx AlveoU280 system, micro-kernel GEMV and ADD workload performances improved by 2.8X, and Long Short-Term Memory workload improved by 2.54X. Simulations show that performance gain of over 2.3X may be attained in a system with LP5-PIM for certain transformer based speech recognition with energy reduction of 86%. In addition, AXDIMM, a DIMM-level PIM with acceleration buffers, exhibits an 80% performance improvement and 42.6% energy savings over a regular RDIMM system.Keywords
This publication has 7 references indexed in Scilit:
- Hardware Architecture and Software Stack for PIM Based on Commercial DRAM Technology : Industrial Product2021
- 25.4 A 20nm 6GB Function-In-Memory DRAM, Based on HBM2 with a 1.2TFLOPS Programmable Computing Unit Using Bank-Level Parallelism, for Machine Learning Applications2021
- RecNMP: Accelerating Personalized Recommendation with Near-Memory Processing2020
- Survey and Benchmarking of Machine Learning Accelerators2019
- The future of graphic and mobile memory for new applications2016
- A 4-Gb/s/pin low-power memory I/O interface using 4-level simultaneous bi-directional signalingIEEE Journal of Solid-State Circuits, 2005
- A Logic-in-Memory ComputerIEEE Transactions on Computers, 1970