Heterogeneous memory management for 3D-DRAM and external DRAM with QoS
Authors:
- 1 January 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 663-668
Abstract
This paper presents an innovative memory management approach to utilize both 3D-DRAM and external DRAM (ex-DRAM). Our approach dynamically allocates and relocates memory blocks between the 3D-DRAM and the ex-DRAM to exploit the high memory bandwidth and the low memory latency of the 3D-DRAM as well as the high capacity and the low cost of the ex-DRAM. Our simulation shows that in workloads that are not memory intensive, our memory management technique transfers all active memory blocks to the 3D-DRAM which runs faster than the ex-DRAM. In memory intensive workloads, our memory management technique utilizes both the 3D-DRAM and the ex-DRAM to increase the memory bandwidth to alleviate bandwidth congestion. Our approach supports Quality of Service (QoS) for “latency sensitive”, “bandwidth sensitive”, and “insensitive” applications. To improve the performance and satisfy a certain level of QoS, memory blocks of different application types are allocated differently. Compared to the scratchpad memory management mechanism, the average memory access latency of our approach decreases by 19% and 23%, while performance improves by up to 5% and 12% in single threaded benchmarks and multi-threaded benchmarks respectively. Moreover, using our approach, applications do not need to manage memory explicitly like in the scratchpad case. Our memory block relocation comes with negligible performance overhead, particularly for applications which have high spatial memory locality.Keywords
This publication has 14 references indexed in Scilit:
- Hybrid memory cube new DRAM architecture increases density and performance2012
- Dynamically heterogeneous cores through 3D resource pooling2012
- Mobile system considerations for SDRAM interface trends2011
- Attaining Single-Chip, High-Performance Computing through 3D Systems with Active CoolingIEEE Micro, 2011
- Simple but Effective Heterogeneous Main Memory with On-Chip Memory Controller Support2010
- An optimized 3D-stacked memory architecture by exploiting excessive, high-density TSV bandwidth2010
- 8 Gb 3-D DDR3 DRAM Using Through-Silicon-Via TechnologyIEEE Journal of Solid-State Circuits, 2009
- 3D DRAM Design and Application to 3D Multicore SystemsIEEE Design & Test of Computers, 2009
- Impacts of though-DRAM vias in 3D processor-DRAM integrated systems2009
- On the Effects of Memory Latency and Bandwidth on Supercomputer Application Performance2007