Simultaneous Multi Layer Access: A High Bandwidth and Low Cost 3D-Stacked Memory Interface
Preprint
Abstract
Limited memory bandwidth is a critical bottleneck in modern systems. 3D-stacked DRAM enables higher bandwidth by leveraging wider Through-Silicon-Via (TSV) channels, but today's systems cannot fully exploit them due to the limited internal bandwidth of DRAM. DRAM reads a whole row simultaneously from the cell array to a row buffer, but can transfer only a fraction of the data from the row buffer to peripheral IO circuit, through a limited and expensive set of wires referred to as global bitlines. In presence of wider memory channels, the major bottleneck becomes the limited data transfer capacity through these global bitlines. Our goal in this work is to enable higher bandwidth in 3D-stacked DRAM without the increased cost of adding more global bitlines. We instead exploit otherwise-idle resources, such as global bitlines, already existing within the multiple DRAM layers by accessing the layers simultaneously. Our architecture, Simultaneous Multi Layer Access (SMLA), provides higher bandwidth by aggregating the internal bandwidth of multiple layers and transferring the available data at a higher IO frequency. To implement SMLA, simultaneous data transfer from multiple layers through the same IO TSVs requires coordination between layers to avoid channel conflict. We first study coordination by static partitioning, which we call Dedicated-IO, that assigns groups of TSVs to each layer. We then provide a simple, yet sophisticated mechanism, called Cascaded-IO, which enables simultaneous access to each layer by time-multiplexing the IOs. By operating at a frequency proportional to the number of layers, SMLA provides a higher bandwidth (4X for a four-layer stacked DRAM). Our evaluations show that SMLA provides significant performance improvement and energy reduction (55%/18% on average for multi-programmed workloads, respectively) over a baseline 3D-stacked DRAM with very low area overhead.Keywords
All Related Versions
This publication has 17 references indexed in Scilit:
- 25.2 A 1.2V 8Gb 8-channel 128GB/s high-bandwidth memory (HBM) stacked DRAM with effective microbump I/O test methods using 29nm process and TSV2014
- Practical implications of via-middle Cu TSV-induced stress in a 28nm CMOS technology for Wide-IO logic-memory interconnect2012
- A scalable I/O architecture for wide I/O DRAM2011
- Understanding the Energy Consumption of Dynamic Random Access Memories2010
- An optimized 3D-stacked memory architecture by exploiting excessive, high-density TSV bandwidth2010
- Mini-rank: Adaptive DRAM architecture for improving memory power efficiency2008
- 3D-Stacked Memory Architectures for Multi-core ProcessorsACM SIGARCH Computer Architecture News, 2008
- Pinpointing Representative Portions of Large Intel® Itanium® Programs with Dynamic Instrumentation2005
- Microarchitecture Optimizations for Exploiting Memory-Level ParallelismACM SIGARCH Computer Architecture News, 2004
- Fully integrated CMOS phase-locked loop with 15 to 240 MHz locking range and ±50 ps jitterIEEE Journal of Solid-State Circuits, 1995