Exploiting Chiplet Integration Technology for Fast High-Capacity DRAM Modules
- 16 January 2025
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
- Vol. 33 (5) , 1202-1214
Abstract
As the end of Moore’s law approaches, chiplet integration technology (or chiplet technology) has emerged to revolutionize future semiconductor chip design. Chiplet technology provides unique advantages over 3-D-stacking technology, including a more cost-efficient and thermal-friendly integration of heterogeneous technologies. Although chiplet technologies have already begun to be used by the latest commercial chips, they have not been explored for commodity dynamic random access memory (DRAM) design yet. Harnessing its advantages for DRAM for the first time, this article evaluates the feasibility of chiplet-based DRAM architecture, considering various physical and electrical constraints imposed by a standard chiplet interface [i.e., universal chiplet interconnect express (UCIe)]. We further explore the DIMM architectures that simplify module packaging and assembly, leading to reductions in total die size and overall costs. The comprehensive cross-level analysis (i.e., device, circuit, chip, and system levels) shows that chiplet-based DRAM reduces t_RCD + t_CAS, latency-critical DRAM timing parameters, by $1.32\times $ – $1.39\times $ , at the same energy consumption. In addition, a $1.39\times $ – $2.28\times $ improvement in t_RRD is obtained. The reduced DRAM timing parameters improve the overall system performance by up to 8.8%–24.7% (geomean 3.4%–8.4%) in real-life benchmarks. The chiplet-based heterogeneous integration achieves a $1.27\times $ higher chip-level yield compared with the monolithic chip, along with up to 10% reduction in overall cost compared with traditional DIMMs at emerging process technologies.
Keywords
Funding Information
- Processing with Intelligent Storage and Memory (PRISM), One of Seven Centers in Joint University Microelectronics Program 2 (0000DONOTUSETHIS0000.0)
This publication has 38 references indexed in Scilit:
- A UCIe Interconnect Channel Design Up to 32Gbps on 2.5D Si-Interposer2024
- Accelerator Design using 3D Stacked Capacitorless DRAM for Large Language Models2024
- Chiplets: How Small is too Small?2023
- Electrical characterization and modeling of 2-μm and 1.5-μm line-and-space high-density signal wiring in organic interposer2023
- Vertical Channel Transistor (VCT) as Access Transistor for Future 4F 2 DRAM Architecture2023
- Capacitor-less, Long-Retention (>400s) DRAM Cell Paving the Way towards Low-Power and High-Density Monolithic 3D DRAM2020
- Silicon vs. Organic Interposer: PPA and Reliability Tradeoffs in Heterogeneous 2.5D Chiplet Integration2020
- CLR-DRAM: A Low-Cost DRAM Architecture Enabling Dynamic Capacity-Latency Trade-Off2020
- Scaling equations for the accurate prediction of CMOS device performance from 180 nm to 7 nmIntegration, 2017
- 3D SiP with Organic Interposer for ASIC and Memory Integration2016