Thermal Analysis and Design Guideline of Massive Orthogonal Stacking Assembly of IC (MOSAIC) Cube with Bump Connection Enabling SoC-DRAM Direct Stacking

Authors:

Abstract
The rapid growth of large language models demands unprecedented memory capacity and bandwidth, driving the need for innovative memory architectures. While HBM technology continues to advance, huge thermal resistance accompanied by more stacked memory chips and assembly costs impede further scaling. We propose Massive Orthogonal Stacking Assembly of IC (MOSAIC), a novel approach that arranges DRAM dies vertically like books on a bookshelf, enabling increase in the number of chip stacking without increase of thermal resistance. Through comprehensive thermal simulations, we demonstrate MOSAIC Cube's superior heat dissipation capabilities compared to conventional HBM-alike structures, enabling significantly higher chip stacking while maintaining thermal stability. Our study establishes design guidelines for optimal implementation, addressing critical parameters including chip height, memory thickness, and power density considerations. The architecture achieves substantially higher I/O connectivity while eliminating TSV-related constraints, demonstrating MOSAIC's potential as a viable solution for next-generation memory systems in high-performance computing and AI applications.