Design exploration of hybrid caches with disparate memory technologies
Authors:
Open Access
- 30 December 2010
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Architecture and Code Optimization
- Vol. 7 (3) , 1-34
Abstract
Traditional multilevel SRAM-based cache hierarchies, especially in the context of chip multiprocessors (CMPs), present many challenges in area requirements, core--to--cache balance, power consumption, and design complexity. New advancements in technology enable caches to be built from other technologies, such as Embedded DRAM (EDRAM), Magnetic RAM (MRAM), and Phase-change RAM (PRAM), in both 2D chips or 3D stacked chips. Caches fabricated in these technologies offer dramatically different power-performance characteristics when compared with SRAM-based caches, particularly in the areas of access latency, cell density, and overall power consumption. In this article, we propose to take advantage of the best characteristics that each technology has to offer through the use of Hybrid Cache Architecture (HCA) designs. We discuss and evaluate two types of hybrid cache architectures: intercache-Level HCA (LHCA), in which the levels in a cache hierarchy can be made of disparate memory technologies; and intracache-level or cache-Region-based HCA (RHCA), where a single level of cache can be partitioned into multiple regions, each of a different memory technology. We have studied a number of different HCA architectures and explored the potential of hardware support for intracache data movement and power consumption management within HCA caches. Utilizing a full-system simulator that has been validated against real hardware, we demonstrate that an LHCA design can provide a geometric mean 6% IPC improvement over a baseline 3-level SRAM cache design under the same area constraint across a collection of 30 workloads. A more aggressive RHCA-based design provides 10% IPC improvement over the baseline. A 2-layer 3D cache stack (3DHCA) of high density memory technology within the same chip footprint gives 16% IPC improvement over the baseline. We also achieve up to a 72% reduction in power consumption over a baseline SRAM-only design. Energy-delay and thermal evaluation for 3DHCA are also presented. In addition to the fast-slow region based RHCA, we further evaluate read-write region based RHCA designs.Keywords
Funding Information
- National Science Foundation (7.03E+19)
This publication has 30 references indexed in Scilit:
- The PARSEC benchmark suite2008
- Die Stacking (3D) Microarchitecture2006
- Managing Wire Delay in Large Chip-Multiprocessor Caches2005
- Placement and Routing in 3D Integrated CircuitsIEEE Design & Test of Computers, 2005
- Demystifying 3D ICs: The Pros and Cons of Going VerticalIEEE Design & Test of Computers, 2005
- SET and RESET Pulse Characterization in BJT-Selected Phase-Change Memories2005
- Optimizing Replication, Communication, and Capacity Allocation in CMPsACM SIGARCH Computer Architecture News, 2005
- MamboACM SIGMETRICS Performance Evaluation Review, 2004
- One-dimensional heat conduction model for an electrical phase change random access memory device with an 8F2 memory cell (F=0.15 μm)Journal of Applied Physics, 2003
- Wattch2000