CAMEO: A Two-Level Memory Organization with Capacity of Main Memory and Flexibility of Hardware-Managed Cache
Authors:
- Chia Chen ChouCCChia Chen Chou
- Aamer JaleelAJAamer Jaleel
- Moinuddin K. QureshiMQMoinuddin K. Qureshi
- 1 December 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10724451,p. 1-12
Abstract
This paper analyzes the trade-offs in architecting stacked DRAM either as part of main memory or as a hardware-managed cache. Using stacked DRAM as part of main memory increases the effective capacity, but obtaining high performance from such a system requires Operating System (OS) support to migrate data at a page-granularity. Using stacked DRAM as a hardware cache has the advantages of being transparent to the OS and perform data management at a line-granularity but suffers from reduced main memory capacity. This is because the stacked DRAM cache is not part of the memory address space. Ideally, we want the stacked DRAM to contribute towards capacity of main memory, and still maintain the hardware-based fine-granularity of a cache. We propose CAMEO, a hardware-based Cache-like Memory Organization that not only makes stacked DRAM visible as part of the memory address space but also exploits data locality on a fine-grained basis. CAMEO retains recently accessed data lines in stacked DRAM and swaps out the victim line to off chip memory. Since CAMEO can change the physical location of a line dynamically, we propose a low overhead Line Location Table (LLT) that tracks the physical location of all data lines. We also propose an accurate Line Location Predictor (LLP) to avoid the serialization of the LLT look-up and memory access. We evaluate a system that has 4GB stacked memory and 12GB off-chip memory. Using stacked DRAM as a cache improves performance by 50%, using as part of main memory improves performance by 33%, whereas CAMEO improves performance by 78%. Our proposed design is very close to an idealized memory system that uses the 4GB stacked DRAM as a hardware-managed cache and also increases the main memory capacity by an additional 4GB.Keywords
This publication has 21 references indexed in Scilit:
- Die-stacked DRAM caches for servers2013
- A Mostly-Clean DRAM Cache for Effective Hit Speculation and Self-Balancing Dispatch2012
- Phase Change Memory: From Devices to SystemsSynthesis Lectures on Computer Architecture, 2011
- Pin2005
- When physical is not real enough2004
- A case for multi-level main memory2004
- Cache-only memory architecturesComputer, 1999
- Performance experiences on Sun's Wildfire prototype1999
- Hardware-software trade-offs in a direct Rambus implementation of the RAMpage memory hierarchy1998
- An empirical comparison of the Kendall Square Research KSR-1 and Stanford DASH multiprocessors1993