Reducing memory reference energy with opportunistic virtual caching
Authors:
- 1 June 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636897,p. 297-308
Abstract
Most modern cores perform a highly-associative transaction look aside buffer (TLB) lookup on every memory access. These designs often hide the TLB lookup latency by overlapping it with L1 cache access, but this overlap does not hide the power dissi-pated by TLB lookups. It can even exacerbate the power dissipation by requiring higher associativity L1 cache. With today's concern for power dissipation, designs could instead adopt a virtual L1 cache, wherein TLB access power is dissipated only after L1 cache misses. Unfortunately, virtual caches have compatibility issues, such as supporting writeable synonyms and x86's physical page table walker. This work proposes an Opportunistic Virtual Cache (OVC) that exposes virtual caching as a dynamic optimization by allowing some memory blocks to be cached with virtual addresses and others with physical addresses. OVC relies on small OS changes to signal which pages can use virtual caching (e.g., no writeable synonyms), but defaults to physical caching for compatibility. We show OVC's promise with analysis that finds virtual cache problems exist, but are dynamically rare. We change 240 lines in Linux 2.6.28 to enable OVC. On experiments with Parsec and commercial workloads, the resulting system saves 94-99% of TLB lookup energy and nearly 23% of L1 cache dynamic lookup energy.Keywords
This publication has 31 references indexed in Scilit:
- The gem5 simulatorACM SIGARCH Computer Architecture News, 2011
- Heterogeneously tagged caches for low-power embedded systems with virtual memory supportACM Transactions on Design Automation of Electronic Systems, 2008
- Selective block buffering TLB system for embedded processorsIEE Proceedings - Computers and Digital Techniques, 2005
- Itanium 2 processor microarchitectureIEEE Micro, 2003
- Uniprocessor virtual memory without TLBsIEEE Transactions on Computers, 2001
- U-cache: A cost-effective solution to the virtual cache synonym problemMicroprocessors and Microsystems, 1998
- Virtual-address caches. Part 1: problems and solutions in uniprocessorsIEEE Micro, 1997
- Virtual-address caches.2. Multiprocessor issuesIEEE Micro, 1997
- Coherency for multiprocessor virtual address cachesACM SIGARCH Computer Architecture News, 1987
- An in-cache address translation mechanismACM SIGARCH Computer Architecture News, 1986