DiDi: Mitigating the Performance Impact of TLB Shootdowns Using a Shared TLB Directory
Authors:
- Carlos VillaviejaCVCarlos Villavieja
- Vasileios KarakostasVKVasileios Karakostas
- Lluis VilanovaLVLluis Vilanova
- Yoav EtsionYEYoav Etsion
- Alex RamirezARAlex Ramirez
- Avi MendelsonAMAvi Mendelson
- Nacho NavarroNNNacho Navarro
- Adrian CristalACAdrian Cristal
- Osman S. UnsalOUOsman S. Unsal
- 1 October 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 1089795X,p. 340-349
Abstract
Translation Look aside Buffers (TLBs) are ubiquitously used in modern architectures to cache virtual-to-physical mappings and, as they are looked up on every memory access, are paramount to performance scalability. The emergence of chip-multiprocessors (CMPs) with per-core TLBs, has brought the problem of TLB coherence to front stage. TLBs are kept coherent at the software-level by the operating system (OS). Whenever the OS modifies page permissions in a page table, it must initiate a coherency transaction among TLBs, a process known as a TLB shoot down. Current CMPs rely on the OS to approximate the set of TLBs caching a mapping and synchronize TLBs using costly Inter-Proceessor Interrupts (IPIs) and software handlers. In this paper, we characterize the impact of TLB shoot downs on multiprocessor performance and scalability, and present the design of a scalable TLB coherency mechanism. First, we show that both TLB shoot down cost and frequency increase with the number of processors and project that software-based TLB shoot downs would thwart the performance of large multiprocessors. We then present a scalable architectural mechanism that couples a shared TLB directory with load/store queue support for lightweight TLB invalidation, and thereby eliminates the need for costly IPIs. Finally, we show that the proposed mechanism reduces the fraction of machine cycles wasted on TLB shoot downs by an order of magnitude.Keywords
This publication has 20 references indexed in Scilit:
- Synergistic TLBs for High Performance Address Translation in Chip Multiprocessors2010
- UNified Instruction/Translation/Data (UNITD) coherence: One protocol to rule them all2010
- STAMP: Stanford Transactional Applications for Multi-Processing2008
- CUBA2008
- Architecting Efficient Interconnects for Large Caches with CACTI 6.0IEEE Micro, 2008
- Evaluating MapReduce for Multi-core and Multiprocessor Systems2007
- Power Efficient Processor Architecture and The Cell Processor2005
- Effects of clock resolution on the scheduling of interactive and soft real-time processes2003
- A look at several memory management units, TLB-refill mechanisms, and page table organizationsACM SIGOPS Operating Systems Review, 1998
- Low-synchronization translation lookaside buffer consistency in large-scale shared-memory multiprocessorsACM SIGOPS Operating Systems Review, 1989