BTB-X: A Storage-Effective BTB Organization
- 3 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Architecture Letters
- Vol. 20 (2) , 134-137
Abstract
Many contemporary applications feature multi-megabyte instruction footprints that overwhelm the capacity of branch target buffers (BTB) and instruction caches (L1-I), causing frequent front-end stalls that inevitably hurt performance. BTB is crucial for performance as it enables the front-end to accurately resolve the upcoming execution path and steer instruction fetch appropriately. Moreover, it also enables highly effective fetch-directed instruction prefetching that can eliminate many L1-I misses. For these reasons, commercial processors allocate vast amounts of storage capacity to BTBs. This letter aims to reduce BTB storage requirements by optimizing the organization of BTB entries. Our key insight is that today's BTBs store the full target address for each branch, yet the vast majority of dynamic branches have short offsets requiring just a handful of bits to encode. Based on this insight, we organize the BTB as an ensemble of smaller BTBs, each storing offsets within a particular range. Doing so enables a dramatic reduction in storage for target addresses. We also compress tags to reduce the tag storage cost. Our final design, called BTB-X, uses an ensemble of five BTBs with compressed tags that enables it to track 2.8x more branches than a conventional BTB with the same storage budget.Keywords
Funding Information
- Norges Forskningsråd (302279)
- NTNU
- UK EPSRC (EP/M001202/1)
- University of Edinburgh
This publication has 9 references indexed in Scilit:
- Re-establishing Fetch-Directed Instruction Prefetching: An Industry Perspective2021
- The IBM z15 processor chip set2020
- Evolution of the Samsung Exynos CPU Microarchitecture2020
- The AMD “Zen 2” ProcessorIEEE Micro, 2020
- The Arm Neoverse N1 Platform: Building Blocks for the Next-Gen Cloud-to-Edge Infrastructure SoCIEEE Micro, 2020
- Blasting through the Front-End Bottleneck with Shotgun2018
- Boomerang: A Metadata-Free Architecture for Control Flow Delivery2017
- Two level bulk preload branch prediction2013
- Fetch directed instruction prefetching2003