Microarchitectural comparison and in-core modeling of state-of-the-art CPUs: Grace, Sapphire Rapids, and Genoa
Preprint
Abstract
With Nvidia's release of the Grace Superchip, all three big semiconductor companies in HPC (AMD, Intel, Nvidia) are currently competing in the race for the best CPU. In this work we analyze the performance of these state-of-the-art CPUs and create an accurate in-core performance model for their microarchitectures Zen 4, Golden Cove, and Neoverse V2, extending the Open Source Architecture Code Analyzer (OSACA) tool and comparing it with LLVM-MCA. Starting from the peculiarities and up- and downsides of a single core, we extend our comparison by a variety of microbenchmarks and the capabilities of a full node. The "write-allocate (WA) evasion" feature, which can automatically reduce the memory traffic caused by write misses, receives special attention; we show that the Grace Superchip has a next-to-optimal implementation of WA evasion, and that the only way to avoid write allocates on Zen 4 is the explicit use of non-temporal stores.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- GRANITE: A Graph Neural Network Model for Basic Block Throughput Estimation2022
- uiCA2022
- New 3rd Gen Intel® Xeon® Scalable Processor (Codename: Ice Lake-SP)2020
- Bridging the Architecture Gap: Abstracting Performance-Relevant Properties of Modern Server ProcessorsSupercomputing Frontiers and Innovations, 2020
- uops.info2019
- Quantifying Performance Bottlenecks of Stencil Computations Using the Execution-Cache-Memory Model2015
- RooflineCommunications of the ACM, 2009