Demystifying Datapath Accelerator Enhanced Off-path SmartNIC
Authors:
- 28 October 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-12
Abstract
Network speeds grow quickly in the modern cloud, so SmartNICs are introduced to offload network processing tasks, even application logic. However, typical multicore SmartNICs such as BlueFiled-2 are only capable of processing control-plane tasks with their embedded processors that have limited memory bandwidth and computing power. On the other hand, cloud applications evolve rapidly, such that a limited number of fixed hardware engines in a SmartNIC cannot satisfy the requirements of cloud applications. Therefore, SmartNIC programmers call for a programmable datapath accelerator (DPA) to process network traffic at line rate. However, no existing work has unveiled the performance characteristics of the existing DPA. To this end, we present the first architectural characterization of the latest DPA-enhanced BlueFiled-3 (BF3) SmartNIC. Our evaluation results indicate that BF3's DPA is significantly wimpier than the off-path Arm processor and the host CPU. However, we still identify that DPA has three unique architectural characteristics that unleash the performance potential of DPA. Specifically, we demonstrate how to take advantage of DPA's three architectural characteristics regarding computing, networking, and memory subsystems. Then we propose three important guidelines for programmers to fully unleash the potential of DPA. To demonstrate the effectiveness of our approach, we conduct detailed case studies regarding each guideline. Our case study on key-value aggregation achieves up to $4.3 \times$ higher throughput by using our guidelines to optimize memory combinations.
Keywords
All Related Versions
Funding Information
- National Natural Science Foundation of China (62472384)
This publication has 47 references indexed in Scilit:
- Making Sense of Using a SmartNIC to Reduce Datacenter Tax from SLO and TCO Perspectives2023
- Battle of the BlueFields: An In-Depth Comparison of the BlueField-2 and BlueField-3 SmartNICs2023
- Characterizing Lossy and Lossless Compression on Emerging BlueField DPU Architectures2023
- DPUBench: An application-driven scalable benchmark suite for comprehensive DPU evaluationBenchCouncil Transactions on Benchmarks, Standards and Evaluations, 2023
- Towards a Network Aware Model of the Time Uncertainty Bound in Precision Time Protocol2023
- Rambda: RDMA-driven Acceleration Framework for Memory-intensive µs-scale Datacenter Applications2023
- Scalable and Flexible High-Performance In-Network Processing of Hash Joins in Distributed Databases2021
- λ-NIC: Interactive Serverless Compute on Programmable SmartNICs2020
- Shuhai: Benchmarking High Bandwidth Memory On FPGAS2020
- Network Function Virtualization: State-of-the-Art and Research ChallengesIEEE Communications Surveys & Tutorials, 2015