Dorado: Scaling SmartNIC Session Tables on Commodity DDRs
Open Access
- 11 August 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 433-446
Abstract
FPGA-based SmartNICs are widely deployed for cloud network function acceleration, but their memory subsystem is under increasing pressure because of large session tables. Conventional wisdom suggests that high packet processing performance relies on advanced memories (e.g., SRAM, HBM), but those are costly to add at cloud scale. Dorado is a novel design that scales SmartNIC session tables entirely on inexpensive DDR modules. At the heart of Dorado are three new techniques that extract commodity DDR performance by restructuring session table layout, decomposing processing pipelines to reduce locking, and scheduling memory accesses to minimize stalls. Our testbed results show that Dorado improves packet processing rates by 33%, even with fewer hardware resources. Further, we have deployed Dorado to millions of servers, processing network traffic from billions of users on a large public cloud for over three years. Our production results show that Dorado can accommodate up to 16M session entries, reduce memory cost by 80%, while enabling 50Mpps line-rate processing.Keywords
This publication has 28 references indexed in Scilit:
- A Mess of Memory System Benchmarking, Simulation and Application Profiling2024
- FPGA‐based HPC accelerators: An evaluation on performance and energy efficiencyConcurrency and Computation: Practice and Experience, 2021
- Increasing DDR4 SDRAM throughput in parallel workloads2020
- Optimal elephant flow detection2017
- HBM (High Bandwidth Memory) DRAM Technology and Architecture2017
- NetFPGA SUME: Toward 100 Gbps as Research CommodityIEEE Micro, 2014
- Network monitoring using traffic dispersion graphs (tdgs)2007
- Cloud control with distributed rate limitingACM SIGCOMM Computer Communication Review, 2007
- Cuckoo hashingJournal of Algorithms, 2004
- Evaluating associativity in CPU cachesIEEE Transactions on Computers, 1989