Thin servers with smart pipes
Authors:
Open Access
- 23 June 2013
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 36-47
Abstract
Distributed in-memory key-value stores, such as memcached, are central to the scalability of modern internet services. Current deployments use commodity servers with high-end processors. However, given the cost-sensitivity of internet services and the recent proliferation of volume low-power System-on-Chip (SoC) designs, we see an opportunity for alternative architectures. We undertake a detailed characterization of memcached to reveal performance and power inefficiencies. Our study considers both high-performance and low-power CPUs and NICs across a variety of carefully-designed benchmarks that exercise the range of memcached behavior. We discover that, regardless of CPU microarchitecture, memcached execution is remarkably inefficient, saturating neither network links nor available memory bandwidth. Instead, we find performance is typically limited by the per-packet processing overheads in the NIC and OS kernel---long code paths limit CPU performance due to poor branch predictability and instruction fetch bottlenecks. Our insights suggest that neither high-performance nor low-power cores provide a satisfactory power-performance trade-off, and point to a need for tighter integration of the network interface. Hence, we argue for an alternate architecture---Thin Servers with Smart Pipes (TSSP)---for cost-effective high-performance memcached deployment. TSSP couples an embedded-class low-power core to a memcached accelerator that can process GET requests entirely in hardware, offloading both network handling and data look up. We demonstrate the potential benefits of our TSSP architecture through an FPGA prototyping platform, and show the potential for a 6X-16X power-performance improvement over conventional server baselines.Keywords
Funding Information
- Division of Computing and Communication Foundations (CCF-0815457)
This publication has 24 references indexed in Scilit:
- An FPGA memcached appliance2013
- Chronos2012
- CPHASH2012
- Many-core key-value store2011
- Warehouse-Scale Computing: Entering the Teenage DecadeACM SIGARCH Computer Architecture News, 2011
- FAWN2009
- A measurement-driven analysis of information propagation in the flickr social network2009
- Integrated network interfaces for high-bandwidth TCP/IP2006
- Direct Cache Access for High Bandwidth Network I/OACM SIGARCH Computer Architecture News, 2005
- Application performance pitfalls and TCP's Nagle algorithmACM SIGMETRICS Performance Evaluation Review, 2000