A Scalable Multi-engine Xpress9 Compressor with Asynchronous Data Transfer
Authors:
- Joo Young KimJKJoo Young Kim
- Scott HauckSHScott Hauck
- Doug BurgerDBDoug Burger
- 1 May 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 161-164
Abstract
Data compression is crucial in large-scale storage servers to save both storage and network bandwidth, but it suffers from high computational cost. In this work, we present a high throughput FPGA based compressor as a PCIe accelerator to achieve CPU resource saving and high power efficiency. The proposed compressor is differentiated from previous hardware compressors by the following features: 1) targeting Xpress9 algorithm, whose compression quality is comparable to the best Gzip implementation (level 9); 2) a scalable multi-engine architecture with various IP blocks to handle algorithmic complexity as well as to achieve high throughput; 3) supporting a heavily multi-threaded server environment with an asynchronous data transfer interface between the host and the accelerator. The implemented Xpress9 compressor on Altera Stratix V GS performs 1.6-2.4Gbps throughput with 7 engines on various compression benchmarks, supporting up to 128 thread contexts.Keywords
This publication has 2 references indexed in Scilit:
- A universal algorithm for sequential data compressionIEEE Transactions on Information Theory, 1977
- A Method for the Construction of Minimum-Redundancy CodesProceedings of the IRE, 1952