Complex event detection at wire speed with FPGAs
Authors:
Open Access
- 1 September 2010
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the VLDB Endowment
- Vol. 3 (1-2) , 660-669
Abstract
Complex event detection is an advanced form of data stream processing where the stream(s) are scrutinized to identify given event patterns. The challenge for many complex event processing (CEP) systems is to be able to evaluate event patterns on high-volume data streams while adhering to real-time constraints. To solve this problem, in this paper we present a hardware-based complex event detection system implemented on field-programmable gate arrays (FPGAs). By inserting the FPGA directly into the data path between the network interface and the CPU, our solution can detect complex events at gigabit wire speed with constant and fully predictable latency, independently of network load, packet size, or data distribution. This is a significant improvement over CPU-based systems and an architectural approach that opens up interesting opportunities for hybrid stream engines that combine the flexibility of the CPU with the parallelism and processing power of FPGAs.Keywords
This publication has 9 references indexed in Scilit:
- Efficient event processing through reconfigurable hardware for algorithmic tradingProceedings of the VLDB Endowment, 2010
- Symbiote2010
- DejaVu2009
- Compact architecture for high-throughput regular expression matching on FPGA2008
- Efficient pattern matching over event streams2008
- Compiling PCRE to FPGA for accelerating SNORT IDS2007
- The Compilation of Regular Expressions into Integrated CircuitsJournal of the ACM, 1982
- Programming Techniques: Regular expression search algorithmCommunications of the ACM, 1968
- Regular Expressions and State Graphs for AutomataIEEE Transactions on Electronic Computers, 1960