Toward Predictive Failure Management for Distributed Stream Processing Systems
Authors:
- Xiaohui GuXGXiaohui Gu
- Spiros PapadimitriouSPSpiros Papadimitriou
- Philip S. YuPYPhilip S. Yu
- Shu-Ping ChangSCShu-Ping Chang
- 1 June 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636927,p. 825-832
Abstract
Distributed stream processing systems (DSPSs) have many important applications such as sensor data analysis, network security, and business intelligence. Failure management is essential for DSPSs that often require highly-available system operations. In this paper, we explore a new predictive failure management approach that employs online failure prediction to achieve more efficient failure management than previous reactive or proactive failure management approaches. We employ light-weight stream-based classification methods to perform online failure forecast. Based on the prediction results, the system can take differentiated failure preventions on abnormal components only. Our failure prediction model is tunable, which can achieve a desired tradeoff between failure penalty reduction and prevention cost based on a user-defined reward function. To achieve low-overhead online learning, we propose adaptive data stream sampling schemes to adaptively adjust measurement sampling rates based on the states of monitored components, and maintain a limited size of historical training data using reservoir sampling. We have implemented an initial prototype of the predictive failure management framework within the IBM System S distributed stream processing system. Experiment results show that our system can achieve more efficient failure management than conventional reactive and proactive approaches, while imposing low overhead to the DSPS.Keywords
This publication has 10 references indexed in Scilit:
- Online Failure Forecast for Fault-Tolerant Data Stream Processing2008
- A Cooperative, Self-Configuring High-Availability Solution for Stream Processing2007
- Adaptive Load Diffusion for Multiway Windowed Stream Joins2007
- Design, implementation, and evaluation of the linear road bnchmark on the stream processing core2006
- Highly available, fault-tolerant, parallel dataflows2004
- Efficient decision tree construction on streaming data2003
- Xen and the art of virtualization2003
- ReVirt2002
- The Elements of Statistical Learning2001
- Density biased sampling2000