Contextual anomaly detection for a critical industrial system based on logs and metrics
Authors:
- Mostafa FarshchiMFMostafa Farshchi
- Ingo WeberIWIngo Weber
- Raffaele Della CorteRCRaffaele Della Corte
- Antonio PecchiaAPAntonio Pecchia
- Marcello CinqueMCMarcello Cinque
- Jean-Guy SchneiderJSJean-Guy Schneider
- John GrundyJGJohn Grundy
- 1 September 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 140-143
Abstract
Recent advances in contextual anomaly detection attempt to combine resource metrics and event logs to uncover unexpected system behaviors at run-time. This is highly relevant for critical software systems, where monitoring is often mandated by international standards and guidelines. In this paper, we analyze the effectiveness of a metrics-logs contextual anomaly detection technique in a middleware for Air Traffic Control systems. Our study addresses the challenges of applying such techniques to a new case study with a dense volume of logs, and finer monitoring sampling rate. Guided by our experimental results, we propose and evaluate several actionable improvements, which include a change detection algorithm and the use of time windows on contextual anomaly detection.Keywords
This publication has 7 references indexed in Scilit:
- CRUDE: Combining Resource Usage Data and Error Logs for Accurate Error Detection in Large-Scale Distributed Systems2016
- Characterizing Direct Monitoring Techniques in Software SystemsIEEE Transactions on Reliability, 2016
- Performance Anomaly Detection and Bottleneck IdentificationACM Computing Surveys, 2015
- Workload-aware anomaly detection for Web applicationsJournal of Systems and Software, 2014
- Anomaly detectionACM Computing Surveys, 2009
- Anomaly? application change? or workload change? towards automated detection of application performance anomaly and change2008
- Basic concepts and taxonomy of dependable and secure computingIEEE Transactions on Dependable and Secure Computing, 2004