A General Framework for the Assessment of Detectors of Anomalies in Time Series
Open Access
- 3 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Informatics
- Vol. 20 (10) , 12051-12061
Abstract
Anomalies are rare events, and this affects the design flow of detectors that monitor systems that behave normally most of the time but whose failure may have serious consequences. This limitation is particularly evident in the detector performance evaluation: it requires an abundance of normal and anomalous data but realistically faces a scarcity of the latter. To address this, in this article, we develop a framework comprising a set of abstract anomalies modeling the effects real-world failures and disturbances have on sensor readings. In addition, we devise synthetic generation procedures for these anomalies. Given a dataset of normal tracks from the actual application, one may apply such procedures to produce anomalous-like time series for a comprehensive detector assessment. We show that this framework can anticipate the detector performing best with real-world anomalies in the context of human and structural health monitoring, also highlighting that, in these cases, the best detector is not the most complex.Keywords
Funding Information
- FAIR—Future Artificial Intelligence Research
- European Union Next-GenerationEU (D.D. 1555 11/10/2022, PE00000013)
This publication has 41 references indexed in Scilit:
- Second-Order Statistic Deviation to Model Anomalies in the Design of Unsupervised Detectors2023
- Wind turbines anomaly detection based on power curves and ensemble learningIET Renewable Power Generation, 2020
- Sensor Fault Classification Based on Support Vector Machine and Statistical Time-Domain FeaturesIEEE Access, 2017
- Outlier Analysis2017
- An introduction to ROC analysisPattern Recognition Letters, 2006
- Narrow-band interference cancellation for enhanced speaker identification2003
- A wavelet-based approach to abrupt fault detection and diagnosis of sensorsIEEE Transactions on Instrumentation and Measurement, 2001
- Splines: a perfect fit for signal and image processingIEEE Signal Processing Magazine, 1999
- Nonlinear total variation based noise removal algorithmsPhysica D: Nonlinear Phenomena, 1992
- Statistical Ensembles of Complex, Quaternion, and Real MatricesJournal of Mathematical Physics, 1965