Anomaly detection in aggregates of grouped time series, composed of high-dimensional and high-frequency event sequences
Authors:
- Nuno Miguel Cerqueira da CostaNuno Miguel Cerqueira da Costa
- Armindo LoboALArmindo Lobo
- Suelma PinaSPSuelma Pina
- Francisco FrancoFFFrancisco Franco
- Andrew HumphreyAHAndrew Humphrey
- Ali AbbasiAAAli Abbasi
- Ricardo RodriguesRRRicardo Rodrigues
- Duarte FernandesDFDuarte Fernandes
- Negin MehrbodNMNegin Mehrbod
- Miguel AlvesMAMiguel Alves
- Emanuel GouveiaEGEmanuel Gouveia
Preprint
- 9 February 2026
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
Motivation: As enterprise information systems collect increasingly diverse event streams, the automatic detection of anomalous events is essential for applications like network security, system monitoring, and fraud detection.Methods: This study aims to develop robust techniques for automatically and computationally efficiently identifying anomalous behavior within high-dimensional event sequences, where events occur at specific timestamps (e.g., number of events per hour). The proposed frameworkleverages machine learning to detect anomalies within high-dimensional, high-frequency event sequence time series. By dynamically grouping time series based on shared categorical dimensions, the framework enables scalable anomaly detection across varying levels of aggregation, while maintaining detection sensitivity and specificity.Results: The framework has been validated using real-world telecommunications event data sets and evaluated against the case where no aggregation is performed (‘fully disaggregated’). In the case of our ‘minimum aggregation’ method, the training time is reduced by a factor of∼ 300, and inference time is reduced by a factor of 8. For our other method, ‘ideal aggregation’, the training time is reduced by a factor of 6.5, and the inference time is reduced by a factor of 7.6. The quality of anomaly detection is generally preserved across different aggregation levels of grouped high-dimensional data.Conclusions: This research advances anomaly detection techniques in grouped high-dimensional event sequence data, a complex yet increasingly common data format in fields like network security and system monitoring. The framework’s dimensional aggregation techniques enable efficient pattern recognition while maintaining detection sensitivity and specificity, critical for applications requiring faster anomaly detection response.Keywords
This publication has 21 references indexed in Scilit:
- Machine-learning classification of astronomical sources: estimating F1-score in the absence of ground truthMonthly Notices of the Royal Astronomical Society: Letters, 2022
- An Anomaly Detection Method for Multiple Time Series Based on Similarity Measurement and Louvain AlgorithmProcedia Computer Science, 2022
- Anomaly Detection for IoT Time-Series Data: A SurveyIEEE Internet of Things Journal, 2019
- A comprehensive survey on network anomaly detectionTelecommunication Systems, 2018
- Unsupervised real-time anomaly detection for streaming dataNeurocomputing, 2017
- Fast computation of reconciled forecasts for hierarchical and grouped time seriesComputational Statistics & Data Analysis, 2016
- A survey of anomaly detection techniques in financial domainFuture Generation Computer Systems, 2016
- Ward’s Hierarchical Agglomerative Clustering Method: Which Algorithms Implement Ward’s Criterion?Journal of Classification, 2014
- Understanding and forecasting aggregate and disaggregate price dynamicsEmpirical Economics, 2013
- Hierarchical Grouping to Optimize an Objective FunctionJournal of the American Statistical Association, 1963