A Structured Study of Multivariate Time-Series Distance Measures
Open Access
- 17 June 2025
- journal article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Management of Data
- Vol. 3 (3) , 1-29
Abstract
Distance measures are fundamental to time series analysis and have been extensively studied for decades. Until now, research efforts mainly focused on univariate time series, leaving multivariate cases largely under-explored. Furthermore, the existing experimental studies on multivariate distances have critical limitations: (a) focusing only on lock-step and elastic measures while ignoring categories such as sliding and kernel measures; (b) considering only one normalization technique; and (c) placing limited focus on statistical analysis of findings. Motivated by these shortcomings, we present the most complete evaluation of multivariate distance measures to date. Our study examines 30 standalone measures across 8 categories, 2 channel-dependency models, and considers 13 normalizations. We perform a comprehensive evaluation across 30 datasets and 3 downstream tasks, accompanied by rigorous statistical analysis. To ensure fairness, we conduct a thorough investigation of parameters for methods in both a supervised and an unsupervised manner. Our work verifies and extends earlier findings, showing that insights from univariate distance measures also apply to the multivariate case: (a) alternative normalization methods outperform Z-score, and for the first time, we demonstrate statistical differences in certain categories for the multivariate case; (b) multiple lock-step measures are better suited than Euclidean distance, when it comes to multivariate time series; and (c) newer elastic measures outperform the widely adopted Dynamic Time Warping distance, especially with proper parameter tuning in the supervised setting. Moreover, our results reveal that (a) sliding measures offer the best trade-off between accuracy and runtime; (b) current normalization techniques fail to significantly enhance accuracy on multivariate time series and, surprisingly, do not outperform the no normalization case, indicating a lack of appropriate solutions for normalizing multivariate time series; and (c) independent consideration of time series channels is beneficial only for elastic measures. In summary, we offer guidelines to aid in designing and selecting preprocessing strategies and multivariate distance measures for our community.Keywords
Funding Information
- Universitas Brawijaya (101070122)
This publication has 79 references indexed in Scilit:
- VUS: effective and efficient accuracy measures for time-series anomaly detectionThe VLDB Journal, 2025
- catch22: CAnonical Time-series CHaracteristicsData Mining and Knowledge Discovery, 2019
- Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh – A Python package)Neurocomputing, 2018
- An online adaptive screening procedure for selective neuronal responsesJournal of Neuroscience Methods, 2017
- The Social Dynamics of Language Change in Online Networks2016
- Flexible non-linear predictive models for large-scale wind turbine diagnosticsWind Energy, 2016
- Generalizing DTW to the multi-dimensional case requires an adaptive approachData Mining and Knowledge Discovery, 2016
- Predicting the impact of scientific concepts using full‐text featuresJournal of the Association for Information Science and Technology, 2016
- On The Marriage of Lp-norms and Edit Distance2004
- An Introduction to Support Vector Machines and Other Kernel-based Learning Methods2000