A disk-aware algorithm for time series motif discovery
Open Access
- 18 April 2010
- journal article
- research article
- Published by Springer Nature in Data Mining and Knowledge Discovery
- Vol. 22 (1-2) , 73-105
Abstract
Time series motifs are sets of very similar subsequences of a long time series. They are of interest in their own right, and are also used as inputs in several higher-level data mining algorithms including classification, clustering, rule-discovery and summarization. In spite of extensive research in recent years, finding time series motifs exactly in massive databases is an open problem. Previous efforts either found approximate motifs or considered relatively small datasets residing in main memory. In this work, we leverage off previous work on pivot-based indexing to introduce a disk-aware algorithm to find time series motifs exactly in multi-gigabyte databases which contain on the order of tens of millions of time series. We have evaluated our algorithm on datasets from diverse areas including medicine, anthropology, computer networking and image processing and show that we can find interesting and meaningful motifs in datasets that are many orders of magnitude larger than anything considered before.Keywords
This publication has 42 references indexed in Scilit:
- Brain Activity-Based Image Classification From Rapid Serial Visual PresentationIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2008
- Querying and mining of time series dataProceedings of the VLDB Endowment, 2008
- Selecting maximally informative genesComputers & Chemical Engineering, 2005
- Mining arbitrary-length repeated patterns in television broadcast2005
- Probabilistic discovery of time series motifs2003
- EEG changes accompanying learned regulation of 12-Hz EEG activityIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2003
- High performance data mining using the nearest neighbor join2003
- Similarity Join in Metric Spaces Using eD-Index2003
- Closest pair queries in spatial databases2000
- Multidimensional divide-and-conquerCommunications of the ACM, 1980