Time2Graph+: Bridging Time Series and Graph Representation Learning via Multiple Attentions
- 7 July 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. PP (10414347) , 1
Abstract
Time series modeling has attracted great research interests in the last decades. Among the literature, shapelet-based models aim to extract representative subsequences, and could offer explanatory insights. In order to capture the shapelet dynamics and evolutions, we propose a novel framework of bridging time series representation learning and graph modeling, with two different implementations. We first formulate the process of extracting time-aware shapelets, then briefly introduce the key idea of transforming time series data into shapelet evolution graphs, to model the shapelet evolutionary patterns. A straightforward solution is to enumerate all possible shapelet transitions among adjacent time series segments, and apply a random-walk-based graph embedding algorithm to learn the time series representations (Time2Graph). We further extend Time2Graph by adopting graph attention mechanism to refine the procedure of modeling shapelet evolutions, namely Time2Graph+. Specifically, we transform each time series data into a unique and unweighted shapelet graph, and use GAT to automatically capture the correlations between shapelets. Experimental results show the significant improvements of Time2Graph+, and extensive observational analysis demonstrate the effectiveness and interpretability brought by attentions. Furthermore, the success of online deployment of Time2Graph+ model in State Grid of China validates the whole framework in the real-world application.Keywords
Funding Information
- National Key Research and Development Project of China (2018AAA0101900)
This publication has 52 references indexed in Scilit:
- Rotation-invariant similarity in time series using bag-of-patterns representationJournal of Intelligent Information Systems, 2012
- Experimental comparison of representation methods and distance measures for time series dataData Mining and Knowledge Discovery, 2012
- Using derivatives in time series classificationData Mining and Knowledge Discovery, 2012
- Weighted dynamic time warping for time series classificationPattern Recognition, 2011
- Early classification on time seriesKnowledge and Information Systems, 2011
- A brief survey on sequence classificationACM SIGKDD Explorations Newsletter, 2010
- Time series shapelets: a novel technique that allows accurate, interpretable and fast classificationData Mining and Knowledge Discovery, 2010
- From time series to complex networks: The visibility graphProceedings of the National Academy of Sciences, 2008
- Experiencing SAX: a novel symbolic representation of time seriesData Mining and Knowledge Discovery, 2007
- Long Short-Term MemoryNeural Computation, 1997