Large Models for Time Series and Spatio-Temporal Data: A Survey and Outlook
Authors:
- Ming JinMJMing Jin
- Qingsong WenQWQingsong Wen
- Yuxuan LiangYLYuxuan Liang
- Chaoli ZhangCZChaoli Zhang
- Siqiao XueSXSiqiao Xue
- Xue WangXWXue Wang
- James ZhangJZJames Zhang
- Yi WangYWYi Wang
- Haifeng ChenHCHaifeng Chen
- Xiaoli LiXLXiaoli Li
- Shirui PanSPShirui Pan
- Vincent S. TsengVTVincent S. Tseng
Preprint
Abstract
Temporal data, notably time series and spatio-temporal data, are prevalent in real-world applications. They capture dynamic system measurements and are produced in vast quantities by both physical and virtual sensors. Analyzing these data types is vital to harnessing the rich information they encompass and thus benefits a wide range of downstream tasks. Recent advances in large language and other foundational models have spurred increased use of these models in time series and spatio-temporal data mining. Such methodologies not only enable enhanced pattern recognition and reasoning across diverse domains but also lay the groundwork for artificial general intelligence capable of comprehending and processing common temporal data. In this survey, we offer a comprehensive and up-to-date review of large models tailored (or adapted) for time series and spatio-temporal data, spanning four key facets: data types, model categories, model scopes, and application areas/tasks. Our objective is to equip practitioners with the knowledge to develop applications and further research in this underexplored domain. We primarily categorize the existing literature into two major clusters: large models for time series analysis (LM4TS) and spatio-temporal data mining (LM4STD). On this basis, we further classify research based on model scopes (i.e., general vs. domain-specific) and application areas/tasks. We also provide a comprehensive collection of pertinent resources, including datasets, model assets, and useful tools, categorized by mainstream applications. This survey coalesces the latest strides in large model-centric research on time series and spatio-temporal data, underscoring the solid foundations, current advances, practical applications, abundant resources, and future research opportunities.Keywords
All Related Versions
This publication has 117 references indexed in Scilit:
- VideoChat: chat-centric video understandingScience China Information Sciences, 2025
- Swap Attention in Spatiotemporal Diffusions for Text-to-Video GenerationInternational Journal of Computer Vision, 2025
- A comprehensive survey on pretrained foundation models: a history from BERT to ChatGPTInternational Journal of Machine Learning and Cybernetics, 2024
- WEASEL 2.0: a random dilated dictionary transform for fast, accurate and memory constrained time series classificationMachine Learning, 2023
- AA-forecast: anomaly-aware forecast for extreme eventsData Mining and Knowledge Discovery, 2023
- Federated Learning for Healthcare InformaticsJournal of Healthcare Informatics Research, 2020
- Financial time series forecasting with deep learning : A systematic literature review: 2005–2019Applied Soft Computing, 2020
- Temporal Link Prediction: A SurveyNew Generation Computing, 2019
- Video Question Answering with Spatio-Temporal ReasoningInternational Journal of Computer Vision, 2019
- A survey on activity recognition and behavior understanding in video surveillanceThe Visual Computer, 2012