Deep Time Series Forecasting With Shape and Temporal Criteria
- 24 February 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 45 (1) , 342-355
Abstract
This paper addresses the problem of multi-step time series forecasting for non-stationary signals that can present sudden changes. Current state-of-the-art deep learning forecasting methods, often trained with variants of the MSE, lack the ability to provide sharp predictions in deterministic and probabilistic contexts. To handle these challenges, we propose to incorporate shape and temporal criteria in the training objective of deep models. We define shape and temporal similarities and dissimilarities, based on a smooth relaxation of Dynamic Time Warping (DTW) and Temporal Distortion Index (TDI), that enable to build differentiable loss functions and positive semi-definite (PSD) kernels. With these tools, we introduce DILATE (DIstortion Loss including shApe and TimE), a new objective for deterministic forecasting, that explicitly incorporates two terms supporting precise shape and temporal change detection. For probabilistic forecasting, we introduce STRIPE++ (Shape and Time diverRsIty in Probabilistic for Ecasting), a framework for providing a set of sharp and diverse forecasts, where the structured shape and time diversity is enforced with a determinantal point process (DPP) diversity loss. Extensive experiments and ablations studies on synthetic and real-world datasets confirm the benefits of leveraging shape and time features in time series forecasting.Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- Dynamic Time Warping under limited warping path lengthInformation Sciences, 2017
- Assessing energy forecasting inaccuracy by simultaneously considering temporal and absolute errorsEnergy Conversion and Management, 2017
- Anomaly detection in ECG time signals via deep long short-term memory networks2015
- A Bias and Variance Analysis for Multistep-Ahead Time Series ForecastingIEEE Transactions on Neural Networks and Learning Systems, 2015
- Identifying Wind and Solar Ramping Events2013
- Weighted dynamic time warping for time series classificationPattern Recognition, 2011
- Mean squared error: Love it or leave it? A new look at Signal Fidelity MeasuresIEEE Signal Processing Magazine, 2009
- Probabilistic Forecasts, Calibration and SharpnessJournal of the Royal Statistical Society Series B: Statistical Methodology, 2007
- Quantile RegressionJournal of Economic Perspectives, 2001
- Long Short-Term MemoryNeural Computation, 1997