Enhancing Time Series Product Demand Forecasting With Hybrid Attention-Based Deep Learning Models
Open Access
- 12 December 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 190079-190091
Abstract
Time series forecasting plays a crucial role in various industries, particularly in predicting product demand for effective supply chain management. This paper presents a novel approach to time series forecasting by leveraging advanced deep learning techniques, specifically focusing on hybrid models that combine attention mechanisms with traditional recurrent neural networks. Our proposed method, the Hybrid Attention-based Long Short-Term Memory (HA-LSTM) network, integrates multi-head self-attention modules with LSTM layers to capture both long-term dependencies and local temporal patterns in time series data. We evaluate our model on a large-scale retail dataset from the "Predict Future Sales" competition, demonstrating its effectiveness in handling complex, real-world time series with multiple seasonalities and trends. Experimental results show that the HA-LSTM outperforms state-of-the-art baselines, including ARIMA, Prophet, and vanilla LSTM models, achieving a 15% improvement in Mean Absolute Percentage Error (MAPE) and a 12% reduction in Root Mean Square Error (RMSE). Furthermore, we conduct an extensive ablation study to analyze the contribution of each component in our hybrid model. The proposed approach not only enhances forecasting accuracy but also provides interpretable attention weights, offering insights into the relative importance of different time steps in making predictions. This research contributes to the growing body of work on deep learning for time series analysis and offers practical implications for improving demand forecasting in retail and supply chain management.Keywords
This publication has 21 references indexed in Scilit:
- Recurrent Neural Networks for Time Series Forecasting: Current status and future directionsInternational Journal of Forecasting, 2021
- DeepAR: Probabilistic forecasting with autoregressive recurrent networksInternational Journal of Forecasting, 2020
- A hybrid method of exponential smoothing and recurrent neural networks for time series forecastingInternational Journal of Forecasting, 2020
- Explaining Explanations: An Overview of Interpretability of Machine Learning2018
- Forecasting at ScaleThe American Statistician, 2018
- Supply chain forecasting: Theory, practice, their gap and the futureEuropean Journal of Operational Research, 2016
- Deep learningNature, 2015
- Forecasting and operational research: a reviewJournal of the Operational Research Society, 2008
- Forecasting with Exponential Smoothing2008
- Financial time series forecasting using support vector machinesNeurocomputing, 2003