A Multi-Head Attention-Enhanced Fusion Model for Cross-Domain Short-Term Time Series Forecasting
Open Access
- 24 July 2026
- journal article
- research article
- Published by MDPI AG in Mathematics
- Vol. 14 (15) , 2675
Abstract
With the rapid advancement of artificial intelligence technologies in the era of big data, time series forecasting has become indispensable in critical fields such as environmental monitoring and financial market analysis. However, the existing forecasting models often encounter performance limitations when extracting high-dimensional features and generally cannot dynamically focus on critical information within long-term sequences. To address these challenges, this study proposes a multi-head attention fusion model (MAFM) designed to enhance the predictive accuracy and modelling capability for high-dimensional and nonlinear data across diverse application scenarios. Experiments were conducted on two heterogeneous datasets from the environmental and financial domains. After the key hyperparameters of the MAFM were optimized through an orthogonal experimental design, the model achieved coefficients of determination exceeding 0.90 on both datasets. Furthermore, the results of four comparative experiments demonstrate that the MAFM consistently outperforms traditional machine learning models, including support vector regression and extreme gradient boosting, as well as state-of-the-art deep learning models such as long short-term memory, temporal convolutional networks, and transformers. Compared with the best-performing baseline model on each sub-dataset, the MAFM reduced the mean squared error by 44.4%, 8.3%, 29.4%, and 65.5%, respectively, highlighting its superior predictive performance and strong generalization capability. In summary, the proposed MAFM provides an efficient, robust, and interpretable solution for time series forecasting tasks across multiple domains. Its outstanding performance demonstrates significant potential for practical applications in environmental monitoring, financial forecasting, and other real-world scenarios.Keywords
Funding Information
- Taizhou University (TZXY2018QDJJ006)
- Young Science and Technology Talent Support Project of Taizhou
- National Natural Science Foundation of China (62473225)
This publication has 50 references indexed in Scilit:
- Time series prediction for cryptocurrency markets with transformer and parallel convolutional neural networksApplied Soft Computing, 2025
- A comprehensive survey of deep learning for time series forecasting: architectural diversity and open challengesArtificial Intelligence Review, 2025
- A wind speed forecasting framework for multiple turbines based on adaptive gate mechanism enhanced multi-graph attention networksApplied Energy, 2024
- Multi-head attention-based probabilistic CNN-BiLSTM for day-ahead wind speed forecastingEnergy, 2023
- Long-time series ecological environment quality monitoring and cause analysis in the Dianchi Lake Basin, ChinaEcological Indicators, 2023
- A New CNN-Based Model for Financial Time Series: TAIEX and FTSE Stocks ForecastingNeural Processing Letters, 2022
- Time series analysis of climate variables using seasonal ARIMA approachJournal of Earth System Science, 2020
- Financial time series forecasting with deep learning : A systematic literature review: 2005–2019Applied Soft Computing, 2020
- A CNN–LSTM model for gold price time-series forecastingNeural Computing and Applications, 2020
- Comparison of Support Vector Machine and Extreme Gradient Boosting for predicting daily global solar radiation using temperature and precipitation in humid subtropical climates: A case study in ChinaEnergy Conversion and Management, 2018