Weather temperature prediction based on LSTM and transformer
Author:
- 11 December 2024
- conference paper
- Published by SPIE-Intl Soc Optical Eng
- Vol. 13445, 206-214
Abstract
Weather temperature prediction is widely used in the fields of environmental management and disaster warning. Temperature prediction based on meteorology is more expensive and has a shorter time horizon. This paper proposes a weather temperature prediction method based on Long Short-Term Memory (LSTM) and Transformer to predict future temperature based on historical temperature information. First of all, Seasonal and Trend decomposition using Loess (STL) is used for feature decomposition to segment weather trends and noise. Then, feature extraction and prediction are carried out based on the LSTM-Transformer hybrid model. When the model is trained on real weather data, the Mean Absolute Error (MAE) and Root Mean Square Error (RMSE) reach 0.1902 and 0.2558 respectively, which is significantly better than the independent LSTM and Transformer models. These results show that the integration of LSTM and Transformer architecture can effectively improve the forecasting capability of meteorological time series analysis. Finally, the future research direction is prospected.Keywords
This publication has 14 references indexed in Scilit:
- Theoretical Limitations of Self-Attention in Neural Sequence ModelsTransactions of the Association for Computational Linguistics, 2020
- Impact Forecasting to Support Emergency Management of Natural HazardsReviews of Geophysics, 2020
- Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) networkPhysica D: Nonlinear Phenomena, 2020
- Power Transformer Operating State Prediction Method Based on an LSTM NetworkEnergies, 2018
- The Economic Impacts of Climate ChangeReview of Environmental Economics and Policy, 2018
- Social and economic impacts of climateScience, 2016
- Climate Change: The Public Health ResponseAmerican Journal of Public Health, 2008
- Analysis of Microarray Data Using Z Score TransformationThe Journal of Molecular Diagnostics, 2003
- Applications of seasonal to interannual climate prediction in agricultural planning and operationsAgricultural and Forest Meteorology, 2000
- Accelerated Degradation Tests: Modeling and AnalysisTechnometrics, 1998