A Machine-Learning Approach Based on Attention Mechanism for Significant Wave Height Forecasting
Open Access
- 19 September 2023
- journal article
- research article
- Published by MDPI AG in Journal of Marine Science and Engineering
- Vol. 11 (9) , 1821
Abstract
Significant wave height (SWH) is a key parameter for monitoring the state of waves. Accurate and long-term SWH forecasting is significant to maritime shipping and coastal engineering. This study proposes a transformer model based on an attention mechanism to achieve the forecasting of SWHs. The transformer model can capture the contextual information and dependencies between sequences and achieves continuous time series forecasting. Wave scale classification is carried out according to the forecasting results, and the results are compared with gated recurrent unit (GRU) and long short-term memory (LSTM) machine-learning models and the key laboratory of MArine Science and NUmerical Modeling (MASNUM) numerical wave model. The results show that the machine-learning models outperform the MASNUM within 72 h, with the transformer being the best model. For continuous 12 h, 24 h, 36 h, 48 h, 72 h, and 96 h forecasting, the average mean absolute errors (MAEs) of the test sets were, respectively, 0.139 m, 0.186 m, 0.223 m, 0.254 m, 0.302 m, and 0.329 m, and the wave scale classification accuracies were, respectively, 91.1%, 99.4%, 86%, 83.3%, 78.9%, and 77.5%. The experimental results validate that the transformer model can achieve continuous and accurate SWH forecasting, as well as accurate wave scale classification and early warning of waves, providing technical support for wave monitoring.Keywords
Funding Information
- National Key Research and Development Program of China (2021YFC3101100, LSKJ202203003, 42149102)
- Laoshan Laboratory (2021YFC3101100, LSKJ202203003, 42149102)
- National Natural Science Foundation of China (2021YFC3101100, LSKJ202203003, 42149102)
This publication has 37 references indexed in Scilit:
- Real-time in situ prediction of ocean currentsOcean Engineering, 2021
- Forecasting of Significant Wave Height Based on Gated Recurrent Unit Network in the Taiwan Strait and Its Adjacent WatersWater, 2021
- A novel model to predict significant wave height based on long short-term memory networkOcean Engineering, 2020
- Deep learning for multi-year ENSO forecastsNature, 2019
- Predicting ocean waves along the US east coast during energetic winter storms: sensitivity to whitecapping parameterizationsOcean Science, 2019
- Speech-Transformer: A No-Recurrence Sequence-to-Sequence Model for Speech Recognition2018
- Application of neural networks and support vector machine for significant wave height predictionOceanologia, 2017
- Forecasting of Time Series Significant Wave Height Using Wavelet Decomposed Neural NetworkAquatic Procedia, 2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Long Short-Term MemoryNeural Computation, 1997