A Hybrid Transformer-CNN Model for Interpolating Meteorological Data on the Tibetan Plateau
Open Access
- 8 April 2025
- journal article
- research article
- Published by MDPI AG in Atmosphere
- Vol. 16 (4) , 431
Abstract
High-quality observational data play a crucial role in deepening the investigation of the Tibetan Plateau’s influence on the Asian climate. This study employs eight machine learning models (support vector regression (SVR), k-nearest neighbors (KNN), extreme gradient boosting (XGBoost), random forest (RF), long short-term memory (LSTM), gated recurrent unit (GRU), Transformer, and Transformer–convolutional neural network (Transformer-CNN)) to interpolate missing observational data on surface net radiation (Rn), soil surface temperature (Ts), soil water content (SWC), air temperature (Ta), relative humidity (RH), and wind speed (WS) from the QOMS observation site. The data covers the period from 1 January 2007 through to 31 December 2016. A comparative evaluation of these models shows that the Transformer-CNN model consistently outperforms the other models in terms of prediction accuracy. On the test dataset, the coefficients of determination for the interpolated results of Ta, RH, WS, SWC, Ts, and Rn were 0.97, 0.92, 0.97, 0.79, 0.93, and 0.98, respectively. Secondly, the Transformer-CNN model was then applied to generate a complete meteorological dataset for the full period. A time series analysis of this dataset reveals statistically significant trends over the past decade: air temperature (Ta) increased by 0.60 °C (p = 0.022) and soil temperature (Ts) by 1.85 °C (p = 1.37 × 10−5). Meanwhile, wind speed (WS), soil water content (SWC), and net radiation (Rn) declined by 0.42 m/s (p = 1.18 × 10−12), 1.24% (p < 0.001), and 9.21 W/m2 (p = 8.81 × 10−6), respectively.Keywords
Funding Information
- Tibetan Plateau Scientific Expedition and Research (STEP) program (2019QZKK0102, 42175082, KYCX24_1460)
- National Science Foundation of China (2019QZKK0102, 42175082, KYCX24_1460)
- Postgraduate Research and Practice Innovation Program of Jiangsu Province (2019QZKK0102, 42175082, KYCX24_1460)
This publication has 46 references indexed in Scilit:
- Comparative evaluation of LSTM, CNN, and ConvLSTM for hourly short-term streamflow forecasting using deep learning approachesEcological Informatics, 2023
- A transformer neural network for predicting near‐surface temperatureMeteorological Applications, 2022
- Comparison of the use of a physical-based model with data assimilation and machine learning methods for simulating soil water dynamicsJournal of Hydrology, 2020
- A hybrid CNN-LSTM model for typhoon formation forecastingGeoInformatica, 2019
- Estimation of soil temperature from meteorological data using different machine learning modelsGeoderma, 2019
- Soil temperature estimation using an artificial neural network and co-active neuro-fuzzy inference system in two different climatesArabian Journal of Geosciences, 2016
- Recent climate changes over the Tibetan Plateau and their impacts on energy and water cycle: A reviewGlobal and Planetary Change, 2014
- Thermal state of permafrost and active layer in Central Asia during the international polar yearPermafrost and Periglacial Processes, 2010
- Uncertainty analysis of statistical downscaling methodsJournal of Hydrology, 2006
- Support-vector networksMachine Learning, 1995