VDMS: An Improved Vision Transformer-Based Model for PM2.5 Concentration Prediction
Open Access
- 30 June 2025
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 15 (13) , 7346
Abstract
China’s accelerating industrialization has led to worsening air pollution, characterized by recurrent haze episodes. The accurate quantification of PM2.5 distribution is crucial for air quality assessment and public health management. Although traditional prediction models can effectively identify PM2.5 concentration fluctuations with moderate accuracy, their dependence relies heavily on extensive ground-based monitoring station data, limiting their applicability in areas with sparse monitoring coverage. To address this limitation, this study proposes a novel algorithm for high-precision PM2.5 concentration prediction, termed VDMS (Vision Transformer with DLSTM Multi-Head Self-Attention and Self-supervision). Based on the traditional Vision Transformer (ViT) architecture, VDMS incorporates a Double-Layered Long Short-Term Memory (DLSTM) network and a Multi-Head Self-Attention mechanism to enhance the model’s capacity to capture temporal sequence features and global dependencies. These enhancements contribute to greater stability and robustness in feature representation, ultimately improving prediction performance. Cross-validation experimental results show that the VDMS model outperforms benchmark models in PM2.5 concentration prediction tasks, achieving a coefficient of determination (R2) of 0.93, a root mean square error (RMSE) of 4.05 μg/m3, and a mean absolute error (MAE) of 3.23 μg/m3. Furthermore, experiments conducted in areas with sparse ground monitoring stations demonstrate that the model maintains high predictive accuracy, further validating its applicability and generalization capability in data-limited scenarios. Moreover, the VDMS model adopts a modular design, offering strong scalability that allows its architecture to be adjusted according to specific requirements. This adaptability renders it suitable for monitoring various atmospheric pollutants, providing essential technical support for precise environmental management and air quality forecasting.Keywords
All Related Versions
Funding Information
- Key Lab of Information Network Security, Ministry of Public Security and the Shenzhen Fundamental Research Program (JCYJ20230807094104009)
This publication has 39 references indexed in Scilit:
- Air pollution, governance quality, and health outcomes: evidence from developing countriesEnvironmental Science and Pollution Research, 2023
- Assessing the evolution of PM2.5 and related health impacts resulting from air quality policies in ChinaEnvironmental Impact Assessment Review, 2022
- Estimating the daily PM2.5 concentration in the Beijing-Tianjin-Hebei region using a random forest model with a 0.01° × 0.01° spatial resolutionEnvironment International, 2020
- Redistribution characteristics of atmospheric precipitation in different spatial levels of Guangzhou urban typical forests in southern ChinaAtmospheric Pollution Research, 2019
- Evaluation of MAIAC aerosol retrievals over ChinaAtmospheric Environment, 2019
- Spatio-temporal evolution and the influencing factors of PM2.5 in China between 2000 and 2015Journal of Geographical Sciences, 2019
- A nonparametric approach to filling gaps in satellite-retrieved aerosol optical depth for estimating ambient PM2.5 levelsEnvironmental Pollution, 2018
- Wilson's disease: A 2017 updateClinics and Research in Hepatology and Gastroenterology, 2018
- Satellite-derived high resolution PM2.5 concentrations in Yangtze River Delta Region of China using improved linear mixed effects modelAtmospheric Environment, 2016
- Correlation between PM concentrations and aerosol optical depth in eastern ChinaAtmospheric Environment, 2009