FusionSF: Fuse Heterogeneous Modalities in a Vector Quantized Framework for Robust Solar Power Forecasting
Authors:
- Ziqing MaZMZiqing Ma
- Wenwei WangWWWenwei Wang
- Tian ZhouTZTian Zhou
- Chao ChenCCChao Chen
- Bingqing PengBPBingqing Peng
- Liang SunLSLiang Sun
- Rong JinRJRong Jin
Preprint
Abstract
Accurate solar power forecasting is crucial to integrate photovoltaic plants into the electric grid, schedule and secure the power grid safety. This problem becomes more demanding for those newly installed solar plants which lack sufficient data. Current research predominantly relies on historical solar power data or numerical weather prediction in a single-modality format, ignoring the complementary information provided in different modalities. In this paper, we propose a multi-modality fusion framework to integrate historical power data, numerical weather prediction, and satellite images, significantly improving forecast performance. We introduce a vector quantized framework that aligns modalities with varying information densities, striking a balance between integrating sufficient information and averting model overfitting. Our framework demonstrates strong zero-shot forecasting capability, which is especially useful for those newly installed plants. Moreover, we collect and release a multi-modal solar power (MMSP) dataset from real-world plants to further promote the research of multi-modal solar forecasting algorithms. Our extensive experiments show that our model not only operates with robustness but also boosts accuracy in both zero-shot forecasting and scenarios rich with training data, surpassing leading models. We have incorporated it into our eForecaster platform and deployed it for more than 300 solar plants with a capacity of over 15GW.Keywords
All Related Versions
This publication has 22 references indexed in Scilit:
- RoFormer: Enhanced transformer with Rotary Position EmbeddingNeurocomputing, 2023
- Energy forecasting with robust, flexible, and explainable machine learning algorithmsAI Magazine, 2023
- A Transformer-based multimodal-learning framework using sky images for ultra-short-term solar irradiance forecastingApplied Energy, 2023
- The value of forecasts for PV power plants operating in the past, present and future Scandinavian energy marketsSolar Energy, 2023
- Accurate one step and multistep forecasting of very short-term PV power using LSTM-TCN modelRenewable Energy, 2023
- A review of solar forecasting, its dependence on atmospheric sciences and implications for grid integration: Towards carbon neutralityRenewable and Sustainable Energy Reviews, 2022
- Multimodal deep learning from satellite and street-level imagery for measuring income, overcrowding, and environmental deprivation in urban areasRemote Sensing of Environment, 2021
- A review of power system planning and operational models for flexibility assessment in high solar energy penetration scenariosSolar Energy, 2020
- The ERA5 global reanalysisQuarterly Journal of the Royal Meteorological Society, 2020
- Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyondInternational Journal of Forecasting, 2016