Limits of Solar Flare Forecasting Models and New Deep Learning Approach*
Open Access
- 16 May 2025
- journal article
- Published by American Astronomical Society in The Astrophysical Journal
- Vol. 985 (1) , 108
Abstract
Reliable forecasting models are necessary to mitigate the risks posed by solar flares to human technology. This study introduces a novel deep learning forecasting approach while emphasizing the need for performance evaluation methods tailored to better highlight current models’ limitations. In particular, we show that models reaching state-of-the-art performance with traditional metrics have similar explanatory power to no-skill persistence models and notably struggle to forecast change in activity significantly better than random guesses. We also discuss shortcomings in traditional evaluation metrics like the True Skill Statistic (TSS), which we show to be mathematically dependent on the class balance for specific models. We introduce patch-distributed CNNs, which allow us to perform full-disk forecasts while providing event probabilities in solar subregions and position predictions. This new framework offers similar information to active region (AR)-based forecasting models while bypassing the problem of unrecorded and misattributed flares that are detrimental to machine learning training. As a result, the model also operates independently of prior feature extraction and AR detection, thus offering promising operational utility with minimal external dependencies. Finally, a method is proposed for constructing balanced and independent cross-validation folds for full-disk models. Models combining Solar Dynamic Observatory (SDO)/Atmospheric Imaging Assembly EUV images as inputs show improved performance compared to employing SDO/HMI photospheric magnetograms, with a TSS of 0.74 for the C+ model and 0.62 for the M+ model.Keywords
All Related Versions
Funding Information
- H2020 Excellent science Marie Skłodowska-Curie Actions (955620)
- MEC ∣ Fundação para a Ciência e a Tecnologia (UIDP+UIDB/00611/2019)
- MEC ∣ Fundação para a Ciência e a Tecnologia (UIDB+UIDP/04434/2020)
This publication has 36 references indexed in Scilit:
- Explaining Full-Disk Deep Learning Model for Solar Flare Prediction Using Attribution Methods2023
- A new catalogue of solar flare events from soft X-ray GOES signal in the period 1986–2020Advances In Space Research, 2022
- Attention‐Based Machine Vision Models and Techniques for Solar Wind Speed Forecasting Using Solar EUV ImagesSpace Weather, 2022
- The Challenge of Machine Learning in Space Weather: Nowcasting and ForecastingSpace Weather, 2019
- The Solar Dynamics Observatory (SDO)Solar Physics, 2011
- The Atmospheric Imaging Assembly (AIA) on the Solar Dynamics Observatory (SDO)Solar Physics, 2011
- Driving major solar flares and eruptions: A reviewAdvances In Space Research, 2009
- Methods of Digital Video Microscopy for Colloidal StudiesJournal of Colloid and Interface Science, 1996
- Temperature and emission measure from goes soft X-ray measurementsSolar Physics, 1994
- Comparison of the predicted and observed secondary structure of T4 phage lysozymeBiochimica et Biophysica Acta (BBA) - Protein Structure, 1975