Gregoire Francisco
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Gregoire Francisco has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Dario Del Moro
Dipartimento di Fisica, Università di Roma Tor Vergata
3 shared publications - Joao Fernandes
CITEUC, Geophysical and Astronomical Observatory
2 shared publications - Michele Berretti
University of Trento
2 shared publications - Ronish Mugatwala
Department of Physics, University of Rome Tor Vergata
2 shared publications - Simone Chierichini
School of Mathematical and Physical Sciences Solar Physics and Space Plasma Research Centre (SP2RC) University of Sheffield S3 7RH Sheffield UK
2 shared publications Enrico Camporeale
1 shared publication
Latest Publications
- Open Access
- 16 May 2025
- Published by American Astronomical Society in The Astrophysical Journal
- Vol. 985 (1) , 108
Limits of Solar Flare Forecasting Models and New Deep Learning Approach*
Reliable forecasting models are necessary to mitigate the risks posed by solar flares to human technology. This study introduces a novel deep learning forecasting approach while emphasizing the need for performance evaluation methods tailored to better highlight current models’ limitations. In particular, we show that models reaching state-of-the-art performance with traditional metrics have similar explanatory power to no-skill persistence models and notably struggle to forecast change in activity significantly better than random guesses. We also discuss shortcomings in traditional evaluation metrics like the True Skill Statistic (TSS), which we show to be mathematically dependent on the class balance for specific models. We introduce patch-distributed CNNs, which allow us to perform full-disk forecasts while providing event probabilities in solar subregions and position predictions. This new framework offers similar information to active region (AR)-based forecasting models while bypassing the problem of unrecorded and misattributed flares that are detrimental to machine learning training. As a result, the model also operates independently of prior feature extraction and AR detection, thus offering promising operational utility with minimal external dependencies. Finally, a method is proposed for constructing balanced and independent cross-validation folds for full-disk models. Models combining Solar Dynamic Observatory (SDO)/Atmospheric Imaging Assembly EUV images as inputs show improved performance compared to employing SDO/HMI photospheric magnetograms, with a TSS of 0.74 for the C+ model and 0.62 for the M+ model.
- 16 May 2025
- Published by American Astronomical Society in The Astrophysical Journal
- Vol. 985 (1) , 108
Open AccessLimits of Solar Flare Forecasting Models and New Deep Learning Approach*
Reliable forecasting models are necessary to mitigate the risks posed by solar flares to human technology. This study introduces a novel deep learning forecasting approach while emphasizing the need for performance evaluation methods tailored to better highlight current models’ limitations. In particular, we show that models reaching state-of-the-art performance with traditional metrics have similar explanatory power to no-skill persistence models and notably struggle to forecast change in activity significantly better than random guesses. We also discuss shortcomings in traditional evaluation metrics like the True Skill Statistic (TSS), which we show to be mathematically dependent on the class balance for specific models. We introduce patch-distributed CNNs, which allow us to perform full-disk forecasts while providing event probabilities in solar subregions and position predictions. This new framework offers similar information to active region (AR)-based forecasting models while bypassing the problem of unrecorded and misattributed flares that are detrimental to machine learning training. As a result, the model also operates independently of prior feature extraction and AR detection, thus offering promising operational utility with minimal external dependencies. Finally, a method is proposed for constructing balanced and independent cross-validation folds for full-disk models. Models combining Solar Dynamic Observatory (SDO)/Atmospheric Imaging Assembly EUV images as inputs show improved performance compared to employing SDO/HMI photospheric magnetograms, with a TSS of 0.74 for the C+ model and 0.62 for the M+ model.
- Open Access
- 15 May 2024
- Published by Wiley
Limits of solar flare forecasting models and new deep learning approach
Reliable forecasting models are necessary to mitigate the risks posed by solar flares to human technology. This study introduces a novel deep learning forecasting approach while emphasizing the need for performance evaluation methods tailored to better highlight current models’ limitations. In particular, we show that models reaching state-of-the-art performances with traditional metrics have similar explanatory power to no-skill persistence models and notably struggle to forecast change in activity significantly better than random guesses. We also discuss other shortcomings in traditional evaluation metric like the True Skill Statistic (TSS) that we prove for the first time to be mathematically dependent to the class balance. We introduce Patch-Distributed-CNNs (P-CNN), which allow to perform full-disk forecasts while providing event probabilities in solar sub-regions and position predictions. This new framework offers similar information to Active-Region-based forecasting models while bypassing the problem of unrecorded and misattributed flares that are detrimental to machine learning training. As a result, the model also operates independently of prior feature extraction and AR detection, thus offering promising operational utility with minimal external dependencies. Finally, a method is proposed for constructing balanced and independent Cross-Validation folds for full-disk models. Models combining SDO/AIA EUV images as inputs show improved performances compared to employing SDO/HMI photospheric magnetograms, with a TSS of 0.74 for the C+ model and 0.62 for the M+ model.
- 15 May 2024
- Published by Wiley
Open AccessLimits of solar flare forecasting models and new deep learning approach
Reliable forecasting models are necessary to mitigate the risks posed by solar flares to human technology. This study introduces a novel deep learning forecasting approach while emphasizing the need for performance evaluation methods tailored to better highlight current models’ limitations. In particular, we show that models reaching state-of-the-art performances with traditional metrics have similar explanatory power to no-skill persistence models and notably struggle to forecast change in activity significantly better than random guesses. We also discuss other shortcomings in traditional evaluation metric like the True Skill Statistic (TSS) that we prove for the first time to be mathematically dependent to the class balance. We introduce Patch-Distributed-CNNs (P-CNN), which allow to perform full-disk forecasts while providing event probabilities in solar sub-regions and position predictions. This new framework offers similar information to Active-Region-based forecasting models while bypassing the problem of unrecorded and misattributed flares that are detrimental to machine learning training. As a result, the model also operates independently of prior feature extraction and AR detection, thus offering promising operational utility with minimal external dependencies. Finally, a method is proposed for constructing balanced and independent Cross-Validation folds for full-disk models. Models combining SDO/AIA EUV images as inputs show improved performances compared to employing SDO/HMI photospheric magnetograms, with a TSS of 0.74 for the C+ model and 0.62 for the M+ model.
- Open Access
- 2 February 2024
- Published by EDP Sciences in Journal of Space Weather and Space Climate
- Vol. 14
A Bayesian approach to the drag-based modelling of ICMEs
Coronal Mass Ejections (CMEs) are huge clouds of magnetised plasma expelled from the solar corona that can travel towards the Earth and cause significant space weather effects. The Drag-Based Model (DBM) describes the propagation of CMEs in an ambient solar wind as analogous to an aerodynamic drag. The drag-based approximation is popular because it is a simple analytical model that depends only on two parameters, the drag parameter $ \gamma $ and the solar wind speed $ w$. DBM thus allows us to obtain reliable estimates of CME transit time at low computational cost. Previous works proposed a probabilistic version of DBM, the Probabilistic Drag Based Model (P-DBM), which enables the evaluation of the uncertainties associated with the predictions. In this work, we infer the “a-posteriori” probability distribution functions (PDFs) of the $ \gamma $ and $ w$ parameters of the DBM by exploiting a well-established Bayesian inference technique: the Monte Carlo Markov Chains (MCMC) method. By utilizing this Bayesian method through two different approaches, an ensemble and an individual approach, we obtain specific DBM parameter PDFs for two ensembles of CMEs: those travelling with fast and slow solar wind, respectively. Subsequently, we assess the operational applicability of the model by forecasting the arrival time of CMEs. While the ensemble approach displays notable limitations, the individual approach yields promising results, demonstrating competitive performances compared to the current state-of-the-art, with a Mean Absolute Error (MAE) of 9.86 ± 4.07 h achieved in the best-case scenario.- 2 February 2024
- Published by EDP Sciences in Journal of Space Weather and Space Climate
- Vol. 14
Open AccessA Bayesian approach to the drag-based modelling of ICMEs
Coronal Mass Ejections (CMEs) are huge clouds of magnetised plasma expelled from the solar corona that can travel towards the Earth and cause significant space weather effects. The Drag-Based Model (DBM) describes the propagation of CMEs in an ambient solar wind as analogous to an aerodynamic drag. The drag-based approximation is popular because it is a simple analytical model that depends only on two parameters, the drag parameter $ \gamma $ and the solar wind speed $ w$. DBM thus allows us to obtain reliable estimates of CME transit time at low computational cost. Previous works proposed a probabilistic version of DBM, the Probabilistic Drag Based Model (P-DBM), which enables the evaluation of the uncertainties associated with the predictions. In this work, we infer the “a-posteriori” probability distribution functions (PDFs) of the $ \gamma $ and $ w$ parameters of the DBM by exploiting a well-established Bayesian inference technique: the Monte Carlo Markov Chains (MCMC) method. By utilizing this Bayesian method through two different approaches, an ensemble and an individual approach, we obtain specific DBM parameter PDFs for two ensembles of CMEs: those travelling with fast and slow solar wind, respectively. Subsequently, we assess the operational applicability of the model by forecasting the arrival time of CMEs. While the ensemble approach displays notable limitations, the individual approach yields promising results, demonstrating competitive performances compared to the current state-of-the-art, with a Mean Absolute Error (MAE) of 9.86 ± 4.07 h achieved in the best-case scenario.