A Comparison of Flare Forecasting Methods. IV. Evaluating Consecutive-Day Forecasting Patterns
Authors:
- Sung-Hong ParkSPSung-Hong Park
- K. D. LekaKLK. D. Leka
- Kanya KusanoKKKanya Kusano
- Graham BarnesGBGraham Barnes
- Suzy BinghamSBSuzy Bingham
- D. Shaun BloomfieldDBD. Shaun Bloomfield
- Aoife E. McCloskeyAMAoife E. McCloskey
- Veronique DelouilleVDVeronique Delouille
- Peter T. GallagherPGPeter T. Gallagher
- Manolis K. GeorgoulisMGManolis K. Georgoulis
Preprint
Abstract
A crucial challenge to successful flare prediction is forecasting periods that transition between "flare-quiet" and "flare-active". Building on earlier studies in this series (Barnes et al. 2016; Leka et al. 2019a,b) in which we describe methodology, details, and results of flare forecasting comparison efforts, we focus here on patterns of forecast outcomes (success and failure) over multi-day periods. A novel analysis is developed to evaluate forecasting success in the context of catching the first event of flare-active periods, and conversely, of correctly predicting declining flare activity. We demonstrate these evaluation methods graphically and quantitatively as they provide both quick comparative evaluations and options for detailed analysis. For the testing interval 2016-2017, we determine the relative frequency distribution of two-day dichotomous forecast outcomes for three different event histories (i.e., event/event, no-event/event and event/no-event), and use it to highlight performance differences between forecasting methods. A trend is identified across all forecasting methods that a high/low forecast probability on day-1 remains high/low on day-2 even though flaring activity is transitioning. For M-class and larger flares, we find that explicitly including persistence or prior flare history in computing forecasts helps to improve overall forecast performance. It is also found that using magnetic/modern data leads to improvement in catching the first-event/first-no-event transitions. Finally, 15% of major (i.e., M-class or above) flare days over the testing interval were effectively missed due to a lack of observations from instruments away from the Earth-Sun line.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- The NWRA Classification Infrastructure: description and extension to the Discriminant Analysis Flare Forecasting System (DAFFS)Journal of Space Weather and Space Climate, 2018
- Verification of Space Weather Forecasts Issued by the Met Office Space Weather Operations CentreSpace Weather, 2017
- Automatic recognition of complex magnetic regions on the Sun in SDO magnetogram images and prediction of flares: Techniques and results for the revised flare prediction program FlarecastSpace Weather, 2017
- Verification of operational solar flare forecast: Case of Regional Warning Center JapanJournal of Space Weather and Space Climate, 2017
- Flare forecasting at the Met Office Space Weather Operations CentreSpace Weather, 2017
- Verification of space weather forecasting at the Regional Warning Center in BelgiumJournal of Space Weather and Space Climate, 2014
- Validation of the NOAA Space Weather Prediction Center's solar flare forecasting look‐up table and forecaster‐issued probabilitiesSpace Weather, 2012
- Automatic recognition of complex magnetic regions on the Sun in GONG magnetogram images and prediction of flares: Techniques for the flare warning program FlarecastSpace Weather, 2011
- A tool for empirical forecasting of major flares, coronal mass ejections, and solar particle events from a proxy of active‐region free magnetic energySpace Weather, 2011
- Automated Solar Activity Prediction: A hybrid computer platform using machine learning and solar imaging for automated prediction of solar flaresSpace Weather, 2009