A standardized methodology for the validation of air quality forecast applications (F-MQO): lessons learnt from its application across Europe
Open Access
- 27 October 2023
- journal article
- research article
- Published by Copernicus GmbH in Geoscientific Model Development
- Vol. 16 (20) , 6029-6047
Abstract
A standardized methodology for the validation of short-term air quality forecast applications was developed in the framework of the Forum for Air quality Modeling (FAIRMODE) activities. The proposed approach, focusing on specific features to be checked when evaluating a forecasting application, investigates the model's capability to detect sudden changes in pollutant concentration levels, predict threshold exceedances and reproduce air quality indices. The proposed formulation relies on the definition of specific forecast modelling quality objectives and performance criteria, defining the minimum level of quality to be achieved by a forecasting application when it is used for policy purposes. The persistence model, which uses the most recent observed value as the predicted value, is used as a benchmark for the forecast evaluation. The validation protocol has been applied to several forecasting applications across Europe, using different modelling paradigms and covering a range of geographical contexts and spatial scales. The method is successful, with room for improvement, in highlighting shortcomings and strengths of forecasting applications. This provides a useful basis for using short-term air quality forecasts as a supporting tool for providing correct information to citizens and regulators.Keywords
All Related Versions
This publication has 54 references indexed in Scilit:
- Real-time air quality forecasting, part I: History, techniques, and current statusAtmospheric Environment, 2012
- A review of operational, regional-scale, chemical weather forecasting models in EuropeAtmospheric Chemistry and Physics, 2012
- Evaluation of a CMAQ simulation at high resolution over the UK for the calendar year 2003Atmospheric Environment, 2010
- A framework for evaluating regional-scale numerical photochemical modeling systemsEnvironmental Fluid Mechanics, 2010
- Impact of large scale circulation on European summer surface ozone and consequences for modelling forecastAtmospheric Environment, 2009
- PM and light extinction model performance metrics, goals, and criteria for three-dimensional air quality modelsAtmospheric Environment, 2006
- Air pollution forecast in Portugal: a demand from the new air quality framework directiveInternational Journal of Environment and Pollution, 2005
- Air quality model performance evaluationMeteorology and Atmospheric Physics, 2004
- Violin Plots: A Box Plot-Density Trace SynergismThe American Statistician, 1998
- An El Niño–Southern Oscillation Climatology and Persistence (CLIPER) Forecasting SchemeWeather and Forecasting, 1997