A Subjective and Objective Evaluation of Model Forecasts of Sumatra Squall Events
- 1 April 2019
- journal article
- research article
- Published by American Meteorological Society in Weather and Forecasting
- Vol. 35 (2) , 489-506
Abstract
Sumatra squalls are important rain-bearing weather systems that affect Singapore and southern Peninsular Malaysia. The performance of forecasts for 63 past squall events is evaluated using a subjective evaluation by forecasters and an objective evaluation based on the fractions skill score (FSS). The purpose of this study is to investigate whether an objective procedure can reproduce the main results of the subjective evaluation. A convection permitting version of the Met Office (UKMO) Unified Model (UM), configured for a limited domain in the southern region of the South China Sea, is used with two driving global deterministic models: the UM and the European Centre for Medium-Range Weather Forecasts (ECMWF) model. Subjective and objective evaluation scoring methods for the two limited-area forecasts of the UM are compared, and it is shown that the objective procedure can reasonably emulate the scores produced by the forecasters in the context of parameters that are of direct relevance to the forecast process. This indicates that automated objective verification methods may be a reasonable alternative to resource intensive subjective evaluations for some cases. The robustness of the objective results is investigated using 7 months of data, and issues of statistical significance are considered.Keywords
This publication has 28 references indexed in Scilit:
- The Global Precipitation Measurement MissionBulletin of the American Meteorological Society, 2014
- Unified Modeling and Prediction of Weather and Climate: A 25-Year JourneyBulletin of the American Meteorological Society, 2012
- 3D-Var Assimilation of Insect-Derived Doppler Radar Radial Winds in Convective Cases Using a High-Resolution ModelMonthly Weather Review, 2011
- Neighborhood-Based Verification of Precipitation Forecasts from Convection-Allowing NCAR WRF Model Simulations and the Operational NAMWeather and Forecasting, 2010
- Verifying Forecasts SpatiallyBulletin of the American Meteorological Society, 2010
- Intercomparison of Spatial Forecast Verification Methods: Identifying Skillful Spatial Scales Using the Fractions Skill ScoreWeather and Forecasting, 2010
- Application of Spatial Verification Methods to Idealized and NWP-Gridded Precipitation ForecastsWeather and Forecasting, 2009
- Neighborhood Verification: A Strategy for Rewarding Close ForecastsWeather and Forecasting, 2009
- Fuzzy verification of high‐resolution gridded forecasts: a review and proposed frameworkMeteorological Applications, 2008
- Individual Comparisons by Ranking MethodsBiometrics Bulletin, 1945