Threshold detection for the generalized Pareto distribution: Review of representative methods and application to the NOAA NCDC daily rainfall database
- 8 April 2016
- journal article
- review article
- Published by American Geophysical Union (AGU) in Water Resources Research
- Vol. 52 (4) , 2659-2681
Abstract
In extreme excess modeling, one fits a generalized Pareto (GP) distribution to rainfall excesses above a properly selected thresholdu. The latter is generally determined using various approaches, such as nonparametric methods that are intended to locate the changing point between extreme and nonextreme regions of the data, graphical methods where one studies the dependence of GP‐related metrics on the threshold levelu, and Goodness‐of‐Fit (GoF) metrics that, for a certain level of significance, locate the lowest thresholduthat a GP distribution model is applicable. Here we review representative methods for GP threshold detection, discuss fundamental differences in their theoretical bases, and apply them to 1714 overcentennial daily rainfall records from the NOAA‐NCDC database. We find that nonparametric methods are generally not reliable, while methods that are based on GP asymptotic properties lead to unrealistically high threshold and shape parameter estimates. The latter is justified by theoretical arguments, and it is especially the case in rainfall applications, where the shape parameter of the GP distribution is low; i.e., on the order of 0.1–0.2. Better performance is demonstrated by graphical methods and GoF metrics that rely on preasymptotic properties of the GP distribution. For daily rainfall, we find that GP threshold estimates range between 2 and 12 mm/d with a mean value of 6.5 mm/d, while the existence of quantization in the empirical records, as well as variations in their size, constitute the two most important factors that may significantly affect the accuracy of the obtained results.Keywords
Funding Information
- European Social Fund Plus
This publication has 103 references indexed in Scilit:
- Generalized Pareto Fit to the Society of Actuaries’ Large Claims DatabaseNorth American Actuarial Journal, 2003
- Regional analysis of annual maximum and partial duration flood data by nonparametric and L-moment methodsJournal of Hydrology, 2000
- Tail Index Estimation, Pareto Quantile Plots, and Regression DiagnosticsJournal of the American Statistical Association, 1996
- Uncertainty measures of regional flood frequency estimatorsJournal of Hydrology, 1995
- Computing Maximum Likelihood Estimates for the Generalized Pareto DistributionTechnometrics, 1993
- The POT model described by the generalized Pareto distribution with Poisson arrival rateJournal of Hydrology, 1991
- Parameter and Quantile Estimation for the Generalized Pareto DistributionTechnometrics, 1987
- The Influence Curve and its Role in Robust EstimationJournal of the American Statistical Association, 1974
- Some results on tests for Poisson processesBiometrika, 1965
- A Test of Goodness of FitJournal of the American Statistical Association, 1954