Semiparametric exponential families for heavy-tailed data
- 10 March 2014
- journal article
- research article
- Published by Oxford University Press (OUP) in Biometrika
- Vol. 102 (2) , 486-493
Abstract
We propose a semiparametric method for fitting the tail of a heavy-tailed population given a relatively small sample from that population and a larger sample from a related background population. We model the tail of the small sample as an exponential tilt of the better-observed large-sample tail, using a robust sufficient statistic motivated by extreme value theory. In particular, our method induces an estimator of the small-population mean, and we give theoretical and empirical evidence that this estimator outperforms methods that do not use the background sample. We demonstrate substantial efficiency gains over competing methods in simulation and on data from a large controlled experiment conducted by Facebook.Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- Spectral Density Ratio Models for Multivariate ExtremesJournal of the American Statistical Association, 2014
- Proportional likelihood ratio models for mean regressionBiometrika, 2012
- Extreme Value Theory2006
- Merging Information for Semiparametric Density EstimationJournal of the Royal Statistical Society Series B: Statistical Methodology, 2004
- A Diagnostic for Selecting the Threshold in Extreme Value AnalysisJournal of the Royal Statistical Society Series B: Statistical Methodology, 2001
- A Semiparametric Approach to the One-Way LayoutTechnometrics, 2001
- An Introduction to Statistical Modeling of Extreme Values2001
- Using specially designed exponential families for density estimationThe Annals of Statistics, 1996
- On Some Simple Estimates of an Exponent of Regular VariationJournal of the Royal Statistical Society Series B: Statistical Methodology, 1982
- A Simple General Approach to Inference About the Tail of a DistributionThe Annals of Statistics, 1975