The HulC: confidence regions from convex hulls
Authors:
- 26 December 2023
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series B: Statistical Methodology
- Vol. 86 (3) , 586-622
Abstract
We develop and analyse the HulC, an intuitive and general method for constructing confidence sets using the convex hull of estimates constructed from subsets of the data. Unlike classical methods which are based on estimating the (limiting) distribution of an estimator, the HulC is often simpler to use and effectively bypasses this step. In comparison to the bootstrap, the HulC requires fewer regularity conditions and succeeds in many examples where the bootstrap provably fails. Unlike sub-sampling, the HulC does not require knowledge of the rate of convergence of the estimators on which it is based. The validity of the HulC requires knowledge of the (asymptotic) median bias of the estimators. We further analyse a variant of our basic method, called the Adaptive HulC, which is fully data-driven and estimates the median bias using sub-sampling. We discuss these methods in the context of several challenging inferential problems which arise in parametric, semi-parametric, and non-parametric inference. Although our focus is on validity under weak regularity conditions, we also provide some general results on the width of the HulC confidence sets, showing that in many cases the HulC confidence sets have near-optimal width.Keywords
All Related Versions
This publication has 85 references indexed in Scilit:
- Bias reduction in exponential family nonlinear modelsBiometrika, 2009
- Inconsistency of the Bootstrap when a Parameter is on the Boundary of the Parameter SpaceEconometrica, 2000
- On Subsampling Estimators with Unknown Rate of ConvergenceJournal of the American Statistical Association, 1999
- On nondifferentiable functions and the bootstrapProbability Theory and Related Fields, 1993
- Bootstrap, wild bootstrap, and asymptotic normalityProbability Theory and Related Fields, 1992
- Best Median-Unbiased Estimation in Linear Regression with Bounded Asymmetric Loss FunctionsJournal of the American Statistical Association, 1987
- On the Bootstrap and Confidence IntervalsThe Annals of Statistics, 1986
- On Adaptive EstimationThe Annals of Statistics, 1982
- Eine Approximation der Binomialverteilung durch die Normalverteilung der Ordnung 1/nProbability Theory and Related Fields, 1970
- Some Numerical Comparisons of Several Approximations to the Binomial DistributionJournal of the American Statistical Association, 1969