How do bootstrap and permutation tests work?
Authors:
- Arnold JanssenAJArnold Janssen
- Thorsten PaulsTPThorsten Pauls
Open Access
- 1 June 2003
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 31 (3) , 768-806
Abstract
Resampling methods are frequently used in practice to adjust critical values of nonparametric tests. In the present paper a comprehensive and unified approach for the conditional and unconditional analysis of linear resampling statistics is presented. Under fairly mild assumptions we prove tightness and an asymptotic series representation for their weak accumulation points. From this series it becomes clear which part of the resampling statistic is responsible for asymptotic normality. The results leads to a discussion of the asymptotic correctness of resampling methods as well as their applications in testing hypotheses. They are conditionally correct iff a central limit theorem holds for the original test statistic. We prove unconditional correctness iff the central limit theorem holds or when symmetric random variables are resampled by a scheme of asymptotically random signs. Special cases are the m (n) out of k (n) bootstrap, the weighted bootstrap, the wild bootstrap and all kinds of permutation statistics. The program is carried out for convergent partial sums of rowwise independent infinitesimal triangular arrays in detail. These results are used to compare power functions of conditional resampling tests and their unconditional counterparts. The proof uses the method of random scores for permutation type statistics.Keywords
This publication has 41 references indexed in Scilit:
- Bootstrapping the Student t-StatisticThe Annals of Probability, 2001
- The asymptotic distribution of the bootstrap sample mean of an infinitesimal arrayAnnales de l'Institut Henri Poincaré, Probabilités et Statistiques, 1998
- Studentized permutation tests for non-i.i.d. hypotheses and the generalized Behrens-Fisher problemStatistics & Probability Letters, 1997
- Sums of Independent Triangular Arrays and Extreme Order StatisticsThe Annals of Probability, 1994
- Bootstrap, wild bootstrap, and asymptotic normalityProbability Theory and Related Fields, 1992
- Approximations to permutation and exchangeable processesJournal of Theoretical Probability, 1992
- Conditional Rank Tests for Randomly Censored DataThe Annals of Statistics, 1991
- Asymptotically optimal rank tests for the two-sample problem with randomly censored dataCommunications in Statistics - Theory and Methods, 1988
- The Supports of Infinitely Divisible Distribution FunctionsProceedings of the American Mathematical Society, 1975
- A Central Limit Theorem for Sums of Interchangeable Random VariablesThe Annals of Mathematical Statistics, 1958