Strategic two-sample test via the two-armed bandit process
Authors:
- 14 June 2023
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series B: Statistical Methodology
- Vol. 85 (4) , 1271-1298
Abstract
This study aims to improve the power of two-sample tests by analysing whether the difference between two population parameters is larger than a prespecified positive equivalence margin. The classic test statistic treats the original data as exchangeable, while the proposed test statistic breaks the structure and proposes employing a two-armed bandit process to strategically integrate the data and thus a strategy-specific test statistic is constructed by combining the classic CLT with the law of large numbers. The developed asymptotic theory is investigated by using nonlinear limit theory in a larger probability space and relates to the ‘strategic CLT’ with a clearly defined density function. The asymptotic distribution demonstrates that the proposed statistic is more concentrated under the null hypothesis and less concentrated under the alternative than the classic CLT, thereby enhancing the testing power. Simulation studies provide supporting evidence for the theoretical results and portray a more powerful performance when using finite samples. A real example is also added for illustration.Keywords
Funding Information
- National Key R&D Program of China (2018YFA0703900)
- National Statistical Science Research (2022LY080)
- Jinan Science and Technology Bureau (2021GXRC056)
- National Natural Science Foundation of China (11901352)
This publication has 24 references indexed in Scilit:
- A two-sample test for high-dimensional data with applications to gene-set testingThe Annals of Statistics, 2010
- Generalized Cramér–von Mises goodness-of-fit tests for multivariate distributionsComputational Statistics & Data Analysis, 2009
- A test for the mean vector with fewer observations than the dimensionJournal of Multivariate Analysis, 2008
- Marginal asymptotics for the “large $p$, small $n$” paradigm: With applications to microarray dataThe Annals of Statistics, 2007
- An Exact Distribution-Free Test Comparing Two Multivariate Distributions based on AdjacencyJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Gene expression analysis with the parametric bootstrapBiostatistics, 2001
- A multivariate Kolmogorov-Smirnov test of goodness of fitStatistics & Probability Letters, 1997
- Restless bandits: activity allocation in a changing worldJournal of Applied Probability, 1988
- A Generalized Two-Sample Wilcoxon Test for Doubly Censored DataBiometrika, 1965
- The Economics of Exhaustible ResourcesJournal of Political Economy, 1931