Improved Catoni-Type Confidence Sequences for Estimating the Mean When the Variance Is Infinite
Preprint
Abstract
We consider a discrete time stochastic model with infinite variance and study the mean estimation problem as in Wang and Ramdas (2023). We refine the Catoni-type confidence sequence (abbr. CS) and use an idea of Bhatt et al. (2022) to achieve notable improvements of some currently existing results for such model. Specifically, for given $\alpha \in (0, 1]$, we assume that there is a known upper bound $\nu_{\alpha} > 0$ for the $(1 + \alpha)$-th central moment of the population distribution that the sample follows. Our findings replicate and `optimize' results in the above references for $\alpha = 1$ (i.e., in models with finite variance) and enhance the results for $\alpha < 1$. Furthermore, by employing the stitching method, we derive an upper bound on the width of the CS as $\mathcal{O} \left(((\log \log t)/t)^{\frac{\alpha}{1+\alpha}}\right)$ for the shrinking rate as $t$ increases, and $\mathcal{O}(\left(\log (1/\delta)\right)^{\frac{\alpha }{1+\alpha}})$ for the growth rate as $\delta$ decreases. These bounds are improving upon the bounds found in Wang and Ramdas (2023). Our theoretical results are illustrated by results from a series of simulation experiments. Comparing the performance of our improved $\alpha$-Catoni-type CS with the bound in the above cited paper indicates that our CS achieves tighter width.
Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Catoni-style confidence sequences for heavy-tailed mean estimationStochastic Processes and their Applications, 2023
- Mean Estimation and Regression Under Heavy-Tailed Distributions: A SurveyFoundations of Computational Mathematics, 2019
- Sub-Gaussian mean estimatorsThe Annals of Statistics, 2016
- Challenging the empirical mean and empirical variance: A deviation studyAnnales de l'Institut Henri Poincaré, Probabilités et Statistiques, 2012
- PAC-Bayesian Inequalities for MartingalesIEEE Transactions on Information Theory, 2012
- Inference Problems Involving Moment Determinacy of DistributionsCommunications in Statistics - Theory and Methods, 2012
- Stochastic Approximation Algorithms and Applications1997
- Interim Analyses: The Repeated Confidence Interval ApproachJournal of the Royal Statistical Society Series B: Statistical Methodology, 1989
- A note on confidence sequences in multiparameter exponential familiesJournal of Multivariate Analysis, 1979
- SOME FURTHER REMARKS ON INEQUALITIES FOR SAMPLE SUMSProceedings of the National Academy of Sciences, 1968