Nonasymptotic universal smoothing factors, kernel complexity and Yatracos classes
Authors:
- Luc DevroyeLDLuc Devroye
- Gábor LugosiGLGábor Lugosi
Open Access
- 1 December 1997
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 25 (6) , 2626-2637
Abstract
We introduce a method to select a smoothing factor for kernel density estimation such that, for all densities in all dimensions, the $L_1$ error of the corresponding kernel estimate is not larger than three times the error of the estimate with the optimal smoothing factor plus a constant times $\sqrt{\log n/n}$, where n is the sample size, and the constant depends only on the complexity of the kernel used in the estimate. The result is nonasymptotic, that is, the bound is valid for each n. The estimate uses ideas from the minimum distance estimation work of Yatracos. As the inequality is uniform with respect to all densities, the estimate is asymptotically minimax optimal (modulo a constant) over many function classes.
Keywords
This publication has 10 references indexed in Scilit:
- Universal smoothing factor selection in density estimation: theory and practiceTEST, 1997
- A universally acceptable smoothing factor for kernel density estimatesThe Annals of Statistics, 1996
- A Probabilistic Theory of Pattern Recognition1996
- Asymptotic Performance Bounds for the Kernel EstimateThe Annals of Statistics, 1988
- Rates of Convergence of Minimum Distance Estimators and Kolmogorov's EntropyThe Annals of Statistics, 1985
- Bounds for the uniform deviation of empirical measuresJournal of Multivariate Analysis, 1982
- On the Uniform Convergence of Relative Frequencies of Events to Their ProbabilitiesTheory of Probability & Its Applications, 1971
- On Estimation of a Probability Density Function and ModeThe Annals of Mathematical Statistics, 1962
- Remarks on Some Nonparametric Estimates of a Density FunctionThe Annals of Mathematical Statistics, 1956
- An approximation to the density functionAnnals of the Institute of Statistical Mathematics, 1954