Data sharpening methods for bias reduction in nonparametric regression
Authors:
- Edwin ChoiECEdwin Choi
- Peter HallPHPeter Hall
- Valentin RoussonVRValentin Rousson
Open Access
- 1 October 2000
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 28 (5) , 1339-1355
Abstract
We consider methods for kernel regression when the explanatory and/or response variables are adjusted prior to substitution into a conven- tional estimator.This “data-sharpening” procedure is designed to preserve the advantages of relatively simple, low-order techniques, for example, their robustness against design sparsity problems, yet attain the sorts of bias reductions that are commonly associated only with high-order methods.We consider Nadaraya–Watson and local-linear methods in detail, although data sharpening is applicable more widely. One approach in particular is found to give excellent performance. It involves adjusting both the explanatory and the response variables prior to substitution into a local linear estimator. The change to the explanatory variables enhances resistance of the estimator to design sparsity, by increasing the density of design points in places where the original density had been low. When combined with adjustment of the response variables, it produces a reduction in bias by an order of magnitude. Moreover, these advantages are available in multivariate settings. The data-sharpening step is simple to implement, since it is explicitly defined. It does not involve functional inversion, solution of equations or use of pilot bandwidths.Keywords
This publication has 15 references indexed in Scilit:
- Miscellanea. Data sharpening as a prelude to density estimationBiometrika, 1999
- Intentionally Biased Bootstrap MethodsJournal of the Royal Statistical Society Series B: Statistical Methodology, 1999
- Density adjusted kernel smoothers for random design nonparametric regressionStatistics & Probability Letters, 1997
- Mass recentred kernel smoothersBiometrika, 1997
- A simple bias reduction method for density estimationBiometrika, 1995
- Multivariate Locally Weighted Least Squares RegressionThe Annals of Statistics, 1994
- A multiplicative bias reduction method for nonparametric regressionStatistics & Probability Letters, 1994
- Identity Reproducing Multivariate Nonparametric RegressionJournal of Multivariate Analysis, 1993
- Local Linear Regression Smoothers and Their Minimax EfficienciesThe Annals of Statistics, 1993
- Kernel Function Smoothing of Insulin Absorption KineticsBiometrics, 1989