Estimation of the density of regression errors by pointwise model selection
Author:
- 1 December 2009
- journal article
- Published by Allerton Press in Mathematical Methods of Statistics
- Vol. 18 (4) , 341-374
Abstract
This paper presents two results: a density estimator and an estimator of regression error density. We first propose a density estimator constructed by model selection, which is adaptive for the quadratic risk at a given point. Then we apply this result to estimate the error density in a homoscedastic regression framework Y i = b(X i ) + ε i from which we observe a sample (X i , Y i ). Given an adaptive estimator $ \hat b $ of the regression function, we apply the density estimation procedure to the residuals $ \hat \varepsilon _i = Y_i - \hat b(X_i ) $ . We get an estimator of the density of ε i whose rate of convergence for the quadratic pointwise risk is the maximum of two rates: the minimax rate we would get if the errors were directly observed and the minimax rate of convergence of $ \hat b $ for the quadratic integrated risk.
Keywords
This publication has 15 references indexed in Scilit:
- Empirical likelihood estimators for the error distribution in nonparametric regression modelsMathematical Methods of Statistics, 2008
- Adaptive density deconvolution with dependent inputsMathematical Methods of Statistics, 2008
- Estimation of the density of regression errorsThe Annals of Statistics, 2005
- Concentration around the mean for maxima of empirical processesThe Annals of Probability, 2005
- Model selection for regression on a random designESAIM: Probability and Statistics, 2002
- Non‐parametric Estimation of the Residual DistributionScandinavian Journal of Statistics, 2001
- Exact adaptive pointwise estimation on Sobolev classes of densitiesESAIM: Probability and Statistics, 2001
- Model selection for regression on a fixed designProbability Theory and Related Fields, 2000
- Minimum Contrast Estimators on Sieves: Exponential Bounds and Rates of ConvergenceBernoulli, 1998
- Constructive Approximation1993