The estimation problem of minimum mean squared error

Authors:
  • LDLuc Devroye
    Luc Devroye
  • DSDominik Schäfer
    Dominik Schäfer
  • LGLászló Györfi
    László Györfi
  • HWHarro Walk
    Harro Walk

Abstract
Regression analysis of a response variable Y requires careful selection of explanatory variables. The quality of a set of explanatory features X =( X (1) ,..., X ( d ) ) can be measured in terms of the minimum mean squared error . This paper investigates methods for estimating L * from i.i.d. data. No estimate can converge rapidly for all distributions of ( X , Y ). For Lipschitz continuous regression function E { Y | X = x }, two estimators for L * are discussed: fitting a regression estimate to a subset of the data and assessing its mean residual sum of squares on the remaining samples, and a nearest neighbor cross-validation type estimate.

This publication has 9 references indexed in Scilit: