More on Liu-Type Estimator in Linear Regression
Author:
- Kejian LiuKLKejian Liu
- 1 January 2004
- journal article
- Published by Taylor & Francis in Communications in Statistics - Theory and Methods
- Vol. 33 (11) , 2723-2733
Abstract
Recently, Liu [Liu, K. (2003). Using Liu-type estimator to combat collinearity. Commun. Statist. Theory Methods 32:1009–1020] introduced the Liu-type estimator to combat collinearity in linear regression. The Liu-type estimator can be applied in two ways. First, when the effect of collinearity is moderate, the Liu-type estimator can be used as a means to further improve the performance of ridge regression. In this case, k selected by existing methods for ridge regression usually is random. Here, we generalize the results in Liu (2003) to the random k case and prove that when k is selected by Hoerl–Kennard formula, the Liu-type estimator is still able to further improve ridge regression. Second, when collinearity is severe, we suggest to choose k based on condition number consideration, which is different from the existing selection methods, and then use the second parameter in Liu-type estimator to make adjustment. We use simulation to provide some empirical justification for the choice of k prop...Keywords
This publication has 12 references indexed in Scilit:
- Using Liu-Type Estimator to Combat CollinearityCommunications in Statistics - Theory and Methods, 2003
- Classical Studies That Revolutionized the Practice of Regression AnalysisTechnometrics, 2000
- On the almost unbiased generalized liu estimator and unbiased estimation of the bias and mseCommunications in Statistics - Theory and Methods, 1995
- A new class of blased estimate in linear regressionCommunications in Statistics - Theory and Methods, 1993
- Condition Numbers and Minimax Ridge Regression EstimatorsJournal of the American Statistical Association, 1985
- A Simulation Study of Some Ridge EstimatorsJournal of the American Statistical Association, 1981
- Regression Diagnostics1980
- Explicit and Constrained Generalized Ridge EstimationTechnometrics, 1978
- Minimax Estimators of the Mean of a Multivariate Normal DistributionThe Annals of Statistics, 1975
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970