Shrinkage parameter selection via modified cross-validation approach for ridge regression model
- 10 November 2018
- journal article
- research article
- Published by Taylor & Francis in Communications in Statistics - Simulation and Computation
- Vol. 49 (7) , 1922-1930
Abstract
The ridge regression estimator has been consistently demonstrated to be an attractive shrinkage method to reduce the effects of multicollinearity. The choice of the ridge shrinkage parameter is critical. Cross-validation method is a widely adopted method for shrinkage parameter selection. However, cross-validation method suffers from instability in determining the best shrinkage parameter. To address this problem, a modification of the cross-validation method is proposed by repeating fold assignment. And then, a proper quantile value of the best shrinkage parameter values is utilized. Simulation and real data example results demonstrate that the proposed method is outperformed cross-validation and generalized cross-validation methods.Keywords
This publication has 23 references indexed in Scilit:
- Selection of the Ridge Parameter Using Mathematical ProgrammingCommunications in Statistics - Simulation and Computation, 2013
- Combining Unbiased Ridge and Principal Component Regression EstimatorsCommunications in Statistics - Theory and Methods, 2009
- On Some Ridge Regression Estimators: An Empirical ComparisonsCommunications in Statistics - Simulation and Computation, 2009
- Some Modifications for Choosing Ridge ParametersCommunications in Statistics - Theory and Methods, 2006
- Choosing Ridge Parameter for Regression ProblemsCommunications in Statistics - Theory and Methods, 2005
- Performance of Some New Ridge Regression EstimatorsCommunications in Statistics - Simulation and Computation, 2003
- Variable Selection and Shrinkage: Comparison of Some ApproachesStatistica Neerlandica, 2001
- Generalized Cross-Validation as a Method for Choosing a Good Ridge ParameterTechnometrics, 1979
- A Monte Carlo Evaluation of Some Ridge-Type EstimatorsJournal of the American Statistical Association, 1975
- Ridge Regression: Biased Estimation for Nonorthogonal ProblemsTechnometrics, 1970