Using Wherry's Adjusted R 2 and Mallow's C p for Model Selection From All Possible Regressions
Authors:
- 1 January 2000
- journal article
- research article
- Published by Taylor & Francis in The Journal of Experimental Education
- Vol. 68 (4) , 365-380
Abstract
Selecting a subset of predictors from a pool of potential predictors continues to be a common problem encountered by applied researchers in education. Because of several limitations associated with stepwise variable selection procedures, the examination of all possible regression solutions has been recommended. The authors evaluated the use of Mallow's Cp and Wherry's adjusted R 2 statistics to select a final model from a pool of model solutions. Neither the Cp nor the adjusted R 2 statistic correctly identified the underlying regression model any better and was generally worse than the stepwise selection method, which itself was poor. Using any of the model selection procedures studied here resulted in biased estimates of the authentic regression coefficients and underestimation of their standard errors. The use of theory and professional judgment is recommended for the selection of variables in a prediction equation.Keywords
This publication has 15 references indexed in Scilit:
- The Interpretation of Mallows's C p -StatisticJournal of the Royal Statistical Society: Series D (The Statistician), 1996
- Stepwise Regression and Stepwise Discriminant Analysis Need Not Apply here: A Guidelines EditorialEducational and Psychological Measurement, 1995
- Backward, forward and stepwise automated subset selection algorithms: Frequency of obtaining authentic and noise variablesBritish Journal of Mathematical and Statistical Psychology, 1992
- Bootstrap investigation of the stability of a cox regression modelStatistics in Medicine, 1989
- Stepwise Regression in Social and Psychological ResearchPsychological Reports, 1989
- Multiple correlation: Exact power and sample size calculations.Psychological Bulletin, 1989
- Frequency of Selecting Noise Variables in Subset Regression Analysis: A Simulation StudyThe American Statistician, 1987
- Inflation of R 2 in Best Subset RegressionTechnometrics, 1980
- Comparison of Stopping Rules in Forward "Stepwise" RegressionJournal of the American Statistical Association, 1977
- A New Formula for Predicting the Shrinkage of the Coefficient of Multiple CorrelationThe Annals of Mathematical Statistics, 1931