Determination of the best significance level in forward stepwise logistic regression
Authors:
- 1 January 1997
- journal article
- research article
- Published by Taylor & Francis in Communications in Statistics - Simulation and Computation
- Vol. 26 (2) , 559-575
Abstract
The χ2 test based on a fixed a level (χ2 (a)) is the standard stopping criterion in forward stepwise logistic regression. SAS/IML programs were written to provide Monte Carlo simulations to determine the best a level for the χ2 (a) stopping criterion. Performance was evaluated using Efron's (1986) estimated true error rate of prediction. The best a varied between 0.05 and 0,40. In all cases, it increased linearly the number of predictor variables; in the multivariate binary case, it also depended upon the mean of the binary variables in one population and the difference between the means of the binary variables in the two populations. An overall recommendation is that 0.15 ≤ a ≤ 0.20 should be used for the χ2 (a) stopping criterion.Keywords
This publication has 20 references indexed in Scilit:
- Prediction Error and Its Estimation for Subset-Selected ModelsTechnometrics, 1991
- Best Subsets Logistic RegressionBiometrics, 1989
- How Biased is the Apparent Error Rate of a Prediction Rule?Journal of the American Statistical Association, 1986
- Cross-Validation, the Jackknife, and the Bootstrap: Excess Error Estimation in Forward Logistic RegressionJournal of the American Statistical Association, 1986
- Estimating the Error Rate of a Prediction Rule: Improvement on Cross-ValidationJournal of the American Statistical Association, 1983
- Comparison of Stopping Rules in Forward Stepwise Discriminant AnalysisJournal of the American Statistical Association, 1979
- Efficient Screening of Nonnormal Regression Models1978
- Comparison of Stopping Rules in Forward "Stepwise" RegressionJournal of the American Statistical Association, 1977
- Sample-Based Multinomial ClassificationBiometrics, 1973
- Sample-Based Classification Procedures Derived from Density EstimatorsJournal of the American Statistical Association, 1972