A Preliminary Investigation of Maximum Likelihood Logistic Regression versus Exact Logistic Regression
Authors:
- 1 August 2002
- journal article
- Published by Taylor & Francis in The American Statistician
- Vol. 56 (3) , 163-170
Abstract
Logistic regression is used by practitioners and researchers in many fields, but is undoubtedly used most frequently in medical and biostatistical applications. Maximum likelihood is generally the estimation method of choice, but we show that maximum likelihood can produce very poor results under certain conditions. Specifically, the poor performance of maximum likelihood in the case of rare events is known and we review research on this topic. We primarily examine the performance of maximum likelihood in the presence of near separation, which has apparently not been studied. Exact logistic regression is the logical alternative to maximum likelihood. We offer a comparison of the two methods of estimation.Keywords
This publication has 15 references indexed in Scilit:
- Explaining Rare Events in International RelationsInternational Organization, 2001
- Efficient Monte Carlo Methods for Conditional Logistic RegressionJournal of the American Statistical Association, 2000
- The use of sighting data to analyse Iberian lynx habitat and distributionJournal of Applied Ecology, 1999
- Predictive Performance of the Binary Logit Model in Unbalanced SamplesJournal of the Royal Statistical Society: Series D (The Statistician), 1999
- Logistic regression in an adaptive Web cacheIEEE Internet Computing, 1999
- Improved Added Variable and Partial Residual Plots for the Detection of Influential Observations in Generalized Linear ModelsJournal of the Royal Statistical Society Series C: Applied Statistics, 1993
- Fisher's Exact TestJournal of the Royal Statistical Society Series A: Statistics in Society, 1992
- Must clinical trials be large? The interpretation of p‐values and the combination of test resultsStatistics in Medicine, 1990
- A note on A. Albert and J. A. Anderson's conditions for the existence of maximum likelihood estimates in logistic regression modelsBiometrika, 1986
- An Algorithm for Exact Logistic RegressionJournal of the American Statistical Association, 1984