For testing the significance of regression coefficients, go ahead and log‐transform count data
- 6 May 2015
- journal article
- research article
- Published by Wiley in Methods in Ecology and Evolution
- Vol. 6 (7) , 828-835
Abstract
Summary: The rise in the use of statistical models for non‐Gaussian data, such as generalized linear models (GLMs) and generalized linear mixed models (GLMMs), is pushing aside the traditional approach of transforming data and applying least‐squares linear models (LMs). Nonetheless, many least‐squares statistical tests depend on the variance of the sum of residuals, which by the Central Limit Theorem converge to a Gaussian distribution for large sample sizes. Therefore, least‐squares LMs will likely have good performance in assessing the statistical significance of regression coefficients. Using simulations of count data, I compared GLM approaches for testing whether regression coefficients differ from zero with the traditional approach of applying LMs to transformed data. Simulations assumed that variation among sample populations was either (i) negative binomial or (ii) log‐normal Poisson (i.e. log‐normal variation among populations that were then sampled by a Poisson distribution). I used the simulated data to conduct tests of the hypotheses that regression coefficients differed from zero; I did not investigate statistical properties of the coefficient estimators, such as bias and precision. For negative binomial simulations whose assumptions closely matched the GLMs, the GLMs were nonetheless prone to type I errors (false positives) especially when there was more than one predictor (independent) variable. After correcting for type I errors, however, the GLMs provided slightly better statistical power than LMs. For log‐normal‐Poisson simulations, both a GLMM and the LMs performed well, but under some simulated conditions the GLMs had high type I error rates, a deadly sin for statistical tests. These results show that, while GLMs have slight advantages in power when they are properly specified, they can lead to badly wrong conclusions about the significance of regression coefficients if they are mis‐specified. In contrast, transforming data and applying least‐squares linear analyses provide robust statistical tests for significance over a wide range of conditions. Thus, the traditional approach of transforming data and applying LMs is still useful.Keywords
Funding Information
- US National Science Foundation (DEB-LTREB-1052160)
This publication has 20 references indexed in Scilit:
- An Accessible Method for Implementing Hierarchical Models with Spatio-Temporal Abundance DataPLOS ONE, 2012
- A generalized model for overdispersed count dataPopulation Ecology, 2012
- Generalized linear mixed models for phylogenetic analyses of community structureEcological Monographs, 2011
- Do not log‐transform count dataMethods in Ecology and Evolution, 2010
- QUASI-POISSON VS. NEGATIVE BINOMIAL REGRESSION: HOW SHOULD WE MODEL OVERDISPERSED COUNT DATA?Ecology, 2007
- SIMPLICITY AND COMPLEXITY IN ECOLOGICAL DATA ANALYSISEcology, 2007
- Zero tolerance ecology: improving ecological inference by modelling the source of zero observationsEcology Letters, 2005
- Species richness estimators: how many species can dance on the head of a pin?Journal of Animal Ecology, 2005
- Analysis of Overdispersed Count Data from Single-Factor Experiments: A Comparative StudyJournal of Agricultural, Biological and Environmental Statistics, 1999
- Analyzing over-dispersed count data in two-way cross-classification problems using generalized linear modelsJournal of Statistical Computation and Simulation, 1999