Abstract
Significance: Statistical analyses of randomized experiments often rely on asymptoticPvalues instead of using the actual randomization procedure that led to the observed data. Fisher-exact and asymptoticPvalues can differ dramatically: The former should be preferred because it is calculated using the exact null randomization distribution, which, in small samples, can substantially differ from its approximating Student’stdistribution. Moreover, we may learn something scientifically interesting from examining the shape of the null randomization distribution.
Funding Information
  • HHS | NIH | NIH Office of the Director (DP5O0D021412)
  • HHS | National Institutes of Health (RO1 AI102710)
  • National Science Foundation (IIS 1409177)

This publication has 12 references indexed in Scilit: