Risk-Limiting Postelection Audits: Conservative $P$-Values From Common Probability Inequalities
- 9 October 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Information Forensics and Security
- Vol. 4 (4) , 1005-1014
Abstract
Postelection audits of a random sample of batches of ballots against a trustworthy audit trail can limit the risk of certifying an incorrect electoral outcome to alpha, guaranteeing that - if the apparent outcome is wrong - the chance of a full hand count of the audit trail is at least 1-alpha. Risk-limiting audits can be built as sequential tests that audit more batches until either 1) there is strong evidence that the outcome is correct, given the errors found, or 2) there has been a complete hand count. The P -value of the hypothesis that the outcome is wrong is the largest chance, for all scenarios in which the outcome is wrong, that overstatements of the margins between winners and losers would be ldquono largerrdquo than they were observed to be. Different definitions of ldquolargerrdquo give different P -values. A small P -value is strong evidence that the outcome is correct. This paper gives simple approaches to calculating a conservative P-value for several ways of summarizing overstatements and several ways of drawing the sample of batches to audit, emphasizing sampling with probability proportional to a bound up on the error in the pth audit batch (PPEB sampling). A P-value based on Markov's inequality applied to a martingale constructed from the data seems the most efficient among the methods discussed; there are plans to use it to audit contests in two California counties in November 2009.Keywords
This publication has 24 references indexed in Scilit:
- Construction of Confidence Intervals for the Mean of a Population Containing Many Zero ValuesJournal of Business & Economic Statistics, 1998
- Correction: Inference and Auditing: The Stringer BoundInternational Statistical Review, 1993
- Inference and Auditing: The Stringer BoundInternational Statistical Review, 1992
- Probability1992
- The Tight Constant in the Dvoretzky-Kiefer-Wolfowitz InequalityThe Annals of Probability, 1990
- A Method of One-Sided Nonparametric Inference for the Mean of a Nonnegative PopulationThe American Statistician, 1987
- Tightening CAV (DUS) Bounds by Using a Parametric ModelJournal of Accounting Research, 1986
- Estimating the Total Overstatement Error in Accounting PopulationsJournal of the American Statistical Association, 1977
- Probability Inequalities for Sums of Bounded Random VariablesJournal of the American Statistical Association, 1963
- Asymptotic Minimax Character of the Sample Distribution Function and of the Classical Multinomial EstimatorThe Annals of Mathematical Statistics, 1956