Estimating the Accuracy of Jury Verdicts
- 18 June 2007
- journal article
- Published by Wiley in Journal of Empirical Legal Studies
- Vol. 4 (2) , 305-329
Abstract
Average accuracy of jury verdicts for a set of cases can be studied empirically and systematically even when the correct verdict cannot be known. The key is to obtain a second rating of the verdict, for example, the judge's, as in the recent study of criminal cases in the United States by the National Center for State Courts (NCSC). That study, like the famous Kalven‐Zeisel study, showed only modest judge‐jury agreement. Simple estimates of jury accuracy can be developed from the judge‐jury agreement rate; the judge's verdict is not taken as the gold standard. Although the estimates of accuracy are subject to error, under plausible conditions they tend to overestimate the average accuracy of jury verdicts. The jury verdict was estimated to be accurate in no more than 87 percent of the NCSC cases (which, however, should not be regarded as a representative sample with respect to jury accuracy). More refined estimates, including false conviction and false acquittal rates, are developed with models using stronger assumptions. For example, the conditional probability that the jury incorrectly convicts given that the defendant truly was not guilty (a “Type I error”) was estimated at 0.25, with an estimated standard error (s.e.) of 0.07, the conditional probability that a jury incorrectly acquits given that the defendant truly was guilty (“Type II error”) was estimated at 0.14 (s.e. 0.03), and the difference was estimated at 0.12 (s.e. 0.08). The estimated number of defendants in the NCSC cases who truly are not guilty but are convicted does seem to be smaller than the number who truly are guilty but are acquitted. The conditional probability of a wrongful conviction, given that the defendant was convicted, is estimated at 0.10 (s.e. 0.03).Keywords
This publication has 16 references indexed in Scilit:
- Judge‐Jury Agreement in Criminal Cases: A Partial Replication of Kalven and Zeisel's The American JuryJournal of Empirical Legal Studies, 2005
- A re-examination of the 1966 Kalven-Zeisel study of judge-jury agreements and disagreements and their causesLaw, Probability and Risk, 2004
- Analysis of Categorical Response Profiles By Informative SummariesSociological Methodology, 2001
- On Procedures for Evaluating the Effectiveness of Reinterview Survey Methods: Application to Labor Force DataJournal of the American Statistical Association, 1996
- Prediction Functions for Categorical Panel DataThe Annals of Statistics, 1995
- Modelling patterns of agreement and disagreementStatistical Methods in Medical Research, 1992
- Miracles and Statistics: The Casual Assumption of IndependenceJournal of the American Statistical Association, 1988
- A Study of Poisson's Models for Jury Verdicts in Criminal and Civil TrialsJournal of the American Statistical Association, 1973
- A Study of Poisson's Models for Jury Verdicts in Criminal and Civil TrialsJournal of the American Statistical Association, 1973
- Some Concepts of DependenceThe Annals of Mathematical Statistics, 1966