Using algorithms to address trade‐offs inherent in predicting recidivism
Authors:
Top Cited Papers
- 5 May 2020
- journal article
- research article
- Published by Wiley in Behavioral Sciences & the Law
- Vol. 38 (3) , 259-278
Abstract
Although risk assessment has increasingly been used as a tool to help reform the criminal justice system, some stakeholders are adamantly opposed to using algorithms. The principal concern is that any benefits achieved by safely reducing rates of incarceration will be offset by costs to racial justice claimed to be inherent in the algorithms themselves. But fairness trade‐offs are inherent to the task of predicting recidivism, whether the prediction is made by an algorithm or human. Based on a matched sample of 67,784 Black and White federal supervisees assessed with the Post Conviction Risk Assessment, we compared how three alternative strategies for “debiasing” algorithms affect these trade‐offs, using arrest for a violent crime as the criterion . These candidate algorithms all strongly predict violent reoffending (areas under the curve = 0.71–72), but vary in their association with race (r = 0.00–0.21) and shift trade‐offs between balance in positive predictive value and false‐positive rates. Providing algorithms with access to race (rather than omitting race or “blinding” its effects) can maximize calibration and minimize imbalanced error rates. Implications for policymakers with value preferences for efficiency versus equity are discussed.Keywords
This publication has 23 references indexed in Scilit:
- The federal Post Conviction Risk Assessment (PCRA): A construction and validation study.Psychological Services, 2013
- Crime and Incarceration in the United States2011
- Implementing Anti-Discrimination Policies in Statistical Profiling ModelsAmerican Economic Journal: Economic Policy, 2011
- EFFECT OF SUSPECT RACE ON OFFICERS’ ARREST DECISIONS*Criminology, 2011
- Conceptual and Technical Issues in Conducting and Interpreting Differential Prediction AnalysesIndustrial and Organizational Psychology, 2010
- What Explains Persistent Racial Disproportionality in Minnesota’s Prison and Jail Populations?Crime and Justice, 2009
- Assessing the Race–Crime and Ethnicity–Crime Relationship in a Sample of Serious Adolescent DelinquentsCrime & Delinquency, 2008
- Comparing effect sizes in follow-up studies: ROC Area, Cohen's d, and r.Law and Human Behavior, 2005
- Race, Gender, and Guidelines-Based Decision MakingJournal of Research in Crime and Delinquency, 1996
- TEST BIAS: PREDICTION OF GRADES OF NEGRO AND WHITE STUDENTS IN INTEGRATED COLLEGESJournal of Educational Measurement, 1968