Imperfect Tools: A Research Note on Developing, Applying, and Increasing Understanding of Criminal Justice Risk Assessments
Open Access
- 21 June 2023
- journal article
- research article
- Published by SAGE Publications in Criminal Justice Policy Review
- Vol. 34 (4) , 319-336
Abstract
This article shares considerations for designing, implementing, and understanding risk assessments used to reduce recidivism of people under community supervision. These insights are gleaned from 27 data scientists who participated in focus groups during the National Institute of Justice’s Recidivism Challenge Winners Symposium. Analyses revealed three primary themes: design considerations, implementation, and increasing awareness and understanding of risk assessments. Critical aspects of the design phase include validating the tool, incorporating field data that account for real-time changes, and adopting strategies to address false positives/negatives and the model’s complexity. Upon the tool’s development, practitioners are recommended to devise an implementation plan, balance attention to risk with client-focused needs, and exercise modest discretion while considering algorithmic results. Recognizing the value predictive instruments bring to decision-making and identifying their limitations is needed to increase understanding for all stakeholders. Collaboration and dialogue between tool developers and practitioners are crucial at every stage.Keywords
This publication has 31 references indexed in Scilit:
- Commentary: Risk Assessment in the Age of Evidence-Based Practice and PolicyInternational Journal of Forensic Mental Health, 2017
- Performance of recidivism risk assessment instruments in U.S. correctional settings.Psychological Services, 2016
- How the machine ‘thinks’: Understanding opacity in machine learning algorithmsBig Data & Society, 2016
- Structured Risk Assessment Instruments: A Systematic Review of Implementation DeterminantsPsychiatry, Psychology and Law, 2015
- Machine Learning Forecasts of Risk to Inform Sentencing DecisionsFederal Sentencing Reporter, 2015
- The Risk Assessment EraFederal Sentencing Reporter, 2015
- The Effects of Private Prison Confinement on Offender RecidivismCriminal Justice Review, 2013
- Use of risk assessment instruments to predict violence and antisocial behaviour in 73 samples involving 24 827 people: systematic review and meta-analysisBMJ, 2012
- The Role of Offender Risk Assessment: A Policy Maker GuideVictims & Offenders, 2010
- The Role of Race in Forecasts of Violent CrimeRace and Social Problems, 2009