Are risk assessment tools more accurate than unstructured judgments in predicting violent, any, and sexual offending? A meta‐analysis of direct comparison studies
Authors:
- Jodi L. ViljoenJVJodi L. Viljoen
- Ilvy GoossensIGIlvy Goossens
- Sanam MonjazebSMSanam Monjazeb
- Dana M. CochraneDCDana M. Cochrane
- Lee M. VargenLVLee M. Vargen
- Melissa R. JonnsonMJMelissa R. Jonnson
- Adam J. E. BlanchardABAdam J. E. Blanchard
- Shanna M. Y. LiSLShanna M. Y. Li
- Jourdan R. JacksonJJJourdan R. Jackson
Open Access
- 3 October 2024
- journal article
- research article
- Published by Wiley in Behavioral Sciences & the Law
- Vol. 43 (1) , 75-113
Abstract
We conducted a pre‐registered meta‐analysis of studies that directly compared the predictive validity of risk assessment tools to unstructured judgments of risk for violent, any, or sexual offending. A total of 31 studies, containing 169 effect sizes from 45,673 risk judgments, met inclusion criteria. Based on the results of three‐level mixed‐effects meta‐regression models, the predictive validity of total scores on risk assessment tools was significantly higher than that of unstructured judgments for predictions of violent, any, and sexual offending. Tools continued to outperform unstructured judgments after accounting for risk of bias. This finding was also robust to variations in population, assessment context, and outcome measurement. Although this meta‐analysis provides support for the use of risk assessment tools, it also highlights limitations and gaps that future research should address.Keywords
This publication has 103 references indexed in Scilit:
- A systematic review of algorithm aversion in augmented decision makingJournal of Behavioral Decision Making, 2019
- Predicting child maltreatment: A meta-analysis of the predictive validity of risk assessment instrumentsChild Abuse & Neglect, 2017
- Finding the power to reduce publication biasStatistics in Medicine, 2017
- Meta-regression approximations to reduce publication selection biasResearch Synthesis Methods, 2013
- Predictive Validity Performance Indicators in Violence Risk Assessment: A Methodological PrimerBehavioral Sciences & the Law, 2013
- Fixed effects and variance components estimation in three-level meta-analysisResearch Synthesis Methods, 2011
- Introduction to Meta‐Analysis2009
- Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetryJournal of Clinical Epidemiology, 2008
- The dynamic appraisal of situational aggression: an instrument to assess risk for imminent aggression in psychiatric inpatientsBehavioral Sciences & the Law, 2006
- Inpatient risk management with mentally ill offenders: results of a survey on clinical decision‐making about easing restrictionsCriminal Behaviour and Mental Health, 2006