Promoting transparency in forensic science by integrating categorical and evaluative reporting through decision theory
Open Access
- 7 February 2023
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Analytical Science
- Vol. 3
Abstract
Forensic science standards often require the analyst to report in categorical terms. Categorical reporting without reference to the strength of the evidence, or the strength threshold that must be met to sustain or justify the decision, obscures the decision-making process, and allows for inconsistency and bias. Standards that promote reporting in probabilistic terms require the analyst to report the strength of the evidence without offering a conclusive interpretation of the evidence. Probabilistic reporting is often based on a likelihood ratio which depends on calibrated probabilities. While probabilistic reporting may be more objective and less open to bias than categorical reporting, the report can be difficult for a lay jury to interpret. These reporting methods may appear disparate, but the relationship between the two is easily understood and visualized by a simple decision theory construct known as the receiver operating characteristic (ROC) curve. Implementing ROC-facilitated reporting through an expanded proficiency testing regime may provide transparency in categorical reporting and potentially obviate some of the lay jury interpretation issues associated with probabilistic reporting.Keywords
This publication has 25 references indexed in Scilit:
- Tutorial on logistic-regression calibration and fusion:converting a score to a likelihood ratioAustralian Journal of Forensic Sciences, 2013
- Understanding of forensic expert reports by judges, defense lawyers and forensic professionalsPsychology, Crime & Law, 2012
- Tutorial on evaluation of type I and type II errors in chemical analyses: From the analytical detection to authentication of products and process controlAnalytica Chimica Acta, 2010
- PAV and the ROC convex hullMachine Learning, 2007
- An introduction to ROC analysisPattern Recognition Letters, 2006
- Advantages to transforming the receiver operating characteristic (ROC) curve into likelihood ratio co‐ordinatesStatistics in Medicine, 2004
- More on the hierarchy of propositions: exploring the distinction between explanations and propositionsScience & Justice, 2000
- A hierarchy of propositions: deciding which level to address in caseworkScience & Justice, 1998
- Towards a uniform framework for reporting opinions in forensic science caseworkScience & Justice, 1998
- Verbal probabilities: Ambiguous, context-dependent, or both?Organizational Behavior and Human Decision Processes, 1988