When the Algorithm Is Wrong
- 4 September 2026
- book chapter
- Published by IGI Global Scientific Publishing
- p. 195-222
Abstract
This chapter examines epistemic trust, AI-generated evidence, and legal liability in judicial proceedings. The study analyses the legal nature of AI-based evidence, identifying key characteristics — algorithmic generation, data dependency, and black box opacity — which challenge traditional evidentiary standards of relevance, admissibility, and verifiability. Drawing on comparative analysis of Wisconsin v. Loomis (2016), the Dutch SyRI judgment (2020), and the Toeslagenaffaire scandal, the chapter shows that algorithmic errors are structurally diverse, systemically discriminatory, and resistant to detection through standard legal mechanisms. Legal liability is explored across multiple actors — developers, operators, and judicial users — while critically assessing traditional fault-based models. The chapter concludes that effective regulation requires risk-based approaches combining algorithmic transparency, mandatory human oversight, and procedural safeguards — as reflected in the EU AI Act 2024 — to ensure AI in justice complies with the rule of law and human rights.Keywords
This publication has 18 references indexed in Scilit:
- Trust, Explainability and AIPhilosophy & Technology, 2025
- Explainable AI and Law: An Evidential SurveyDigital Society, 2023
- Liability for AI Decision-Making2022
- Digital welfare fraud detection and the Dutch SyRI judgmentEuropean Journal of Social Security, 2021
- Why fairness cannot be automated: Bridging the gap between EU non-discrimination law and AIComputer Law & Security Review, 2021
- The accuracy, fairness, and limits of predicting recidivismScience Advances, 2018
- Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction InstrumentsBig Data, 2017
- The Nature of Epistemic TrustSocial Epistemology, 2015
- Epistemic Trust in ScienceThe British Journal for the Philosophy of Science, 2013
- The Laws of Robots2013