Why we should talk about institutional (dis)trustworthiness and medical machine learning
- 13 November 2024
- journal article
- research article
- Published by Springer Nature in Medicine, Health Care and Philosophy
- Vol. 28 (1) , 83-92
Abstract
The principle of trust has been placed at the centre as an attitude for engaging with clinical machine learning systems. However, the notions of trust and distrust remain fiercely debated in the philosophical and ethical literature. In this article, we proceed on a structural level ex negativo as we aim to analyse the concept of “institutional distrustworthiness” to achieve a proper diagnosis of how we should not engage with medical machine learning. First, we begin with several examples that hint at the emergence of a climate of distrust in the context of medical machine learning. Second, we introduce the concept of institutional trustworthiness based on an expansion of Hawley’s commitment account. Third, we argue that institutional opacity can undermine the trustworthiness of medical institutions and can lead to new forms of testimonial injustices. Finally, we focus on possible building blocks for repairing institutional distrustworthiness.Keywords
Funding Information
- H2020 European Research Council (949841- DIME)
- Horizon 2020 Framework Programme (871042)
This publication has 44 references indexed in Scilit:
- Keep trusting! A plea for the notion of Trustworthy AIAI & SOCIETY, 2023
- Institutionalised distrust and human oversight of artificial intelligence: towards a democratic design of AI governance under the European Union AI ActAI & SOCIETY, 2023
- Dirty data labeled dirt cheap: epistemic injustice in machine learning systemsEthics and Information Technology, 2023
- Distressed Work: Chronic Imperatives and Distress in Covid‐19 Critical CareHastings Center Report, 2023
- Is Trust Enough? Anti‐Black Racism and the Perception of Black Vaccine “Hesitancy”Hastings Center Report, 2022
- Trust in medical artificial intelligence: a discretionary accountEthics and Information Technology, 2022
- Trust and The Acquisition and Use of Public Health InformationHealth Care Analysis, 2021
- A Leap of Faith: Is There a Formula for “Trustworthy” AI?Hastings Center Report, 2021
- Clinical AI: opacity, accountability, responsibility and liabilityAI & SOCIETY, 2020
- The Individualist Model of Autonomy and the Challenge of DisabilityJournal of Bioethical Inquiry, 2008