Towards trustworthy medical AI ecosystems – a proposal for supporting responsible innovation practices in AI-based medical innovation
Open Access
- 16 October 2024
- journal article
- research article
- Published by Springer Nature in AI & SOCIETY
- Vol. 40 (4) , 2119-2139
Abstract
In this article, we explore questions about the culture of trustworthy artificial intelligence (AI) through the lens of ecosystems. We draw on the European Commission’s Guidelines for Trustworthy AI and its philosophical underpinnings. Based on the latter, the trustworthiness of an AI ecosystem can be conceived of as being grounded by both the so-called rational-choice and motivation-attributing accounts—i.e., trusting is rational because solution providers deliver expected services reliably, while trust also involves resigning control by attributing one’s motivation, and hence, goals, onto another entity. Our research question is: What aspects contribute to a responsible AI ecosystem that can promote justifiable trustworthiness in a healthcare environment? We argue that especially within devising governance and support aspects of a medical AI ecosystem, considering the so-called motivation-attributing account of trust provides fruitful pointers. There can and should be specific ways and governance structures supporting and nurturing trustworthiness beyond mere reliability. After compiling a list of preliminary requirements for this, we describe the emergence of one particular medical AI ecosystem and assess its compliance with and future ways of improving its functioning as a responsible AI ecosystem that promotes trustworthiness.Keywords
Funding Information
- Universität zu Lübeck
This publication has 99 references indexed in Scilit:
- An Ecosystem Approach to Earning and Sustaining Trust in Health Care—Too Big to CareJAMA Health Forum, 2023
- Integrating Artificial Intelligence and Blockchain for Enabling a Trusted Ecosystem for Healthcare Sector2022
- From What to How: An Initial Review of Publicly Available AI Ethics Tools, Methods and Research to Translate Principles into Practices2021
- Operationalising AI ethics: how are companies bridging the gap between practice and principles? An exploratory studyAI & SOCIETY, 2021
- Towards Ecosystems for Responsible AI2021
- In principle obstacles for empathic AI: why we can’t replace human empathy in healthcareAI & SOCIETY, 2021
- Artificial Intelligence for a Better Future2021
- An Introduction to Ethics in Robotics and AI2021
- Responsible Artificial Intelligence2019
- Unintended Consequences of Machine Learning in MedicineJAMA, 2017