Enhancing trust in AI through industry self-governance
Authors:
Open Access
- 25 April 2021
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 28 (7) , 1582-1590
Abstract
Artificial intelligence (AI) is critical to harnessing value from exponentially growing health and healthcare data. Expectations are high for AI solutions to effectively address current health challenges. However, there have been prior periods of enthusiasm for AI followed by periods of disillusionment, reduced investments, and progress, known as “AI Winters.” We are now at risk of another AI Winter in health/healthcare due to increasing publicity of AI solutions that are not representing touted breakthroughs, and thereby decreasing trust of users in AI. In this article, we first highlight recently published literature on AI risks and mitigation strategies that would be relevant for groups considering designing, implementing, and promoting self-governance. We then describe a process for how a diverse group of stakeholders could develop and define standards for promoting trust, as well as AI risk-mitigating practices through greater industry self-governance. We also describe how adherence to such standards could be verified, specifically through certification/accreditation. Self-governance could be encouraged by governments to complement existing regulatory schema or legislative efforts to mitigate AI risks. Greater adoption of industry self-governance could fill a critical gap to construct a more comprehensive approach to the governance of AI solutions than US legislation/regulations currently encompass. In this more comprehensive approach, AI developers, AI users, and government/legislators all have critical roles to play to advance practices that maintain trust in AI and prevent another AI Winter.Keywords
This publication has 53 references indexed in Scilit:
- Modeling polypharmacy side effects with graph convolutional networksBioinformatics, 2018
- Assessing the capacity of social determinants of health data to augment predictive models identifying patients in need of wraparound social servicesJournal of the American Medical Informatics Association, 2017
- Delivering Cognitive Behavior Therapy to Young Adults With Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled TrialJMIR Mental Health, 2017
- The New Self-Governance: A Theoretical FrameworkBusiness and Politics, 2017
- Security and Privacy of Performing Data Analytics in the Cloud: A Three-way Handshake of Technology, Policy, and ManagementJournal of Information Policy, 2015
- Development of a Web Service for Analysis in a Distributed NetworkeGEMs (Generating Evidence & Methods to improve patient outcomes), 2014
- Organizational readiness for innovation in health care: some lessons from the recent literatureHealth Services Management Research, 2011
- Regulation and Economic Globalization: Prospects and Limits of Private GovernanceBusiness and Politics, 2010
- An Introduction to Medical Malpractice in the United StatesClinical Orthopaedics and Related Research, 2009
- Safety and the Second Best: The Hazards of Public Risk Management in the CourtsColumbia Law Review, 1985