Human–machine teaming is key to AI adoption: clinicians’ experiences with a deployed machine learning system
Top Cited Papers
Open Access
- 21 July 2022
- journal article
- research article
- Published by Springer Nature in npj Digital Medicine
- Vol. 5 (1) , 1-6
Abstract
While a growing number of machine learning (ML) systems have been deployed in clinical settings with the promise of improving patient care, many have struggled to gain adoption and realize this promise. Based on a qualitative analysis of coded interviews with clinicians who use an ML-based system for sepsis, we found that, rather than viewing the system as a surrogate for their clinical judgment, clinicians perceived themselves as partnering with the technology. Our findings suggest that, even without a deep understanding of machine learning, clinicians can build trust with an ML system through experience, expert endorsement and validation, and systems designed to accommodate clinicians’ autonomy and support them across their entire workflow.Keywords
Funding Information
- Gordon and Betty Moore Foundation (3926)
This publication has 40 references indexed in Scilit:
- Algorithm aversion: People erroneously avoid algorithms after seeing them err.Journal of Experimental Psychology: General, 2015
- Standards for Reporting Qualitative ResearchAcademic Medicine, 2014
- Hospital Deaths in Patients With Sepsis From 2 Independent CohortsJAMA, 2014
- Big Data In Health Care: Using Analytics To Identify And Manage High-Risk And High-Cost PatientsHealth Affairs, 2014
- The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future researchImplementation Science, 2012
- Physician acceptance of information technologies: Role of perceived threat to professional autonomyDecision Support Systems, 2008
- Methodological fit in management field researchAcademy of Management Review, 2007
- Trust in Automation: Designing for Appropriate RelianceHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2004
- Trust in Automation: Designing for Appropriate RelianceHuman Factors: The Journal of the Human Factors and Ergonomics Society, 2004
- A Guide to Conducting Consensual Qualitative ResearchThe Counseling Psychologist, 1997