Rethinking Human-AI Collaboration in Complex Medical Decision Making: A Case Study in Sepsis Diagnosis
Top Cited Papers
Open Access
- 11 May 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- Vol. 2024, 1-18
Abstract
Today’s AI systems for medical decision support often succeed on benchmark datasets in research papers but fail in real-world deployment. This work focuses on the decision making of sepsis, an acute life-threatening systematic infection that requires an early diagnosis with high uncertainty from the clinician. Our aim is to explore the design requirements for AI systems that can support clinical experts in making better decisions for the early diagnosis of sepsis. The study begins with a formative study investigating why clinical experts abandon an existing AI-powered Sepsis predictive module in their electrical health record (EHR) system. We argue that a human-centered AI system needs to support human experts in the intermediate stages of a medical decision-making process (e.g., generating hypotheses or gathering data), instead of focusing only on the final decision. Therefore, we build SepsisLab based on a state-of-the-art AI algorithm and extend it to predict the future projection of sepsis development, visualize the prediction uncertainty, and propose actionable suggestions (i.e., which additional laboratory tests can be collected) to reduce such uncertainty. Through heuristic evaluation with six clinicians using our prototype system, we demonstrate that SepsisLab enables a promising human-AI collaboration paradigm for the future of AI-assisted sepsis diagnosis and other high-stakes medical decision making.Keywords
All Related Versions
Funding Information
- National Science Foundation (IIS-2145625)
- National Institutes of Health (R01GM141279)
- NIH (National Institutes of Health) (1R01MD018424-01)
This publication has 95 references indexed in Scilit:
- Challenges of human—machine collaboration in risky decision-makingFrontiers of Engineering Management, 2022
- The Epic Sepsis Model Falls Short—The Importance of External ValidationJAMA Internal Medicine, 2021
- External Validation of a Widely Implemented Proprietary Sepsis Prediction Model in Hospitalized PatientsJAMA Internal Medicine, 2021
- Uncertainty Visualization2021
- An interpretable deep-learning model for early prediction of sepsis in the emergency departmentPatterns, 2021
- The development an artificial intelligence algorithm for early sepsis diagnosis in the intensive care unitInternational Journal of Medical Informatics, 2020
- Artificial Intelligence in the Intensive Care Unit2020
- A web-based clinical decision support system for gestational diabetes: Automatic diet prescription and detection of insulin needsInternational Journal of Medical Informatics, 2017
- The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3)JAMA, 2016
- Implementation of the Surviving Sepsis Campaign guidelines for severe sepsis and septic shock: We could go fasterJournal of Critical Care, 2008