VBridge: Connecting the Dots Between Features and Data to Explain Healthcare Models
Authors:
- 1 October 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 28 (1) , 378-388
Abstract
Machine learning (ML) is increasingly applied to Electronic Health Records (EHRs) to solve clinical prediction tasks. Although many ML models perform promisingly, issues with model transparency and interpretability limit their adoption in clinical practice. Directly using existing explainable ML techniques in clinical settings can be challenging. Through literature surveys and collaborations with six clinicians with an average of 17 years of clinical experience, we identified three key challenges, including clinicians' unfamiliarity with ML features, lack of contextual information, and the need for cohort-level evidence. Following an iterative design process, we further designed and developed VBridge, a visual analytics tool that seamlessly incorporates ML explanations into clinicians' decision-making workflow. The system includes a novel hierarchical display of contribution-based feature explanations and enriched interactions that connect the dots between ML features, explanations, and data. We demonstrated the effectiveness of VBridge through two case studies and expert interviews with four clinicians, showing that visually associating model explanations with patients' situational records can help clinicians better interpret and use model predictions when making clinician decisions. We further derived a list of design implications for developing future explainable ML tools to support clinical decision-making.Keywords
All Related Versions
Funding Information
- Hong Kong Theme-based Research Scheme (T41-709/17N)
This publication has 54 references indexed in Scilit:
- INFUSE: Interactive Feature Selection for Predictive Modeling of High Dimensional DataIEEE Transactions on Visualization and Computer Graphics, 2014
- Innovative information visualization of electronic health record data: a systematic reviewJournal of the American Medical Informatics Association, 2014
- A methodology for interactive mining and visual analysis of clinical event patterns using electronic health record dataJournal of Biomedical Informatics, 2014
- Interactive Information Visualization to Explore and Query Electronic Health RecordsFoundations and Trends® in Human-Computer Interaction, 2013
- Mining electronic health records: towards better research applications and clinical careNature Reviews Genetics, 2012
- Use of diverse electronic medical record systems to identify genetic risk for type 2 diabetes within a genome-wide association studyJournal of the American Medical Informatics Association, 2012
- Querying event sequences by exact match or similarity search: Design and empirical evaluationInteracting with Computers, 2012
- Clinical predictors of progression to Alzheimer disease in amnestic mild cognitive impairmentNeurology, 2007
- Distributed, intelligent, interactive visualization and exploration of time-oriented clinical data and their abstractionsArtificial Intelligence in Medicine, 2006
- Evaluating the Use of Flowsheets in Pediatric Intensive Care to Inform DesignProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2006