Using Visual Patient to Show Vital Sign Predictions, a Computer-Based Mixed Quantitative and Qualitative Simulation Study
Authors:
- Amos MalorgioAMAmos Malorgio
- David HenckertDHDavid Henckert
- Giovanna SchweigerGSGiovanna Schweiger
- Julia BraunJBJulia Braun
- Kai ZacharowskiKZKai Zacharowski
- Florian J. RaimannFRFlorian J. Raimann
- Florian PiekarskiFPFlorian Piekarski
- Patrick MeybohmPMPatrick Meybohm
- Sebastian HottenrottSHSebastian Hottenrott
- Corinna FroehlichCFCorinna Froehlich
- Donat R. SpahnDSDonat R. Spahn
- Christoph B NöthigerChristoph B Nöthiger
Preprint
- 5 October 2023
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Background: Machine learning can analyze vast amounts of data and make predictions for events in the future. Our group created machine learning models for vital sign predictions. To transport the information of these predictions without numbers and numerical values and make them easily usable for human caregivers, we aimed to integrate them into the Philips Visual-Patient-avatar, an avatar-based visualization of patient monitoring. Methods: We conducted a computer-based simulation study with 70 participants in three European university hospitals. We validated the vital sign prediction visualizations by testing their identification by anesthesiologists and intensivists. Each prediction visualization consisted of a condition (e.g., blood pressure low) and an urgency (a visual indication of the timespan in which the condition is expected to occur). To obtain qualitative user feedback, we also conducted standardised interviews and derived statements that participants later rated in an online survey. Results: The mixed logistic regression model showed 77.9% (95%CI 73.2-82.0%) correct identification of prediction visualizations (i.e. condition and urgency both correctly identified) and 93.8% (95%CI 93.7-93.8%) for conditions only (i.e. without considering urgencies). Forty-nine of 70 participants completed the online survey. The online survey participants agreed that the prediction visualizations were fun to use (32/49, 65.3%), and that they could imagine working with them in the future (30/49, 61.2%). They also agreed that identifying the urgencies was difficult (32/49, 65.3%). Conclusions: This study found that care providers correctly identified >90% of the conditions (i.e. without considering urgencies). The accuracy of identification decreased when considering urgencies in addition to conditions. Therefore, in future development of the technology, we will focus on either only displaying conditions (without urgencies) or improve the visualizations of urgency to enhance usability for human users.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Evaluating and reducing cognitive load should be a priority for machine learning in healthcareNature Medicine, 2022
- Avatar-based patient monitoring in critical anaesthesia events: a randomised high-fidelity simulation studyBritish Journal of Anaesthesia, 2021
- The impact of machine learning on patient care: A systematic reviewArtificial Intelligence in Medicine, 2020
- Axes of a revolution: challenges and promises of big data in healthcareNature Medicine, 2020
- Making Machine Learning Models Clinically UsefulJAMA, 2019
- Benefits and challenges of Big Data in healthcare: an overview of the European initiativesEuropean Journal of Public Health, 2019
- Machine learning in anaesthesia: reactive, proactive… predictive!British Journal of Anaesthesia, 2019
- High-performance medicine: the convergence of human and artificial intelligenceNature Medicine, 2019
- Potential Biases in Machine Learning Algorithms Using Electronic Health Record DataJAMA Internal Medicine, 2018
- The Utility of Template Analysis in Qualitative Psychology ResearchQualitative Research in Psychology, 2015