Scoping review of dashboards in health care: why, how, and for whom they have been developed, implemented, and evaluated (Preprint)
Authors:
- Danielle HelminskiDHDanielle Helminski
- Jeremy B SussmanJSJeremy B Sussman
- Paul N PfeifferPPPaul N Pfeiffer
- Alex N KokalyAKAlex N Kokaly
- Allison RanuschARAllison Ranusch
- Anjana Deep RenjiARAnjana Deep Renji
- Laura J DamschroderLDLaura J Damschroder
- Zach Landis-LewisZLZach Landis-Lewis
- Jacob E KurlanderJKJacob E Kurlander
Preprint
- 8 May 2024
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND While dashboards are frequently used by health systems to monitor and improve performance, little is known about their characteristics and the processes used to incorporate them into practice. OBJECTIVE This scoping review aimed to explore published literature on health care dashboards to summarize why, how, and for whom they have been developed, implemented, and evaluated. METHODS MEDLINE, EMBASE, Web of Science and the Cochrane Library were searched from inception through July 2020. Studies were included if they described the development or evaluation of a health care dashboard with publication since 2015. Clinical setting, purpose (categorized as clinical, administrative, or both), and end-user were extracted for all studies. Data on dashboard development, design characteristics, implementation strategies, and evaluation were extracted only for studies published from 2018-2020. RESULTS Data was extracted for 199 dashboards described in 193 publications. The most common settings in which dashboards were used were inpatient (n=81/199, 40.7%) and outpatient clinics (n=68/199, 34.2%). Most dashboards had ≥2 stated purposes (n=142/199, 71.4%); of these, 97/199 (48.7%) were administrative, 68/199 (34.2%) were clinical, and 31/199 (15.6%) met both criteria. Most dashboards included front-line clinical staff as end-users (n=154/199, 77.4%). In the 118 dashboards published from 2018-2020, half involved end-users in the design process (n=59/118, 50.0%); fewer described formative usability testing (n=26/118, 22.0%) or use of any theory or framework to guide development, implementation, or evaluation (n=24/118, 20.3%). Dashboards tended to be web-based (n=41/118, 34.7%) or embedded directly into the electronic health record (n=17/118, 14.4%). Common implementation strategies used alongside dashboards included education (n=60/118, 50.8%), audit and feedback (n=59/118, 50.0%), and advisory boards (n=54/118, 45.8%). Evaluations of dashboards (n=84/118, 71.2%) were mostly quantitative (n=60/118, 50.8%), or mixed methods, combining dashboard or health record data with qualitative findings (n=18/118, 15.2%). CONCLUSIONS Dashboards in health care have been used in diverse settings, for multiple purposes and varied end users. The complexity of many dashboards – serving many purposes and end users at once – and the frequent expectation that clinicians will use them underscores the importance of systematic design and evaluation to ensure they are having the intended outcomes. Future work is needed to identify best practices for the development, implementation, and evaluation of health care dashboards. INTERNATIONAL REGISTERED REPORT RR2-10.2196/34894Keywords
This publication has 220 references indexed in Scilit:
- The Volume and Cost of Quality Metric ReportingJAMA, 2023
- Medical Documentation Burden Among US Office-Based Physicians in 2019JAMA Internal Medicine, 2022
- Core implementation strategies for improving cirrhosis care in the Veterans Health AdministrationHepatology, 2022
- Targeted Program in an Academic Rheumatology Practice to Improve Compliance With Opioid Prescribing Guidelines for the Treatment of Chronic PainArthritis Care & Research, 2020
- Using data to improve the care of people with diabetes across OxfordshirePractical Diabetes, 2020
- Single institution followed by national implementation of systematic surgical quality control and feedback for radical prostatectomy: a 20-year journeyWorld Journal of Urology, 2019
- Inclusion of Real-Time Hand Hygiene Observation and Feedback in a Multimodal Hand Hygiene Improvement Strategy in Low-Resource SettingsJAMA Network Open, 2019
- Use of Routine Prospective Functional and Aesthetic Patient Satisfaction Measurements in Secondary Cleft Lip RhinoplastyJAMA Facial Plastic Surgery, 2018
- Effect of an Automated Patient Dashboard Using Active Choice and Peer Comparison Performance Feedback to Physicians on Statin PrescribingJAMA Network Open, 2018
- Use of provider‐level dashboards and pay‐for‐performance in venous thromboembolism prophylaxisJournal of Hospital Medicine, 2014