Analysis of clinical decision support system malfunctions: a case series and survey
Open Access
- 28 March 2016
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 23 (6) , 1068-1076
Abstract
Objective To illustrate ways in which clinical decision support systems (CDSSs) malfunction and identify patterns of such malfunctions. Materials and Methods We identified and investigated several CDSS malfunctions at Brigham and Women’s Hospital and present them as a case series. We also conducted a preliminary survey of Chief Medical Information Officers to assess the frequency of such malfunctions. Results We identified four CDSS malfunctions at Brigham and Women’s Hospital: (1) an alert for monitoring thyroid function in patients receiving amiodarone stopped working when an internal identifier for amiodarone was changed in another system; (2) an alert for lead screening for children stopped working when the rule was inadvertently edited; (3) a software upgrade of the electronic health record software caused numerous spurious alerts to fire; and (4) a malfunction in an external drug classification system caused an alert to inappropriately suggest antiplatelet drugs, such as aspirin, for patients already taking one. We found that 93% of the Chief Medical Information Officers who responded to our survey had experienced at least one CDSS malfunction, and two-thirds experienced malfunctions at least annually. Discussion CDSS malfunctions are widespread and often persist for long periods. The failure of alerts to fire is particularly difficult to detect. A range of causes, including changes in codes and fields, software upgrades, inadvertent disabling or editing of rules, and malfunctions of external systems commonly contribute to CDSS malfunctions, and current approaches for preventing and detecting such malfunctions are inadequate. Conclusion CDSS malfunctions occur commonly and often go undetected. Better methods are needed to prevent and detect these malfunctions.Keywords
This publication has 28 references indexed in Scilit:
- A framework for evaluating the appropriateness of clinical decision support alerts and responsesJournal of the American Medical Informatics Association, 2012
- Comparison of clinical knowledge management capabilities of commercially-available and leading internally-developed electronic health recordsBMC Medical Informatics and Decision Making, 2011
- A new sociotechnical model for studying health information technology in complex adaptive healthcare systemsQuality and Safety in Health Care, 2010
- Clinical decision support: progress and opportunitiesJournal of the American Medical Informatics Association, 2010
- Safe Electronic Health Record Use Requires a Comprehensive Monitoring and Evaluation FrameworkJAMA, 2010
- The state of the art in clinical knowledge management: An inventory of tools and techniquesInternational Journal of Medical Informatics, 2010
- The intended and unintended consequences of clinical guidelinesJournal of Evaluation in Clinical Practice, 2009
- Proposal for Fulfilling Strategic Objectives of the U.S. Roadmap for National Action on Decision Support through a Service-oriented Architecture Leveraging HL7 ServicesJournal of the American Medical Informatics Association, 2007
- Types of Unintended Consequences Related to Computerized Provider Order EntryJournal of the American Medical Informatics Association, 2006
- Effects of Computerized Clinical Decision Support Systems on Practitioner Performance and Patient OutcomesJAMA, 2005