Development and validation of an algorithm to recalibrate mental models and reduce diagnostic errors associated with catheter-associated bacteriuria
Open Access
- 15 April 2013
- journal article
- research article
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 13 (1) , 48
Abstract
Background: Overtreatment of catheter-associated bacteriuria is a quality and safety problem, despite the availability of evidence-based guidelines. Little is known about how guidelines-based knowledge is integrated into clinicians’ mental models for diagnosing catheter-associated urinary tract infection (CA-UTI). The objectives of this research were to better understand clinicians’ mental models for CA-UTI, and to develop and validate an algorithm to improve diagnostic accuracy for CA-UTI. Methods: We conducted two phases of this research project. In phase one, 10 clinicians assessed and diagnosed four patient cases of catheter associated bacteriuria (n= 40 total cases). We assessed the clinical cues used when diagnosing these cases to determine if the mental models were IDSA guideline compliant. In phase two, we developed a diagnostic algorithm derived from the IDSA guidelines. IDSA guideline authors and non-expert clinicians evaluated the algorithm for content and face validity. In order to determine if diagnostic accuracy improved using the algorithm, we had experts and non-experts diagnose 71 cases of bacteriuria. Results: Only 21 (53%) diagnoses made by clinicians without the algorithm were guidelines-concordant with fair inter-rater reliability between clinicians (Fleiss’ kappa = 0.35, 95% Confidence Intervals (CIs) = 0.21 and 0.50). Evidence suggests that clinicians’ mental models are inappropriately constructed in that clinicians endorsed guidelines-discordant cues as influential in their decision-making: pyuria, systemic leukocytosis, organism type and number, weakness, and elderly or frail patient. Using the algorithm, inter-rater reliability between the expert and each non-expert was substantial (Cohen’s kappa = 0.72, 95% CIs = 0.52 and 0.93 between the expert and non-expert #1 and 0.80, 95% CIs = 0.61 and 0.99 between the expert and non-expert #2). Conclusions: Diagnostic errors occur when clinicians’ mental models for catheter-associated bacteriuria include cues that are guidelines-discordant for CA-UTI. The understanding we gained of clinicians’ mental models, especially diagnostic errors, and the algorithm developed to address these errors will inform interventions to improve the accuracy and reliability of CA-UTI diagnoses.Keywords
This publication has 26 references indexed in Scilit:
- Urine culture doubtful in determining etiology of diffuse symptoms among elderly individuals: a cross-sectional study of 32 nursing homesBMC Family Practice, 2011
- A hospital-site controlled intervention using audit and feedback to implement guidelines concerning inappropriate treatment of catheter-associated asymptomatic bacteriuriaImplementation Science, 2011
- Heuristic Decision MakingAnnual Review of Psychology, 2011
- Understanding Adherence to Guidelines in the Intensive Care UnitJournal of Parenteral and Enteral Nutrition, 2010
- Smart strategies for doctors and doctors‐in‐training: heuristics in medicineMedical Education, 2009
- Risk perception and inappropriate antimicrobial use: yes, it can hurt.Clinical Infectious Diseases, 2009
- Inappropriate Treatment of Catheter‐Associated Asymptomatic Bacteriuria in a Tertiary Care HospitalClinical Infectious Diseases, 2009
- Importance of Urinary Tract Infection to Antibiotic Use Among Hospitalized PatientsInfection Control & Hospital Epidemiology, 2009
- DIAGNOSTIC ACCURACY OF CRITERIA FOR URINARY TRACT INFECTION IN A COHORT OF NURSING HOME RESIDENTSJournal of the American Geriatrics Society, 2008
- Reducing Antibiotic Overuse: A Call for a National Performance Measure for Not Treating Asymptomatic BacteriuriaClinical Infectious Diseases, 2007