LMLauren McCullagh

Lauren McCullagh

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Lauren McCullagh has a total of 31 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Live Usability Testing of Two Complex Clinical Decision Support Tools: Observational Study

    by Safiya Richardson, David Feldstein, Thomas McGinn, Linda S Park, Sundas Khan, Rachel Hess, Paul D Smith, Rebecca Grochow Mishuris, Lauren McCullagh, Devin Mann

    Background: Potential of the electronic health records (EHR) and clinical decision support (CDS) systems to improve the practice of medicine has been tempered by poor design and the resulting burden they place on providers. CDS is rarely tested in the real clinical environment. As a result, many tools are hard to use, placing strain on providers and resulting in low adoption rates. The existing CDS usability literature relies primarily on expert opinion and provider feedback via survey. This is the first study to evaluate CDS usability and the provider-computer-patient interaction with complex CDS in the real clinical environment. Objective: This study aimed to further understand the barriers and facilitators of meaningful CDS usage within a real clinical context. Methods: This qualitative observational study was conducted with 3 primary care providers during 6 patient care sessions. In patients with the chief complaint of sore throat, a CDS tool built with the Centor Score was used to stratify the risk of group A Streptococcus pharyngitis. In patients with a chief complaint of cough or upper respiratory tract infection, a CDS tool built with the Heckerling Rule was used to stratify the risk of pneumonia. During usability testing, all human-computer interactions, including audio and continuous screen capture, were recorded using the Camtasia software. Participants’ comments and interactions with the tool during clinical sessions and participant comments during a postsession brief interview were placed into coding categories and analyzed for generalizable themes. Results: In the 6 encounters observed, primary care providers toggled between addressing either the computer or the patient during the visit. Minimal time was spent listening to the patient without engaging the EHR. Participants mostly used the CDS tool with the patient, asking questions to populate the calculator and discussing the results of the risk assessment; they reported the ability to do this as the major benefit of the tool. All providers were interrupted during their use of the CDS tool by the need to refer to other sections of the chart. In half of the visits, patients’ clinical symptoms challenged the applicability of the tool to calculate the risk of bacterial infection. Primary care providers rarely used the incorporated incentives for CDS usage, including progress notes and patient instructions. Conclusions: Live usability testing of these CDS tools generated insights about their role in the patient-provider interaction. CDS may contribute to the interaction by being simultaneously viewed by the provider and patient. CDS can improve usability and lessen the strain it places on providers by being short, flexible, and customizable to unique provider workflow. A useful component of CDS is being as widely applicable as possible and ensuring that its functions represent the fastest way to perform a particular task.


  • Open Access

    Improving Provider Adoption With Adaptive Clinical Decision Support Surveillance: An Observational Study

    by Sundas Khan, Safiya Richardson, Andrew Liu, Vinodh Mechery, Lauren McCullagh, Andy Schachter, Salvatore Pardo, Thomas McGinn

    Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Successful clinical decision support (CDS) tools can bring evidence-based medicine to the point-of-care to effectively improve patient outcomes. However, the impact of these tools has been limited by low provider adoption due to over-triggering, leading to alert fatigue. We have developed a tracking mechanism for monitoring trigger rate (percent of total visits for which the tool triggers) and adoption rate (percent of completed tools) of a complex CDS tool based on the Wells’ Criteria for pulmonary embolism (PE). Objective: Monitor and evaluate the adoption and trigger rates of the tool and to see if ongoing tool modifications would improve adoption rates. Methods: As part of a larger clinical trial, a CDS tool was developed using the Wells’ Criteria to calculate pre-test probability for PE at two academic tertiary center’s emergency departments (ED). The tool had multiple triggers: any order for D-dimer, computed tomography (CT) of the chest with intravenous contrast, computed tomography pulmonary angiography (CTPA), ventilation/perfusion scan, or lower extremity Doppler ultrasound. A tracking dashboard was developed using Tableau® to monitor trigger and adoption rates in real-time. Based on initial low provider adoption rates of the tool, small focus groups were conducted with key ED providers to elicit barriers to tool use. Over-triggering of the tool for non-PE-related evaluations and inability to order CT testing for intermediate risk patients were identified. Thus, the tool was modified to allow CT testing for intermediate risk group and to not trigger for CT chest with intravenous contrast orders. Additionally, a dialogue box, “Are you considering PE for this patient?” was added before the tool triggered to account for CTPAs ordered for the evaluation of aortic dissection. Results: In the first academic tertiary center’s ED, 95,295 patients were seen during the academic year. The tool triggered for an average of 509 patients per month (6.73%) before the modifications and this reduced to 423 patients per month (5.22%). The second academic tertiary center’s ED saw 88,956 patients during the academic year with the tool triggering for about 473 patients per month (6.38%) before the modifications, and for about 400 (5.12%) afterwards. The modifications resulted in a significant 4.5-fold and 3-fold increase in provider adoption rates. The modifications increased the average monthly adoption rate from 6.51% to 29.33% in center 1, and also increased from 14.73% to 42.64% in center 2. Conclusions: Close post-implementation monitoring of CDS tools may help to improve provider adoption. Adaptive modifications based on user feedback may lead to more targeted CDS with lower trigger rates, reducing alert fatigue and increasing provider adoption. This study provides an example of how iterative improvements and a post-implementation monitoring dashboard resulted in significantly improved adoption rates.


  • Open Access

    Live Usability Testing of Two Complex Clinical Decision Support Tools: Observational Study (Preprint)

    by Safiya Richardson, David Feldstein, Thomas McGinn, Linda S Park, Sundas Khan, Rachel Hess, Paul D Smith, Rebecca Grochow Mishuris, Lauren McCullagh, Devin Mann

    BACKGROUND Potential of the electronic health records (EHR) and clinical decision support (CDS) systems to improve the practice of medicine has been tempered by poor design and the resulting burden they place on providers. CDS is rarely tested in the real clinical environment. As a result, many tools are hard to use, placing strain on providers and resulting in low adoption rates. The existing CDS usability literature relies primarily on expert opinion and provider feedback via survey. This is the first study to evaluate CDS usability and the provider-computer-patient interaction with complex CDS in the real clinical environment. OBJECTIVE This study aimed to further understand the barriers and facilitators of meaningful CDS usage within a real clinical context. METHODS This qualitative observational study was conducted with 3 primary care providers during 6 patient care sessions. In patients with the chief complaint of sore throat, a CDS tool built with the Centor Score was used to stratify the risk of group A Streptococcus pharyngitis. In patients with a chief complaint of cough or upper respiratory tract infection, a CDS tool built with the Heckerling Rule was used to stratify the risk of pneumonia. During usability testing, all human-computer interactions, including audio and continuous screen capture, were recorded using the Camtasia software. Participants’ comments and interactions with the tool during clinical sessions and participant comments during a postsession brief interview were placed into coding categories and analyzed for generalizable themes. RESULTS In the 6 encounters observed, primary care providers toggled between addressing either the computer or the patient during the visit. Minimal time was spent listening to the patient without engaging the EHR. Participants mostly used the CDS tool with the patient, asking questions to populate the calculator and discussing the results of the risk assessment; they reported the ability to do this as the major benefit of the tool. All providers were interrupted during their use of the CDS tool by the need to refer to other sections of the chart. In half of the visits, patients’ clinical symptoms challenged the applicability of the tool to calculate the risk of bacterial infection. Primary care providers rarely used the incorporated incentives for CDS usage, including progress notes and patient instructions. CONCLUSIONS Live usability testing of these CDS tools generated insights about their role in the patient-provider interaction. CDS may contribute to the interaction by being simultaneously viewed by the provider and patient. CDS can improve usability and lessen the strain it places on providers by being short, flexible, and customizable to unique provider workflow. A useful component of CDS is being as widely applicable as possible and ensuring that its functions represent the fastest way to perform a particular task.


  • Open Access

    Improving Provider Adoption With Adaptive Clinical Decision Support Surveillance: An Observational Study (Preprint)

    by Sundas Khan, Safiya Richardson, Andrew Liu, Vinodh Mechery, Lauren McCullagh, Andy Schachter, Salvatore Pardo, Thomas McGinn

    BACKGROUND Successful clinical decision support (CDS) tools can help use evidence-based medicine to effectively improve patient outcomes. However, the impact of these tools has been limited by low provider adoption due to overtriggering, leading to alert fatigue. We developed a tracking mechanism for monitoring trigger (percent of total visits for which the tool triggers) and adoption (percent of completed tools) rates of a complex CDS tool based on the Wells criteria for pulmonary embolism (PE). OBJECTIVE We aimed to monitor and evaluate the adoption and trigger rates of the tool and assess whether ongoing tool modifications would improve adoption rates. METHODS As part of a larger clinical trial, a CDS tool was developed using the Wells criteria to calculate pretest probability for PE at 2 tertiary centers’ emergency departments (EDs). The tool had multiple triggers: any order for D-dimer, computed tomography (CT) of the chest with intravenous contrast, CT pulmonary angiography (CTPA), ventilation-perfusion scan, or lower extremity Doppler ultrasound. A tracking dashboard was developed using Tableau to monitor real-time trigger and adoption rates. Based on initial low provider adoption rates of the tool, we conducted small focus groups with key ED providers to elicit barriers to tool use. We identified overtriggering of the tool for non-PE-related evaluations and inability to order CT testing for intermediate-risk patients. Thus, the tool was modified to allow CT testing for the intermediate-risk group and not to trigger for CT chest with intravenous contrast orders. A dialogue box, “Are you considering PE for this patient?” was added before the tool triggered to account for CTPAs ordered for aortic dissection evaluation. RESULTS In the ED of tertiary center 1, 95,295 patients visited during the academic year. The tool triggered for an average of 509 patients per month (average trigger rate 2036/30,234, 6.73%) before the modifications, reducing to 423 patients per month (average trigger rate 1629/31,361, 5.22%). In the ED of tertiary center 2, 88,956 patients visited during the academic year, with the tool triggering for about 473 patients per month (average trigger rate 1892/29,706, 6.37%) before the modifications and for about 400 per month (average trigger rate 1534/30,006, 5.12%) afterward. The modifications resulted in a significant 4.5- and 3-fold increase in provider adoption rates in tertiary centers 1 and 2, respectively. The modifications increased the average monthly adoption rate from 23.20/360 (6.5%) tools to 81.60/280.20 (29.3%) tools and 46.60/318.80 (14.7%) tools to 111.20/263.40 (42.6%) tools in centers 1 and 2, respectively. CONCLUSIONS Close postimplementation monitoring of CDS tools may help improve provider adoption. Adaptive modifications based on user feedback may increase targeted CDS with lower trigger rates, reducing alert fatigue and increasing provider adoption. Iterative improvements and a postimplementation monitoring dashboard can significantly improve adoption rates.

  • Open Access

    Usability Testing of a National Substance Use Screening Tool Embedded in Electronic Health Records

    by Anne Press, Catherine DeStio, Lauren McCullagh, Sandeep Kapoor, Jeanne Morley, Sbirt Ny-Ii Team, Joseph Conigliaro

    JMIR Human Factors - a leading peer-reviewed ehealth journal


  • Developing a Clinical Prediction Rule for First Hospital-Onset Clostridium difficile Infections: A Retrospective Observational Study

    by Anne Press, Benson S Ku, Lauren McCullagh, Lisa Rosen, Safiya Richardson, Thomas McGinn

    BACKGROUND: The healthcare burden of hospital-acquired Clostridium difficile infection (CDI) demands attention and calls for a solution. Identifying patients’ risk of developing a primary nosocomial CDI is a critical first step in reducing the development of new cases of CDI.OBJECTIVE: To derive a clinical prediction rule that can predict a patient’s risk of acquiring a primary CDI.DESIGN: Retrospective cohort study.SETTING: Large tertiary healthcare center.PATIENTS: Total of 61,482 subjects aged at least 18 admitted over a 1-year period (2013).INTERVENTION: None.METHODS: Patient demographic characteristics, evidence of CDI, and other risk factors were retrospectively collected. To derive the CDI clinical prediction rule the patient population was divided into a derivation and validation cohort. A multivariable analysis was performed in the derivation cohort to identify risk factors individually associated with nosocomial CDI and was validated on the validation sample.RESULTS: Among 61,482 subjects, CDI occurred in 0.46%. CDI outcome was significantly associated with age, admission in the past 60 days, mechanical ventilation, dialysis, history of congestive heart failure, and use of antibiotic medications. The sensitivity and specificity of the score, in the validation set, were 82.0% and 75.7%, respectively. The area under the receiver operating characteristic curve was 0.85.CONCLUSION: This study successfully derived a clinical prediction rule that will help identify patients at high risk for primary CDI. This tool will allow physicians to systematically recognize those at risk for CDI and will allow for early interventional strategies.Infect Control Hosp Epidemiol 2016;37:896–900


  • Open Access

    Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons Learned

    by Anne Press, Lauren McCullagh, Sundas Khan, Andy Schachter, Salvatore Pardo, Thomas McGinn

    JMIR Human Factors - a leading peer-reviewed ehealth journal


  • Open Access

    InformedTogether: Usability Evaluation of a Web-Based Decision Aid to Facilitate Shared Advance Care Planning for Severe Chronic Obstructive Pulmonary Disease

    by Lauren M Uhler, Rafael E Pérez Figueroa, Mark Dickson, Lauren McCullagh, Andre Kushniruk, Helen Monkman, Holly O Witteman, Negin Hajizadeh

    JMIR Human Factors - a leading peer-reviewed ehealth journal


  • Su1214 Opiate Use in Inflammatory Bowel Disease (IBD): Impact on Biologic/Immune Modulator Utilization and Associated Outcomes

    by Arunan S. Vamadevan, Ariy Volfson, Sundas Khan, Lauren McCullagh, Meredith Akerman, Keith Sultan