ASAnia Syrowatka

Ania Syrowatka

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Ania Syrowatka has a total of 133 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Informing Measurement of Timely Follow-up Colonoscopies After Positive Stool Tests for Two-Step Colorectal Cancer Screening: An Environmental Scan

    by Marlika Marceau, Samantha J. Magier, Omar Nafaa, Carol Mita, Lipika Samal, David W. Bates, Patricia C. Dykes, Ania Syrowatka

  • Informing the Measurement of Timely Follow-Up on Inconclusive or Abnormal Screening Mammograms: An Environmental Scan

    by Marlika Marceau, Omar Nafaa, Carol Mita, Lipika Samal, David W. Bates, Patricia C. Dykes, Ania Syrowatka

  • Open Access

    Clinical decision support systems’ effect in reducing medication errors and adverse drug events: an expanded review from Making Healthcare Safer IV

    by Ania Syrowatka, Aneesa Motala, Emily Lawson, Paul G Shekelle

    Clinical decision support systems (CDSSs) are used to provide alerts and recommendations on prescribing and order verification with the intent of reducing the frequency and harm of medication errors (MEs) and adverse drug events (ADEs). This review assessed recent evidence on the effects of CDSSs on reducing MEs and ADEs. Related implementation outcomes such as alert overrides and unintended consequences of use were also assessed, and literature around the effective implementation of CDSSs was summarised. The review followed processes proposed by the Agency for Healthcare Research and Quality Evidence-based Practice Center Programme. PubMed and the Cochrane Library were searched from 2015 to 2023. Results were narratively synthesised, and overall certainty of evidence was assessed for outcomes of interest. The search yielded 1335 unique abstracts, of which 34 articles met the criteria for inclusion. The type of clinical decision support and outcomes were heterogeneous between studies. Overall, computerised provider order entry with medication-related clinical decision support functions was associated with reduced MEs (moderate certainty of evidence) and prevention of ADEs (low certainty of evidence). Improved or targeted medication-related CDSSs were associated with reductions of MEs and ADEs (moderate certainty of evidence). However, alert override rates were high and varied between studies, and the appropriateness of the overrides was largely influenced by the type of alert. Other unintended consequences included CDSS-related errors, overdependence on alerts, alert fatigue, inappropriate alert overrides and provider burnout. An additional seven systematic reviews focused on barriers and facilitators of CDSS implementation. CDSSs reduce MEs and ADEs, with moderate-certainty and low-certainty evidence, respectively. However, there are several unintended consequences of CDSS use. PROSPERO registration number: CRD42023449710.


  • Open Access

    An Extraction Tool for Venous Thromboembolism Symptom Identification in Primary Care Notes to Facilitate Electronic Clinical Quality Measure Reporting: Algorithm Development and Validation Study

    by John Novoa-Laurentiev, Mica Bowen, Avery Pullman, Wenyu Song, Ania Syrowatka, Jin Chen, Michael Sainlaire, Frank Chang, Krissy Gray, Purushottam Panta, et al.

    Background: Diagnosis of venous thromboembolism (VTE) is often delayed, and facilitating earlier diagnosis may improve associated morbidity and mortality. Clinical notes contain information not found elsewhere in the medical record that could facilitate timely VTE diagnosis and accurate quality measurement. However, extracting relevant information from unstructured clinical notes is complex. Today, there are relatively few electronic clinical quality measures (eCQMs) in our national payment program and none that use natural language processing (NLP) techniques for data extraction. NLP holds great promise for making quality measurement more accurate and more efficient. Given the potential of NLP-based applications to facilitate more accurate VTE detection, primary care is one clinical setting in urgent need of this type of tool. Objective: This study aimed to develop a tool that extracts VTE symptoms from clinical notes for use within an eCQM to quantify the rate of delayed diagnosis of VTE in primary care settings. Methods: We iteratively developed an NLP-based data extraction tool, venous thromboembolism symptom extractor (VTExt), on an internal dataset using a rule-based approach to extract VTE symptoms from primary care clinical note text. The VTE symptoms lexicon was derived and optimized with physician guidance and externally validated using datasets from 2 independent health care organizations. We performed 26 rounds of performance evaluation of notes sampled from the case cohort (17,585 patient progress note sentences from 279 patient notes), and 5 rounds of evaluation of the control cohort (2838 patient progress note sentences from 50 patient notes). VTExt’s performance was evaluated using evaluation metrics, including area under the curve, positive predictive value, negative predictive value, sensitivity, and specificity. Results: VTExt achieved near-perfect performance in extracting VTE symptoms from primary care notes sampled from records of patients diagnosed with or without VTE. In external validation, VTExt achieved promising performance in 2 additional geographically distant organizations using different electronic health record systems. When compared against a deep learning model and 4 machine learning models, VTExt exhibited similar or even improved performance across all metrics. Conclusions: This study demonstrates a data-driven NLP-based approach to clinical note information extraction that can be generalized to different electronic health record systems across different institutions. Due to the robust performance of this tool, VTExt is the first NLP application to be used in a nationally endorsed eCQM.


  • Open Access

    Clinician Attitudes and Perceptions of Point-of-Care Information Resources and Their Integration Into Electronic Health Records: Qualitative Interview Study

    by Marlika Marceau, Sevan Dulgarian, Jacob Cambre, Pamela M Garabedian, Mary G Amato, Diane L Seger, Lynn A Volk, Gretchen Purcell Jackson, David W Bates, Ronen Rozenblum, et al.

    Background: Electronic health records (EHRs) are widely used in health care systems across the United States to help clinicians access patient medical histories in one central location. As medical knowledge expands, clinicians are increasingly using evidence-based point-of-care information (POCI) resources to facilitate clinical decision-making in medical practices. While these tools can improve clinical outcomes, few studies have assessed clinicians’ opinions on integrating them with EHRs. Objective: This study aims to assess clinicians’ attitudes and the perceived value of POCI resources for finding medication- and disease-related information in clinical practice and their integration with EHRs. Methods: Semistructured interviews were conducted with 10 clinicians from various roles and specialties between December 2021 and January 2022 at Brigham and Women’s Hospital in Boston, Massachusetts. A content analysis approach was used to examine participants’ responses and feedback on their current use of POCI resources, barriers and facilitators, mobile app use, and recommendations for improved integration. Results: Of the 10 participants, 6 (60%) were female, 9 (90%) were aged <40 years, and 8 (80%) had ≤10 years of experience in clinical practice. While UpToDate was the most preferred disease-related information resource (n=9, 90%), preferences for medication-related resources varied, with 2 (20%) participants favoring Micromedex, 2 (20%) favoring Lexicomp, 2 (20%) favoring Brigham and Women’s Hospital–specific drug administration guidelines, 2 (20%) favoring UpToDate, and 1 (10%) favoring Medscape. Most participants used their preferred tools weekly. Most clinicians preferred comprehensive POCI tools with clear, navigable layouts that eased and quickened the search for information. Features such as heavy text density, the lack of citations, and frequent log-ins to access the tool were viewed as barriers that limited content legibility, credibility, and accessibility. Access-related, tool-specific, and integration-related barriers were reported to negatively impact clinical workflow. Most (n=8, 80%) of the participants reported currently using mobile apps, reasoning that they facilitated quick and convenient searches for information; however, frequent updates, time-consuming log-ins, and high text density on smaller screens posed challenges. Most participants favored further integration of POCI resources with EHRs, with all reporting them being currently available as embedded links that launch externally. Some recommended that further integration would allow us to leverage existing POCI tool features, such as chatbots and knowledge links, as well as aspects of artificial intelligence and machine learning, such as predictive algorithms and personalized alert systems, to enhance EHR functionality. Conclusions: Participants favored integration to improve usability and optimize workplace efficiency by reducing the amount of time spent seeking answers to their medication- and disease-related questions. Recommendations on integration highlighted the need for stakeholder input in developing clinical decision support tools and interfaces that leverage advancements in artificial intelligence and machine learning while not compromising user experience or increasing time spent on tasks.


  • Accurately identifying incident cases of venous thromboembolism in the electronic health record: Performance of a novel phenotyping algorithm

    by Ania Syrowatka, Avery Pullman, Elizabeth Pajares, Kyra White, Michael Sainlaire, Jin Chen, Frank Chang, Krissy Gray, John Laurentiev, Wenyu Song, et al.


  • The Safety of Outpatient Health Care

    by David M. Levine, Ania Syrowatka, Hojjat Salmasian, David M. Shahian, Stuart Lipsitz, Jonathan P. Zebrowski, Laura C. Myers, Merranda S. Logan, Christopher G. Roy, Christine Iannaccone, et al.

    Despite considerable emphasis on delivering safe care, substantial patient harm occurs. Although most care occurs in the outpatient setting, knowledge of outpatient adverse events (AEs) remains limited. To measure AEs in the outpatient setting. Retrospective review of the electronic health record (EHR). 11 outpatient sites in Massachusetts in 2018. 3103 patients who received outpatient care. Using a trigger method, nurse reviewers identified possible AEs and physicians adjudicated them, ranked severity, and assessed preventability. Generalized estimating equations were used to assess the association of having at least 1 AE with age, sex, race, and primary insurance. Variation in AE rates was analyzed across sites. The 3103 patients (mean age, 52 years) were more often female (59.8%), White (75.1%), English speakers (90.8%), and privately insured (70.4%) and had a mean of 4 outpatient encounters in 2018. Overall, 7.0% (95% CI, 4.6% to 9.3%) of patients had at least 1 AE (8.6 events per 100 patients annually). Adverse drug events were the most common AE (63.8%), followed by health care-associated infections (14.8%) and surgical or procedural events (14.2%). Severity was serious in 17.4% of AEs, life-threatening in 2.1%, and never fatal. Overall, 23.2% of AEs were preventable. Having at least 1 AE was less often associated with ages 18 to 44 years than with ages 65 to 84 years (standardized risk difference, -0.05 [CI, -0.09 to -0.02]) and more often associated with Black race than with Asian race (standardized risk difference, 0.09 [CI, 0.01 to 0.17]). Across study sites, 1.8% to 23.6% of patients had at least 1 AE and clinical category of AEs varied substantially. Retrospective EHR review may miss AEs. Outpatient harm was relatively common and often serious. Adverse drug events were most frequent. Rates were higher among older adults. Interventions to curtail outpatient harm are urgently needed. Controlled Risk Insurance Company and the Risk Management Foundation of the Harvard Medical Institutions.


  • Open Access

    Clinician Attitudes and Perceptions of Point-of-Care Information Resources and Their Integration Into Electronic Health Records: Qualitative Interview Study (Preprint)

    by Marlika Marceau, Sevan Dulgarian, Jacob Cambre, Pamela M Garabedian, Mary G Amato, Diane L Seger, Lynn A Volk, Gretchen Purcell Jackson, David W Bates, Ronen Rozenblum, et al.

    BACKGROUND Electronic health records (EHRs) are widely used in health care systems across the United States to help clinicians access patient medical histories in one central location. As medical knowledge expands, clinicians are increasingly using evidence-based point-of-care information (POCI) resources to facilitate clinical decision-making in medical practices. While these tools can improve clinical outcomes, few studies have assessed clinicians’ opinions on integrating them with EHRs. OBJECTIVE This study aims to assess clinicians’ attitudes and the perceived value of POCI resources for finding medication- and disease-related information in clinical practice and their integration with EHRs. METHODS Semistructured interviews were conducted with 10 clinicians from various roles and specialties between December 2021 and January 2022 at Brigham and Women’s Hospital in Boston, Massachusetts. A content analysis approach was used to examine participants’ responses and feedback on their current use of POCI resources, barriers and facilitators, mobile app use, and recommendations for improved integration. RESULTS Of the 10 participants, 6 (60%) were female, 9 (90%) were aged <40 years, and 8 (80%) had ≤10 years of experience in clinical practice. While UpToDate was the most preferred disease-related information resource (n=9, 90%), preferences for medication-related resources varied, with 2 (20%) participants favoring Micromedex, 2 (20%) favoring Lexicomp, 2 (20%) favoring Brigham and Women’s Hospital–specific drug administration guidelines, 2 (20%) favoring UpToDate, and 1 (10%) favoring Medscape. Most participants used their preferred tools weekly. Most clinicians preferred comprehensive POCI tools with clear, navigable layouts that eased and quickened the search for information. Features such as heavy text density, the lack of citations, and frequent log-ins to access the tool were viewed as barriers that limited content legibility, credibility, and accessibility. Access-related, tool-specific, and integration-related barriers were reported to negatively impact clinical workflow. Most (n=8, 80%) of the participants reported currently using mobile apps, reasoning that they facilitated quick and convenient searches for information; however, frequent updates, time-consuming log-ins, and high text density on smaller screens posed challenges. Most participants favored further integration of POCI resources with EHRs, with all reporting them being currently available as embedded links that launch externally. Some recommended that further integration would allow us to leverage existing POCI tool features, such as chatbots and knowledge links, as well as aspects of artificial intelligence and machine learning, such as predictive algorithms and personalized alert systems, to enhance EHR functionality. CONCLUSIONS Participants favored integration to improve usability and optimize workplace efficiency by reducing the amount of time spent seeking answers to their medication- and disease-related questions. Recommendations on integration highlighted the need for stakeholder input in developing clinical decision support tools and interfaces that leverage advancements in artificial intelligence and machine learning while not compromising user experience or increasing time spent on tasks.

  • Open Access

    Straight to the point: evaluation of a Point of Care Information (POCI) resource in answering disease-related questions

    by Rachel Leah Wasserman, Diane L. Seger, Mary G. Amato, Zoe Co, Aqsa Mugal, Angela Rui, Pamela M. Garabedian, Marlika Marceau, Ania Syrowatka, Lynn A. Volk, et al.

    Objective: To evaluate the ability of DynaMedex, an evidence-based drug and disease Point of Care Information (POCI) resource, in answering clinical queries using keyword searches. Methods: Real-world disease-related questions compiled from clinicians at an academic medical center, DynaMedex search query data, and medical board review resources were categorized into five clinical categories (complications & prognosis, diagnosis & clinical presentation, epidemiology, prevention & screening/monitoring, and treatment) and six specialties (cardiology, endocrinology, hematology-oncology, infectious disease, internal medicine, and neurology). A total of 265 disease-related questions were evaluated by pharmacist reviewers based on if an answer was found (yes, no), whether the answer was relevant (yes, no), difficulty in finding the answer (easy, not easy), cited best evidence available (yes, no), clinical practice guidelines included (yes, no), and level of detail provided (detailed, limited details). Results: An answer was found for 259/265 questions (98%). Both reviewers found an answer for 241 questions (91%), neither found the answer for 6 questions (2%), and only one reviewer found an answer for 18 questions (7%). Both reviewers found a relevant answer 97% of the time when an answer was found. Of all relevant answers found, 68% were easy to find, 97% cited best quality of evidence available, 72% included clinical guidelines, and 95% were detailed. Recommendations for areas of resource improvement were identified. Conclusions: The resource enabled reviewers to answer most questions easily with the best quality of evidence available, providing detailed answers and clinical guidelines, with a high level of replication of results across users.


  • Cost Savings Associated With Implementing 4 Total Joint Replacement Electronic Clinical Quality Measures Nationally: 2020–2040

    by Patricia C. Rn Dykes, Mica Ba Curtin-Bowen, Calvin Franz, Ania Syrowatka, Stuart ScD Lipsitz, Michael Sainlaire, Alexandra Businger, Tien Bs Thai, Antonia F. Md Chen, Andrew J. Md Schoenfeld, et al.

    Background: Digital transformation using widely available electronic data is a key component to improving health outcomes and customer choice and decreasing cost and measurement burden. Despite these benefits, existing information on the potential cost savings from electronic clinical quality measures (eCQMs) is limited. Methods: We assessed the costs of implementing 4 eCQMs related to total hip and/or total knee arthroplasty into electronic health record systems across healthcare systems in the United States. We used published literature and technical expert panel consultation to calculate low-, mid-, and high-range hip and knee arthroplasty surgery projections, and used empirical testing, literature, and technical expert panel consultation to develop an economic model to assess projected cost savings of eCQMs when implemented nationally. Results: Low-, mid-, and high-range projected cost savings for year’s 2020, 2030, and 2040 were calculated for 4 orthopedic eCQMs. Mid-range projected cost savings for 2020 ranged from $7.9 to $31.9 million per measure per year. A breakeven of between 0.5% and 5.1% of adverse events (measure dependent) must be averted for cost savings to outweigh implementation costs. Conclusions: All measures demonstrated potential cost savings. These findings suggest that eCQMs have the potential to lower healthcare costs and improve patient outcomes without adding to physician documentation burden. The Centers for Medicare and Medicaid Services’ investment in eCQMs is an opportunity to reduce adverse outcomes and excess costs in orthopedics.