AZAlem Zekarias

Alem Zekarias

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Alem Zekarias has a total of 12 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    AI as a signal assessor – Can a Large Language Model perform causality assessment on a case series?

    by Aditi Shenoy, Alem Zekarias, Anders Viklund, Joseph Mitchell, Jim Barrett, Lovisa Sandberg, Eva-Lisa Meldau, Henric Taavola-Gustafsson

    Background: Large Language Models (LLMs) are increasingly explored for pharmacovigilance tasks, including information extraction, case documentation, and single-case causality assessment. However, their ability to support causality assessment at the case series level — a complex, time-intensive task requiring clinical reasoning across multiple reports — remains unexplored. Objective: To investigate how a large-scale general-purpose LLM can support pharmacovigilance professionals in assessing causality in a case series, and to explore how prompt design influences the quality of the model’s reasoning. Methods: GPT-4o was used to assess causality for five drug – adverse event combinations, using an adaptation of the Bradford Hill viewpoints for case series assessment. The combinations represented varying drugs and vaccines, adverse events, and case series sizes (5–402 reports). One combination served as a negative control. Structured prompts were iteratively developed and refined using one combination, then applied to all combinations. LLM-generated assessments for each viewpoint were qualitatively evaluated by human annotators for accuracy (precision), and the LLM’s coverage of key aspects from the original signal text was assessed for one combination (recall). Results: Across all five combinations, annotators agreed with 79–92% of the LLM’s output sentences. Full disagreement was consistently low (3–7%), with errors typically involving misinterpretation of complex report details rather than outright fabrication. Prompt design substantially influenced output quality; providing Bradford Hill viewpoint descriptions, including case series data, and adding explicit anti-hallucination instructions improved specificity and grounding. For the recall assessment, 15 of 23 key segments from the original signal text were reflected in the LLM output. The overall summary assessments demonstrated balanced reasoning, correctly distinguishing between positive safety signals and the negative control, and provided a coherent synthesis suitable as a starting point for human assessors. Conclusions: LLMs have the potential to generate contextually nuanced and largely accurate preliminary causality assessments of case series aligned with the Bradford Hill viewpoints, with a low but non-zero hallucination rate. These findings support LLMs as a tool to augment, not replace, expert judgment in signal assessment. Future work should address larger and more diverse signal sets, improved evaluation frameworks for generative output, and the integration of pre-computed summary statistics to reduce errors. Key points: A large language model (GPT-4o) can support pharmacovigilance professionals by generating preliminary causality assessments of a case series that align with human expert judgment. Generated in minutes, such assessments could give assessors a structured starting point for in-depth review, condensing case-level information and surfacing early evidence for or against a signal. Output quality depended heavily on prompt design, and because the hallucination rate was low but not zero, these tools should augment, not replace, expert judgment in signal assessment.

  • Open Access

    Narrative Search Engine for Case Series Assessment Supported by Artificial Intelligence Query Suggestions

    by Alem Zekarias, Eva-Lisa Meldau, Shachi Bista, Joana Félix China, Lovisa Sandberg

    Introduction Manual identification of case narratives with specific relevant information can be challenging when working with large numbers of adverse event reports (case series). The process can be supported with a search engine, but building search queries often remains a manual task. Suggesting terms to add to the search query could support assessors in the identification of case narratives within a case series. Objective The aim of this study is to explore the feasibility of identifying case narratives containing specific characteristics with a narrative search engine supported by artificial intelligence (AI) query suggestions. Methods The narrative search engine uses Best Match 25 (BM25) and suggests additional query terms from two word embedding models providing English and biomedical words to a human in the loop. We calculated the percentage of relevant narratives retrieved by the system (recall) and the percentage of retrieved narratives relevant to the search (precision) on an evaluation dataset including narratives from VigiBase, the World Health Organization global database of adverse event reports for medicines and vaccines. Exact-match search and BM25 search with the Relevance Model (RM3), an alternative way to expand queries, were used as comparators. Results The gold standard included 55/750 narratives labelled as relevant. Our narrative search engine retrieved on average 56.4% of the relevant narratives (recall), which is higher when compared with exact-match search (21.8%), without a significant drop in precision (54.5% to 43.1%). The recall is also higher as compared with RM3 (34.4%). Conclusions Our study demonstrates that a narrative search engine supported by AI query suggestions can be a viable alternative to an exact-match search and BM25 search with RM3, since it can facilitate the retrieval of additional relevant narratives during signal assessments.


  • Open Access

    Sex Differences in Reported Adverse Drug Reactions to COVID-19 Drugs in a Global Database of Individual Case Safety Reports

    by Alem Zekarias, Sarah Watson, Sara Hedfors Vidlin, Birgitta Grundmark

    Introduction In late 2019, a new coronavirus—severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2)—was discovered in Wuhan, China, and the World Health Organization later declared coronavirus disease 2019 (COVID-19) a pandemic. Numerous drugs have been repurposed and investigated for therapeutic effectiveness in the disease, including those from “Solidarity,” an international clinical trial (azithromycin, chloroquine, hydroxychloroquine, the fixed combination lopinavir/ritonavir, and remdesivir). Objective Our objective was to evaluate adverse drug reaction (ADR) reporting for drugs when used in the treatment of COVID-19 compared with use for other indications, specifically focussing on sex differences. Method We extracted reports on COVID-19-specific treatments from the global ADR database, VigiBase, using an algorithm developed to identify reports that listed COVID-19 as the indication. The Solidarity trial drugs were included, as were any drugs reported ≥ 100 times. We performed a descriptive comparison of reports for the same drugs used in non-COVID-19 indications. The data lock point date was 7 June 2020. Results In total, 2573 reports were identified for drugs used in the treatment of COVID-19. In order of frequency, the most reported ADRs were electrocardiogram QT-prolonged, diarrhoea, nausea, hepatitis, and vomiting in males and diarrhoea, electrocardiogram QT-prolonged, nausea, vomiting, and upper abdominal pain in females. Other hepatic and kidney-related events were included in the top ten ADRs in males, whereas no hepatic or renal terms were reported for females. COVID-19-related reporting patterns differed from non-pandemic reporting for these drugs. Conclusion Review of a global database of suspected ADR reports revealed sex differences in the reporting patterns for drugs used in the treatment of COVID-19. Patterns of ADR sex differences need further elucidation.