ISIpek Baris Schlicht

Ipek Baris Schlicht

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Ipek Baris Schlicht has a total of 35 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    From Past Outbreaks to Future Threats: Detecting Medical Conspiracy Theories With LLMs and Limited Labels

    by Ipek Baris Schlicht, Damir Korenčić, Berta Chulvi, Lucie Flek, Paolo Rosso

    Online dissemination of conspiracy theories (CTs) during epidemics poses significant risks to public health. This paper addresses the problem of detecting CTs in social media posts with an emphasis on the resource‐constrained scenarios characterized by the scarcity of labelled datasets and expert annotations, and the lack of computational budget for large‐scale LLM inference. To address these challenges, we investigate resource‐efficient methods for CT detection across multiple epidemics. We construct a novel dataset of CT‐labelled social media posts covering four major epidemics from the past decade: Ebola, Zika, COVID‐19 and Monkeypox. We conduct extensive experiments addressing four research questions: (1) the performance of BERT‐like models on individual epidemics, (2) the ability to transfer knowledge from past epidemics to new ones, (3) the efficacy of zero‐shot classification using Large Language Models (LLMs) and (4) the feasibility of training BERT‐like models on LLM‐labelled datasets. Our findings indicate that BERT‐like models exhibit highly variable performance across epidemics. Transfer learning from prior epidemics can be effective and their performance can be improved with the number of prior datasets. Zero‐shot LLM classifiers, including ensemble methods, achieve performance that matches or surpasses that of fine‐tuned BERT‐like models. Finally, we demonstrate that BERT‐like models trained on LLM‐labelled datasets achieve results close to the models trained on expert‐annotated data, offering a practical alternative when expert labelling is infeasible. While automated methods can be useful for data analysis, we caution against automatization of content filtering due to the inherent difficulty of CT detection and the potential biases of language models.

  • Zoom In Disparities in Healthcare LLM Q&A

    by Ipek Baris Schlicht, Burcu Sayin, Zhixue Zhao, Frederik M. Labonté, Cesare Barbera, Marco Viviani, Paolo Rosso, Lucie Flek

  • Open Access

    Human–LLM Dialogue Improves Diagnostic Accuracy in Emergency Care: Controlled Crossover Study (Preprint)

    by Burcu Sayin, Ngoc Vo Hong, Ipek Baris Schlicht, Jacopo Staiano, Pasquale Minervini, Sara Allievi, Nicola Susca, Nicola Osti, Alberto Maino, Vito Racanelli, et al.

    BACKGROUND Clinical decision-making in emergency medicine requires rapid, accurate diagnoses under uncertainty. Large language models (LLMs) have shown diagnostic potential, but evidence for their benefit in real physician workflows remains limited. OBJECTIVE This study evaluated whether MedSyn, a physician–LLM dialogue system, improves diagnostic accuracy in live emergency care workflows, and examined how benefit varies with case difficulty and physician expertise. METHODS Seven physicians (three senior internists, four residents) completed unassisted (baseline) and AI-assisted (interactive) sessions across 52 MIMIC-IV cases stratified by difficulty (Easy, Medium, Hard). Diagnostic performance was measured using automated fuzzy-matching metrics (any-match accuracy, exact-match accuracy, diagnosis-set F1) and blinded expert evaluation. Between-condition comparisons used paired bootstrap resampling (20,000 replicates, seed 42). RESULTS Interactive support significantly improved overall diagnostic accuracy: difficulty-standardised any-match accuracy improved by 0.156 (P < .001; d = 1.25). Residents showed the largest gains, with F1 improving by 0.138 (P < .001; d = 0.94). Blinded evaluation revealed residents’ Hard-case mean correctness rose from 0.589 to 0.734 (+0.145); difficulty-standardised completely-correct rates confirmed a medium effect (Δ = 0.092; P = .07; d = 0.47). Automated and blinded manual assessment showed only modest agreement (Cohen's κ = 0.148), with 45% of clinically correct diagnoses receiving no automated credit; reported F1 improvements are therefore conservative estimates. Cross-expertise concordance increased significantly (Δ = 0.142; P < .001; d = 1.48). Dialogue analysis revealed expertise-dependent strategies: seniors employed targeted, hypothesis-driven queries while residents used broader exploratory questioning. CONCLUSIONS Interactive LLM assistance meaningfully enhances diagnostic accuracy, particularly for resident physicians on complex cases. The expertise-stratified benefit profile, large effect sizes, and significant convergence in cross-expertise concordance suggest that adaptive LLM deployment, targeting high-complexity cases and less experienced clinicians, is a promising and evidence-grounded strategy for emergency diagnostic support.

  • Top Cited Papers
    Open Access

    A Survey on Automatic Credibility Assessment Using Textual Credibility Signals in the Era of Large Language Models

    by Ivan Srba, Olesya Razuvayevskaya, João A. Leite, Robert Moro, Ipek Baris Schlicht, Sara Tonelli, Francisco Moreno García, Santiago Barrio Lottmann, Denis Teyssou, Valentin Porcellini, et al.

    In the age of social media and generative AI, the ability to automatically assess the credibility of online content has become increasingly critical, complementing traditional approaches to false information detection. Credibility assessment relies on aggregating diverse credibility signals—small units of information, such as content subjectivity, bias or a presence of persuasion techniques—into a final credibility label/score. However, current research in automatic credibility assessment and credibility signals detection remains highly fragmented, with many signals studied in isolation and lacking integration. Notably, there is a scarcity of approaches that detect and aggregate multiple credibility signals simultaneously. These challenges are further exacerbated by the absence of a comprehensive and up-to-date overview of research works that connects these research efforts under a common framework and identifies shared trends, challenges and open problems. In this survey, we address this gap by presenting a systematic and comprehensive literature review of 175 research papers, focusing on textual credibility signals within the field of Natural Language Processing (NLP), which undergoes a rapid transformation due to advancements in Large Language Models (LLMs). While positioning the NLP research into the broader multidisciplinary landscape, we examine both automatic credibility assessment methods as well as the detection of nine categories of credibility signals. We provide an in-depth analysis of three key categories: (1) factuality, subjectivity and bias, (2) persuasion techniques and logical fallacies and (3) check-worthy and fact-checked claims. In addition to summarising existing methods, datasets and tools, we outline future research direction and emerging opportunities, with particular attention to evolving challenges posed by generative AI.


  • Open Access

    Detection of Medical Conspiracy Theories with Limited Resources: Using Data from Prior Epidemics and LLMs

    by Ipek Baris Schlicht, Damir Korenčić, Berta Chulvi, Lucie Flek, Paolo Rosso

    Online dissemination of conspiracy theories (CTs) during epidemics poses significant risks to public health. This paper addresses the problem of detecting CTs in social media posts with an emphasis on the resource-constrained scenarios characterized by the absence of labeled datasets and the high cost of expert annotation. To address these challenges, we investigate resource-efficient methods for CT detection across multiple epidemics. We construct a novel dataset of CT-labeled social media posts covering four major epidemics from the past decade: Ebola, Zika, COVID-19, and Monkeypox. We conduct extensive experiments addressing four research questions: (1) the performance of BERT-like models on individual epidemics, (2) the ability to transfer knowledge from past epidemics to new ones, (3) the efficacy of zero-shot classification using Large Language Models (LLMs), and (4) the feasibility of training BERT-like models on LLM-labeled datasets. Our findings indicate that BERT-like models exhibit highly variable performance across epidemics. Transfer learning from prior epidemics can be effective and their performance can be improved with the number of prior datasets. Zero-shot LLM classifiers, including ensemble methods, achieve performance that matches or surpasses that of fine-tuned BERT-like models. Finally, we demonstrate that BERT-like models trained on LLM-labeled datasets achieve results close to the models trained on expert-annotated data, offering a practical alternative when expert labeling is infeasible. While automated methods can be useful for data analysis, we caution against automatization of content filtering due to the inherent difficulty of CT detection and the potential biases of language models.

  • Do LLMs Provide Consistent Answers to Health-Related Questions Across Languages?

    by Ipek Baris Schlicht, Zhixue Zhao, Burcu Sayin, Lucie Flek, Paolo Rosso


  • Open Access

    Do LLMs Provide Consistent Answers to Health-Related Questions across Languages?

    by Ipek Baris Schlicht, Zhixue Zhao, Burcu Sayin, Lucie Flek, Paolo Rosso

    Equitable access to reliable health information is vital for public health, but the quality of online health resources varies by language, raising concerns about inconsistencies in Large Language Models (LLMs) for healthcare. In this study, we examine the consistency of responses provided by LLMs to health-related questions across English, German, Turkish, and Chinese. We largely expand the HealthFC dataset by categorizing health-related questions by disease type and broadening its multilingual scope with Turkish and Chinese translations. We reveal significant inconsistencies in responses that could spread healthcare misinformation. Our main contributions are 1) a multilingual health-related inquiry dataset with meta-information on disease categories, and 2) a novel prompt-based evaluation workflow that enables sub-dimensional comparisons between two languages through parsing. Our findings highlight key challenges in deploying LLM-based tools in multilingual contexts and emphasize the need for improved cross-lingual alignment to ensure accurate and equitable healthcare information.


  • Open Access

    Automatic detection of health misinformation: a systematic review

    by Ipek Baris Schlicht, Eugenia Fernandez, Berta Chulvi, Paolo Rosso

    The spread of health misinformation has the potential to cause serious harm to public health, from leading to vaccine hesitancy to adoption of unproven disease treatments. In addition, it could have other effects on society such as an increase in hate speech towards ethnic groups or medical experts. To counteract the sheer amount of misinformation, there is a need to use automatic detection methods. In this paper we conduct a systematic review of the computer science literature exploring text mining techniques and machine learning methods to detect health misinformation. To organize the reviewed papers, we propose a taxonomy, examine publicly available datasets, and conduct a content-based analysis to investigate analogies and differences among Covid-19 datasets and datasets related to other health domains. Finally, we describe open challenges and conclude with future directions.


  • Open Access

    Multilingual Detection of Check-Worthy Claims using World Languages and Adapter Fusion

    by Ipek Baris Schlicht, Lucie Flek, Paolo Rosso

    Check-worthiness detection is the task of identifying claims, worthy to be investigated by fact-checkers. Resource scarcity for non-world languages and model learning costs remain major challenges for the creation of models supporting multilingual check-worthiness detection. This paper proposes cross-training adapters on a subset of world languages, combined by adapter fusion, to detect claims emerging globally in multiple languages. (1) With a vast number of annotators available for world languages and the storage-efficient adapter models, this approach is more cost efficient. Models can be updated more frequently and thus stay up-to-date. (2) Adapter fusion provides insights and allows for interpretation regarding the influence of each adapter model on a particular language. The proposed solution often outperformed the top multilingual approaches in our benchmark tasks.