BYBerke Yazan

Berke Yazan

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Berke Yazan has a total of 11 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Screenathon 2.0: human–AI collaborative screening applied to patient-generated health data

    by Jonas Bergmann, Tiago Azzi, Rutger Neeleman, Kianush Monschau, Berke Yazan, Elena Jalsovec, Emily Westerbeek, Felix Weijdema, Jonathan de Bruin, Qixiang Fang, et al.

    Systematic reviews are essential for evidence-based research, yet the traditional screening process is time-consuming and difficult to scale. Human-only screening can introduce inconsistency, while fully automated approaches employing Large Language Models often lack the contextual judgement required for complex decisions. To address this, we introduce a crowd-based screening methodology that integrates human expertise with adaptive machine learning. The methods have been applied in the context of a large EU project where experts from 27 collaborating partners jointly screened 5842 papers across eleven disease topics related to patient-generated health data in a span of 2 days. Post-processing played a central role in ensuring data quality, including topic reallocation, targeted full-text verification, and noisy-label filtering. This Screenathon resulted in 487 records being labeled as relevant and 6,463 records as irrelevant. The number of records screened per participant ranged from 3 to 2496, with a mean of 216.4 records per screener ( SE = 95.19). Exploratory analyses using survey results indicated increased trust in AI-assisted systematic reviewing after the event, along with generally positive evaluations of usability. The current Screenathon demonstrates that crowdsourced human–AI collaboration requires thoughtful training and calibration, together with strong post-processing safeguards.


  • Open Access

    Updated Approach to Error Rates in Systematic Review Screening: Integrating Active Learning, Large Language Models, and Full-Text Screening Data

    by Rutger Chris Neeleman, Berke Yazan, Emily Westerbeek, Wouter van Ballegooijen, Rens van de Schoot

    Screening records for a systematic review or meta-analysis (SRMA) can be both time-consuming and prone to errors. Wang et al. (2020) estimated that humans misclassify about 10.76% of records during abstract screening, relative to the gold-standard full-text decision, as false inclusions or false exclusions. Errors at the full-text level are rarely evaluated, as are errors in AI-assisted screening methods for SRMAs, which are becoming more common. We applied Wang et al. (2020)’s approach to determine error rates for human-only, human-AI, and AI-only screening at both the title-abstract and full-text stages. This analysis used data from collaborative projects focused on SRMA screening, including Synergy, IMPROVE, FORAS, and MetaPsy. Our overall weighted error rate was 3.51% (95% CI 0.42%-6.60%), likely influenced by lower error rates at the full-text level (0.15%, 95% CI 0.00%-2.61%) and for AI-assisted methods (1.13%, 95% CI 0.00%-9.38%). False exclusions, which can significantly affect SRMA outcomes, had the highest error rate at 10.89% (95% CI 4.43%-17.35%). Because gold standards are not perfect, they may include even more false exclusions due to incomplete assessment at the full-text level. AI techniques such as the noisy label filter (NLF) and large language models (LLMs) are well suited to identifying these false exclusions and reducing human workload. Furthermore, we propose a screening error origin model (SEOM) with potential error threats (PETs), highlighting the importance of clearer communication between human and AI agents, for instance, regarding label uncertainty. Future research could focus on specific PETs to minimize their impact and thereby decrease overall error rates.


  • Open Access

    Screenathon 2.0: Human–AI Collaborative Screening Applied to Patient-Generated Health Data

    by Jonas Bergmann, Tiago Azzi, Rutger Chris Neeleman, Kianush Monschau, Elena Jalsovec, Emily Westerbeek, Felix Weijdema, Jonathan de Bruin, Qixiang Fang, Rens van de Schoot, et al.

    Systematic reviews are essential for evidence-based research, yet the traditional screening process is time-consuming and difficult to scale. Human-only screening can introduce inconsistency, while fully automated approaches employing Large Language Models often lack the contextual judgement required for complex decisions. To address this, we introduce a crowd-based screening methodology that integrates human expertise with adaptive machine learning. The methods have been applied in the context of a large EU project where experts from 27 collaborating partners jointly screened 5,842 papers across eleven disease topics related to patient-generated health data in a span of only 2 days. Post-processing played a central role in ensuring data quality, including topic reallocation, targeted full-text verification, and noisy-label filtering. This Screenathon resulted in 487 records being labeled as relevant and 6,463 records as irrelevant. The number of records screened per participant ranged from 3 to 2,496, with a mean of 216.4 records per screener (SE = 95.19). Survey results indicated increased trust in AI-assisted systematic reviewing after the event, along with generally positive evaluations of usability. The current Screenathon demonstrates that human–AI collaboration can increase efficiency while maintaining rigor, provided that workflows include thoughtful training and calibration together with strong post-processing safeguards.