Berke Yazan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Berke Yazan has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Emily Westerbeek
Department of Methodology and Statistics, Faculty of Social and Behavioural Sciences, Utrecht University, Utrecht, The Netherlands
3 shared publications - Rens van de Schoot
Utrecht University
3 shared publications - Rutger Chris Neeleman
Department of Methodology and Statistics, Faculty of Social and Behavioural Sciences, Utrecht University, Utrecht, The Netherlands
3 shared publications - Elena Jalsovec
Department of Methodology and Statistics, Faculty of Social and Behavioural Sciences, Utrecht University, Utrecht, The Netherlands
2 shared publications - Felix Weijdema
Utrecht University Library, Utrecht University, Utrecht, The Netherlands
2 shared publications - Jonas Bergmann
Department of Methodology and Statistics, Faculty of Social and Behavioural Sciences, Utrecht University, Utrecht, The Netherlands
2 shared publications
Latest Publications
- Open Access
- 22 March 2026
- Published by Springer Nature in Scientific Reports
- Vol. 16 (1)
Screenathon 2.0: human–AI collaborative screening applied to patient-generated health data
Systematic reviews are essential for evidence-based research, yet the traditional screening process is time-consuming and difficult to scale. Human-only screening can introduce inconsistency, while fully automated approaches employing Large Language Models often lack the contextual judgement required for complex decisions. To address this, we introduce a crowd-based screening methodology that integrates human expertise with adaptive machine learning. The methods have been applied in the context of a large EU project where experts from 27 collaborating partners jointly screened 5842 papers across eleven disease topics related to patient-generated health data in a span of 2 days. Post-processing played a central role in ensuring data quality, including topic reallocation, targeted full-text verification, and noisy-label filtering. This Screenathon resulted in 487 records being labeled as relevant and 6,463 records as irrelevant. The number of records screened per participant ranged from 3 to 2496, with a mean of 216.4 records per screener ( SE = 95.19). Exploratory analyses using survey results indicated increased trust in AI-assisted systematic reviewing after the event, along with generally positive evaluations of usability. The current Screenathon demonstrates that crowdsourced human–AI collaboration requires thoughtful training and calibration, together with strong post-processing safeguards.
- 22 March 2026
- Published by Springer Nature in Scientific Reports
- Vol. 16 (1)
Open AccessScreenathon 2.0: human–AI collaborative screening applied to patient-generated health data
Systematic reviews are essential for evidence-based research, yet the traditional screening process is time-consuming and difficult to scale. Human-only screening can introduce inconsistency, while fully automated approaches employing Large Language Models often lack the contextual judgement required for complex decisions. To address this, we introduce a crowd-based screening methodology that integrates human expertise with adaptive machine learning. The methods have been applied in the context of a large EU project where experts from 27 collaborating partners jointly screened 5842 papers across eleven disease topics related to patient-generated health data in a span of 2 days. Post-processing played a central role in ensuring data quality, including topic reallocation, targeted full-text verification, and noisy-label filtering. This Screenathon resulted in 487 records being labeled as relevant and 6,463 records as irrelevant. The number of records screened per participant ranged from 3 to 2496, with a mean of 216.4 records per screener ( SE = 95.19). Exploratory analyses using survey results indicated increased trust in AI-assisted systematic reviewing after the event, along with generally positive evaluations of usability. The current Screenathon demonstrates that crowdsourced human–AI collaboration requires thoughtful training and calibration, together with strong post-processing safeguards.
- Open Access
- 26 January 2026
- Published by Center for Open Science in PsyArXiv
Updated Approach to Error Rates in Systematic Review Screening: Integrating Active Learning, Large Language Models, and Full-Text Screening Data
Screening records for a systematic review or meta-analysis (SRMA) can be both time-consuming and prone to errors. Wang et al. (2020) estimated that humans misclassify about 10.76% of records during abstract screening, relative to the gold-standard full-text decision, as false inclusions or false exclusions. Errors at the full-text level are rarely evaluated, as are errors in AI-assisted screening methods for SRMAs, which are becoming more common. We applied Wang et al. (2020)’s approach to determine error rates for human-only, human-AI, and AI-only screening at both the title-abstract and full-text stages. This analysis used data from collaborative projects focused on SRMA screening, including Synergy, IMPROVE, FORAS, and MetaPsy. Our overall weighted error rate was 3.51% (95% CI 0.42%-6.60%), likely influenced by lower error rates at the full-text level (0.15%, 95% CI 0.00%-2.61%) and for AI-assisted methods (1.13%, 95% CI 0.00%-9.38%). False exclusions, which can significantly affect SRMA outcomes, had the highest error rate at 10.89% (95% CI 4.43%-17.35%). Because gold standards are not perfect, they may include even more false exclusions due to incomplete assessment at the full-text level. AI techniques such as the noisy label filter (NLF) and large language models (LLMs) are well suited to identifying these false exclusions and reducing human workload. Furthermore, we propose a screening error origin model (SEOM) with potential error threats (PETs), highlighting the importance of clearer communication between human and AI agents, for instance, regarding label uncertainty. Future research could focus on specific PETs to minimize their impact and thereby decrease overall error rates.
- 26 January 2026
- Published by Center for Open Science in PsyArXiv
Open AccessUpdated Approach to Error Rates in Systematic Review Screening: Integrating Active Learning, Large Language Models, and Full-Text Screening Data
Screening records for a systematic review or meta-analysis (SRMA) can be both time-consuming and prone to errors. Wang et al. (2020) estimated that humans misclassify about 10.76% of records during abstract screening, relative to the gold-standard full-text decision, as false inclusions or false exclusions. Errors at the full-text level are rarely evaluated, as are errors in AI-assisted screening methods for SRMAs, which are becoming more common. We applied Wang et al. (2020)’s approach to determine error rates for human-only, human-AI, and AI-only screening at both the title-abstract and full-text stages. This analysis used data from collaborative projects focused on SRMA screening, including Synergy, IMPROVE, FORAS, and MetaPsy. Our overall weighted error rate was 3.51% (95% CI 0.42%-6.60%), likely influenced by lower error rates at the full-text level (0.15%, 95% CI 0.00%-2.61%) and for AI-assisted methods (1.13%, 95% CI 0.00%-9.38%). False exclusions, which can significantly affect SRMA outcomes, had the highest error rate at 10.89% (95% CI 4.43%-17.35%). Because gold standards are not perfect, they may include even more false exclusions due to incomplete assessment at the full-text level. AI techniques such as the noisy label filter (NLF) and large language models (LLMs) are well suited to identifying these false exclusions and reducing human workload. Furthermore, we propose a screening error origin model (SEOM) with potential error threats (PETs), highlighting the importance of clearer communication between human and AI agents, for instance, regarding label uncertainty. Future research could focus on specific PETs to minimize their impact and thereby decrease overall error rates.
- Open Access
- 9 January 2026
- Published by Center for Open Science in PsyArXiv
Screenathon 2.0: Human–AI Collaborative Screening Applied to Patient-Generated Health Data
Systematic reviews are essential for evidence-based research, yet the traditional screening process is time-consuming and difficult to scale. Human-only screening can introduce inconsistency, while fully automated approaches employing Large Language Models often lack the contextual judgement required for complex decisions. To address this, we introduce a crowd-based screening methodology that integrates human expertise with adaptive machine learning. The methods have been applied in the context of a large EU project where experts from 27 collaborating partners jointly screened 5,842 papers across eleven disease topics related to patient-generated health data in a span of only 2 days. Post-processing played a central role in ensuring data quality, including topic reallocation, targeted full-text verification, and noisy-label filtering. This Screenathon resulted in 487 records being labeled as relevant and 6,463 records as irrelevant. The number of records screened per participant ranged from 3 to 2,496, with a mean of 216.4 records per screener (SE = 95.19). Survey results indicated increased trust in AI-assisted systematic reviewing after the event, along with generally positive evaluations of usability. The current Screenathon demonstrates that human–AI collaboration can increase efficiency while maintaining rigor, provided that workflows include thoughtful training and calibration together with strong post-processing safeguards.
- 9 January 2026
- Published by Center for Open Science in PsyArXiv
Open AccessScreenathon 2.0: Human–AI Collaborative Screening Applied to Patient-Generated Health Data
Systematic reviews are essential for evidence-based research, yet the traditional screening process is time-consuming and difficult to scale. Human-only screening can introduce inconsistency, while fully automated approaches employing Large Language Models often lack the contextual judgement required for complex decisions. To address this, we introduce a crowd-based screening methodology that integrates human expertise with adaptive machine learning. The methods have been applied in the context of a large EU project where experts from 27 collaborating partners jointly screened 5,842 papers across eleven disease topics related to patient-generated health data in a span of only 2 days. Post-processing played a central role in ensuring data quality, including topic reallocation, targeted full-text verification, and noisy-label filtering. This Screenathon resulted in 487 records being labeled as relevant and 6,463 records as irrelevant. The number of records screened per participant ranged from 3 to 2,496, with a mean of 216.4 records per screener (SE = 95.19). Survey results indicated increased trust in AI-assisted systematic reviewing after the event, along with generally positive evaluations of usability. The current Screenathon demonstrates that human–AI collaboration can increase efficiency while maintaining rigor, provided that workflows include thoughtful training and calibration together with strong post-processing safeguards.