Overview of BioASQ 2024: The twelfth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
Preprint
Abstract
This is an overview of the twelfth edition of the BioASQ challenge in the context of the Conference and Labs of the Evaluation Forum (CLEF) 2024. BioASQ is a series of international challenges promoting advances in large-scale biomedical semantic indexing and question answering. This year, BioASQ consisted of new editions of the two established tasks b and Synergy, and two new tasks: a) MultiCardioNER on the adaptation of clinical entity detection to the cardiology domain in a multilingual setting, and b) BIONNE on nested NER in Russian and English. In this edition of BioASQ, 37 competing teams participated with more than 700 distinct submissions in total for the four different shared tasks of the challenge. Similarly to previous editions, most of the participating systems achieved competitive performance, suggesting the continuous advancement of the state-of-the-art in the field.Keywords
All Related Versions
- Version 1, 2025-08-28, ArXiv
- Published version: , 3.
This publication has 14 references indexed in Scilit:
- BioASQ at CLEF2024: The Twelfth Edition of the Large-Scale Biomedical Semantic Indexing and Question Answering Challenge2024
- NEREL: a Russian information extraction dataset with rich annotation for nested entities, relations, and wikidata entity linksLanguage Resources and Evaluation, 2023
- Localizing in-domain adaptation of transformer-based biomedical language modelsJournal of Biomedical Informatics, 2023
- Prompts in Few-Shot Named Entity RecognitionPattern Recognition and Image Analysis, 2023
- NEREL-BIO: a dataset of biomedical abstracts annotated with nested named entitiesBioinformatics, 2023
- BioASQ-QA: A manually curated corpus for Biomedical Question AnsweringScientific Data, 2023
- Domain-Specific Language Model Pretraining for Biomedical Natural Language ProcessingACM Transactions on Computing for Healthcare, 2021
- Unsupervised Cross-lingual Representation Learning at Scale2020
- BioCreative V CDR task corpus: a resource for chemical disease relation extractionDatabase: The Journal of Biological Databases and Curation, 2016
- An overview of the BIOASQ large-scale biomedical semantic indexing and question answering competitionBMC Bioinformatics, 2015