Claudia Giuliani
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Claudia Giuliani has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Felix Engel
Institute of Medical Biometry and Statistics, Medical Faculty and Medical Center, University of Freiburg, Stefan-Meier-Str. 26, Freiburg, 79104, Germany, 49 076127083739
2 shared publications - Gita Benadi
Institute of Medical Biometry and Statistics, Medical Faculty and Medical Center, University of Freiburg, Stefan-Meier-Str. 26, Freiburg, 79104, Germany, 49 076127083739
2 shared publications - Harald Binder
Institute of Medical Biometry and Statistics (IMBI), Faculty of Medicine and Medical Center, University of Freiburg, Germany
2 shared publications - Klaus Kaier
Institute of Medical Biometry and Statistics, Department of Methods in Clinical Epidemiology, University Medical Center Freiburg, Freiburg im Breisgau, Germany
2 shared publications - Manuel Watter
Institute of Medical Biometry and Statistics, Medical Faculty and Medical Center, University of Freiburg, Stefan-Meier-Str. 26, Freiburg, 79104, Germany, 49 076127083739
2 shared publications - Guido Schwarzer
Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center, University of Freiburg, Freiburg, Germany
1 shared publication
Latest Publications
- Open Access
- 20 November 2025
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 9 (1) , e73822
Identifying Biomedical Entities for Datasets in Scientific Articles: 4-Step Cache-Augmented Generation Approach Using GPT-4o and PubTator 3.0
Background: The accurate extraction of biomedical entities in scientific articles is essential for effective metadata annotation of research datasets, ensuring data findability, accessibility, interoperability, and reusability in collaborative research. Objective: This study aimed to introduce a novel 4-step cache-augmented generation approach to identify biomedical entities for an automated metadata annotation of datasets, leveraging GPT-4o and PubTator 3.0. Methods: The method integrates four steps: (1) generation of candidate entities using GPT-4o, (2) validation via PubTator 3.0, (3) term extraction based on a metadata schema developed for the specific research area, and (4) a combined evaluation of PubTator-validated and schema-related terms. Applied to 23 articles published in the context of the Collaborative Research Center OncoEscape , the process was validated through supervised, face-to-face interviews with article authors, allowing an assessment of annotation precision using random-effects meta-analysis. Results: The approach yielded a mean of schema-related and PubTator-validated biomedical entities per article. Within the study’s specific context, the overall annotation precision was 98% (95% CI 94%-100%), with most prediction errors concentrated in articles outside the primary basic research domain of the schema. In a subsample (n=20), available supplemental material was included in the prediction process, but it did not improve precision (98%, 95% CI 95%‐100%). Moreover, the mean number of schema-related entities was ( P =.56) and the mean number of PubTator-validated entities was ( P =.68); these values did not increase with the additional information provided in the supplement. Conclusions: This study highlights the potential of large language model–supported metadata annotation. The findings underscore the practical feasibility of full-text analysis and suggest its potential for integration into routine workflows for biomedical metadata generation.
- 20 November 2025
- Published by JMIR Publications Inc. in JMIR Formative Research
- Vol. 9 (1) , e73822
Open AccessIdentifying Biomedical Entities for Datasets in Scientific Articles: 4-Step Cache-Augmented Generation Approach Using GPT-4o and PubTator 3.0
Background: The accurate extraction of biomedical entities in scientific articles is essential for effective metadata annotation of research datasets, ensuring data findability, accessibility, interoperability, and reusability in collaborative research. Objective: This study aimed to introduce a novel 4-step cache-augmented generation approach to identify biomedical entities for an automated metadata annotation of datasets, leveraging GPT-4o and PubTator 3.0. Methods: The method integrates four steps: (1) generation of candidate entities using GPT-4o, (2) validation via PubTator 3.0, (3) term extraction based on a metadata schema developed for the specific research area, and (4) a combined evaluation of PubTator-validated and schema-related terms. Applied to 23 articles published in the context of the Collaborative Research Center OncoEscape , the process was validated through supervised, face-to-face interviews with article authors, allowing an assessment of annotation precision using random-effects meta-analysis. Results: The approach yielded a mean of schema-related and PubTator-validated biomedical entities per article. Within the study’s specific context, the overall annotation precision was 98% (95% CI 94%-100%), with most prediction errors concentrated in articles outside the primary basic research domain of the schema. In a subsample (n=20), available supplemental material was included in the prediction process, but it did not improve precision (98%, 95% CI 95%‐100%). Moreover, the mean number of schema-related entities was ( P =.56) and the mean number of PubTator-validated entities was ( P =.68); these values did not increase with the additional information provided in the supplement. Conclusions: This study highlights the potential of large language model–supported metadata annotation. The findings underscore the practical feasibility of full-text analysis and suggest its potential for integration into routine workflows for biomedical metadata generation.
- Open Access
Automated Identification of Contextually Relevant Biomedical Entities with Grounded LLMs
This study investigates the effectiveness of different large language models (LLMs) for automated biomedical entity annotation in research articles with a focus on contextualized and grounded results. A 4-step generative workflow iteratively generates and refines entity candidates by considering a metadata schema for context and agentic tool use for validation with the PubTator 3 data base. The precision of this flow was assessed with a random effects meta-analysis after face-to-face interviews with authors of six papers from the Collaborative Research Center (CRC) 1453 “NephGen”. With an overall precision of 91.3%, the selected models provide qualitatively valuable annotations, with models GPT 4.1, GPT-4o Mini, and Gemini 2.0 Flash showing the highest precision. While GPT 4.1 and Gemini 2.0 Flash excelled in the total number of correct annotations, GPT-4o Mini and Gemini 2.0 Flash were fastest and most cost-effective. Large variations in annotation count and the conflation of publication and dataset-specific annotations highlight that human review (“human-in-the-loop”) is still important. The results further highlight the trade-offs between precision, total number of correct annotations, cost, and speed. While quality is paramount in collaborative research settings, cost-effectiveness could be more critical in public implementations.
Open AccessAutomated Identification of Contextually Relevant Biomedical Entities with Grounded LLMs
This study investigates the effectiveness of different large language models (LLMs) for automated biomedical entity annotation in research articles with a focus on contextualized and grounded results. A 4-step generative workflow iteratively generates and refines entity candidates by considering a metadata schema for context and agentic tool use for validation with the PubTator 3 data base. The precision of this flow was assessed with a random effects meta-analysis after face-to-face interviews with authors of six papers from the Collaborative Research Center (CRC) 1453 “NephGen”. With an overall precision of 91.3%, the selected models provide qualitatively valuable annotations, with models GPT 4.1, GPT-4o Mini, and Gemini 2.0 Flash showing the highest precision. While GPT 4.1 and Gemini 2.0 Flash excelled in the total number of correct annotations, GPT-4o Mini and Gemini 2.0 Flash were fastest and most cost-effective. Large variations in annotation count and the conflation of publication and dataset-specific annotations highlight that human review (“human-in-the-loop”) is still important. The results further highlight the trade-offs between precision, total number of correct annotations, cost, and speed. While quality is paramount in collaborative research settings, cost-effectiveness could be more critical in public implementations.