Large-Scale Biomedical Relation Extraction Across Diverse Relation Types: Model Development and Usability Study on COVID-19 (Preprint)
Preprint
- 11 April 2023
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND Biomedical relation extraction (RE) is of great importance for researchers to conduct systematic biomedical studies. It not only helps knowledge mining, such as knowledge graphs and novel knowledge discovery, but also promotes translational applications, such as clinical diagnosis, decision-making, and precision medicine. However, the relations between biomedical entities are complex and diverse, and comprehensive biomedical RE is not yet well established. OBJECTIVE We aimed to investigate and improve large-scale RE with diverse relation types and conduct usability studies with application scenarios to optimize biomedical text mining. METHODS Data sets containing 125 relation types with different entity semantic levels were constructed to evaluate the impact of entity semantic information on RE, and performance analysis was conducted on different model architectures and domain models. This study also proposed a continued pretraining strategy and integrated models with scripts into a tool. Furthermore, this study applied RE to the COVID-19 corpus with article topics and application scenarios of clinical interest to assess and demonstrate its biological interpretability and usability. RESULTS The performance analysis revealed that RE achieves the best performance when the detailed semantic type is provided. For a single model, PubMedBERT with continued pretraining performed the best, with an F1-score of 0.8998. Usability studies on COVID-19 demonstrated the interpretability and usability of RE, and a relation graph database was constructed, which was used to reveal existing and novel drug paths with edge explanations. The models (including pretrained and fine-tuned models), integrated tool (Docker), and generated data (including the COVID-19 relation graph database and drug paths) have been made publicly available to the biomedical text mining community and clinical researchers. CONCLUSIONS This study provided a comprehensive analysis of RE with diverse relation types. Optimized RE models and tools for diverse relation types were developed, which can be widely used in biomedical text mining. Our usability studies provided a proof-of-concept demonstration of how large-scale RE can be leveraged to facilitate novel research.Keywords
All Related Versions
- Published version: Journal of Medical Internet Research, 25, e48115.
This publication has 42 references indexed in Scilit:
- The DDI corpus: An annotated corpus with pharmacological substances and drug–drug interactionsJournal of Biomedical Informatics, 2013
- PubTator: a web-based text mining tool for assisting biocurationNucleic Acids Research, 2013
- A Single Kernel-Based Approach to Extract Drug-Drug Interactions from Biomedical LiteraturePLOS ONE, 2012
- Palmitoylethanolamide Protects Dentate Gyrus Granule Cells via Peroxisome Proliferator-Activated Receptor-AlphaNeurotoxicity Research, 2010
- Astaxanthin decreased oxidative stress and inflammation and enhanced immune response in humansNutrition & Metabolism, 2010
- Evaluation of genome-wide association study results through development of ontology fingerprintsBioinformatics, 2009
- Gastric inflammatory markers and interleukins in patients with functional dyspepsia treated with astaxanthinFEMS Immunology & Medical Microbiology, 2007
- The Nuclear Receptor Peroxisome Proliferator-Activated Receptor-α Mediates the Anti-Inflammatory Actions of PalmitoylethanolamideMolecular Pharmacology, 2005
- BioRAT: extracting biological information from full-length papersBioinformatics, 2004
- The Genetic Association DatabaseNature Genetics, 2004