Characterization and automated classification of sentences in the biomedical literature: a case study for biocuration of gene expression and protein kinase activity
Preprint
Abstract
Biological knowledgebases are essential resources for biomedical researchers, providing ready access to gene function and genomic data. Professional, manual curation of knowledgebases, however, is labor-intensive and thus high-performing machine learning methods that improve biocuration efficiency are needed. Here we report on sentence-level classification to identify biocuration-relevant sentences in the full text of published references for two gene function data types: gene expression and protein kinase activity. We performed a detailed characterization of sentences from references in the WormBase bibliography and used this characterization to define three tasks for classifying sentences as either 1) fully curatable, 2) fully and partially curatable, or 3) all language-related. We evaluated various machine learning (ML) models applied to these tasks and found that GPT and BioBERT achieve the highest average performance, resulting in F1 performance scores ranging from 0.89 to 0.99 depending upon the task. Our findings demonstrate the feasibility of extracting biocuration-relevant sentences from full text. Integrating these models into professional biocuration workflows, such as those used by the Alliance of Genome Resources and the ACKnowledge community curation platform, might well facilitate efficient and accurate annotation of the biomedical literature.Keywords
All Related Versions
- Published version: Database: The Journal of Biological Databases and Curation, 2025.
This publication has 44 references indexed in Scilit:
- OntoMate: a text-mining tool aiding curation at the Rat Genome DatabaseDatabase: The Journal of Biological Databases and Curation, 2015
- A method for increasing expressivity of Gene Ontology annotations using a compositional approachBMC Bioinformatics, 2014
- Overview of the gene ontology task at BioCreative IVDatabase: The Journal of Biological Databases and Curation, 2014
- BC4GO: a full-text corpus for the BioCreative IV GO taskDatabase: The Journal of Biological Databases and Curation, 2014
- Automatic categorization of diverse experimental information in the bioscience literatureBMC Bioinformatics, 2012
- Assessment of community-submitted ontology annotations from a novel database-journal partnershipDatabase: The Journal of Biological Databases and Curation, 2012
- Directly e-mailing authors of newly published papers encourages community curationDatabase: The Journal of Biological Databases and Curation, 2012
- Automatically classifying sentences in full-text biomedical articles into Introduction, Methods, Results and DiscussionBioinformatics, 2009
- Semi-automated curation of protein subcellular localization: a text mining-based approach to Gene Ontology (GO) Cellular Component curationBMC Bioinformatics, 2009
- Multi-dimensional classification of biomedical text: Toward automated, practical provision of high-utility text to diverse usersBioinformatics, 2008