Extraction of biological terms using large language models enhances the usability of metadata in the BioSample database
Open Access
- 6 January 2025
- journal article
- Published by Oxford University Press (OUP) in GigaScience
- Vol. 14
Abstract
BioSample is a repository of experimental sample metadata. It is a comprehensive archive that enables searches of experiments, regardless of type. However, there is substantial variability in the submitted metadata due to the difficulty in defining comprehensive rules for describing them and the limited user awareness of best practices in creating them. This inconsistency poses considerable challenges to the findability and reusability of archived data. Given the scale of BioSample, which hosts over 40 million records, manual curation is impractical. Automatic rule-based ontology mapping methods have been proposed to address this issue, but their effectiveness is limited by the heterogeneity of the metadata. Recently, large language models (LLMs) have gained attention in natural language processing and are promising tools for automating metadata curation. In this study, we evaluated the performance of LLMs in extracting cell line names from BioSample descriptions using a gold-standard dataset derived from ChIP-Atlas, a secondary database of epigenomics experiment data in which samples were manually curated. The LLM-assisted methods outperformed traditional approaches, achieving higher accuracy and coverage. We further extended them to extract information about experimentally manipulated genes from metadata when manual curation had not yet been applied in ChIP-Atlas. This also yielded successful results, including the facilitation of more precise filtering of the data and the prevention of possible misinterpretations caused by the inclusion of unintended data. These findings underscore the potential of LLMs in improving the findability and reusability of experimental data in general, which would considerably reduce the user workload and enable more effective scientific data management.Keywords
All Related Versions
Funding Information
- JST
- JSPS (24K20889, 045RP2023, 039RP2024)
This publication has 20 references indexed in Scilit:
- GREIN: An Interactive Web Platform for Re-analyzing GEO RNA-seq DataScientific Reports, 2019
- Digital expression explorer 2: a repository of uniformly processed RNA sequencing dataGigaScience, 2019
- The variable quality of metadata about biological samples used in biomedical experimentsScientific Data, 2019
- The Cellosaurus, a Cell-Line Knowledge ResourceJournal of Biomolecular Techniques : JBT, 2018
- MetaSRA: normalized human sample-specific metadata for the Sequence Read ArchiveBioinformatics, 2017
- The Gene Expression Omnibus Database2016
- Uberon, an integrative multi-species anatomy ontologyGenome Biology, 2012
- BioProject and BioSample databases at NCBI: facilitating capture and organization of metadataNucleic Acids Research, 2011
- Modeling sample variables with an Experimental Factor OntologyBioinformatics, 2010
- An ontology for cell typesGenome Biology, 2005