Overview of the gene ontology task at BioCreative IV
Authors:
- Y. MaoYMY. Mao
- K. Van AukenKAK. Van Auken
- D. LiDLD. Li
- C. N. ArighiCAC. N. Arighi
- P. McQuiltonPMP. McQuilton
- G. T. HaymanGHG. T. Hayman
- S. TweedieSTS. Tweedie
- M. L. SchaefferMSM. L. Schaeffer
- S. J. F. LaulederkindSLS. J. F. Laulederkind
- S.-J. WangSWS.-J. Wang
- J. GobeillJGJ. Gobeill
- P. RuchPRP. Ruch
Open Access
- 1 January 2014
- journal article
- research article
- Published by Oxford University Press (OUP) in Database: The Journal of Biological Databases and Curation
- Vol. 2014, bau086
Abstract
Gene ontology (GO) annotation is a common task among model organism databases (MODs) for capturing gene function data from journal articles. It is a time-consuming and labor-intensive task, and is thus often considered as one of the bottlenecks in literature curation. There is a growing need for semiautomated or fully automated GO curation techniques that will help database curators to rapidly and accurately identify gene function information in full-length articles. Despite multiple attempts in the past, few studies have proven to be useful with regard to assisting real-world GO curation. The shortage of sentence-level training data and opportunities for interaction between text-mining developers and GO curators has limited the advances in algorithm development and corresponding use in practical circumstances. To this end, we organized a text-mining challenge task for literature-based GO annotation in BioCreative IV. More specifically, we developed two subtasks: (i) to automatically locate text passages that contain GO-relevant information (a text retrieval task) and (ii) to automatically identify relevant GO terms for the genes in a given article (a concept-recognition task). With the support from five MODs, we provided teams with >4000 unique text passages that served as the basis for each GO annotation in our task data. Such evidence text information has long been recognized as critical for text-mining algorithm development but was never made available because of the high cost of curation. In total, seven teams participated in the challenge task. From the team results, we conclude that the state of the art in automatically mining GO terms from literature has improved over the past decade while much progress is still needed for computer-assisted GO curation. Future work should focus on addressing remaining technical challenges for improved performance of automatic GO concept recognition and incorporating practical benefits of text-mining tools into real-world GO annotation. http://www.biocreative.org/tasks/biocreative-iv/track-4-GO/.Keywords
This publication has 45 references indexed in Scilit:
- GeneRIF indexing: sentence selection based on machine learningBMC Bioinformatics, 2013
- Large-Scale Event Extraction from Literature with Multi-Level Gene NormalizationPLOS ONE, 2013
- Accelerating literature curation with text-mining tools: a case study of using PubTator to curate genes in PubMed abstractsDatabase: The Journal of Biological Databases and Curation, 2012
- Improving links between literature and biological data with text mining: a case study with GEO, PDB and MEDLINEDatabase: The Journal of Biological Databases and Curation, 2012
- Extraction of data deposition statements from the literature: a method for automatically tracking research resultsBioinformatics, 2011
- Semi-automatic semantic annotation of PubMed queries: A study on quality, efficiency, satisfactionJournal of Biomedical Informatics, 2011
- Reflective random indexing for semi-automatic indexing of the biomedical literatureJournal of Biomedical Informatics, 2010
- Document classification for mining host pathogen protein–protein interactionsArtificial Intelligence in Medicine, 2010
- Cross-product extensions of the Gene OntologyJournal of Biomedical Informatics, 2010
- Representing ontogeny through ontology: A developmental biologist's guide to the gene ontologyMolecular Reproduction and Development, 2009