Data-poor categorization and passage retrieval for Gene Ontology Annotation in Swiss-Prot
Open Access
- 24 May 2005
- journal article
- Published by Springer Nature in BMC Bioinformatics
- Vol. 6 (S1) , 1-S23
Abstract
Background In the context of the BioCreative competition, where training data were very sparse, we investigated two complementary tasks: 1) given a Swiss-Prot triplet, containing a protein, a GO (Gene Ontology) term and a relevant article, extraction of a short passage that justifies the GO category assignement; 2) given a Swiss-Prot pair, containing a protein and a relevant article, automatic assignement of a set of categories. Methods Sentence is the basic retrieval unit. Our classifier computes a distance between each sentence and the GO category provided with the Swiss-Prot entry. The Text Categorizer computes a distance between each GO term and the text of the article. Evaluations are reported both based on annotator judgements as established by the competition and based on mean average precision measures computed using a curated sample of Swiss-Prot. Results Our system achieved the best recall and precision combination both for passage retrieval and text categorization as evaluated by official evaluators. However, text categorization results were far below those in other data-poor text categorization experiments The top proposed term is relevant in less that 20% of cases, while categorization with other biomedical controlled vocabulary, such as the Medical Subject Headings, we achieved more than 90% precision. We also observe that the scoring methods used in our experiments, based on the retrieval status value of our engines, exhibits effective confidence estimation capabilities. Conclusion From a comparative perspective, the combination of retrieval and natural language processing methods we designed, achieved very competitive performances. Largely data-independent, our systems were no less effective that data-intensive approaches. These results suggests that the overall strategy could benefit a large class of information extraction tasks, especially when training data are missing. However, from a user perspective, results were disappointing. Further investigations are needed to design applicable end-user text mining tools for biologists.Keywords
This publication has 24 references indexed in Scilit:
- Using argumentation to retrieve articles with similar citations: An inquiry into improving related articles search in the MEDLINE digital libraryInternational Journal of Medical Informatics, 2006
- Protein annotation as term categorization in the gene ontology using word proximity networksBMC Bioinformatics, 2005
- Automatically annotating documents with normalized gene listsBMC Bioinformatics, 2005
- Probabilistic models of information retrieval based on measuring the divergence from randomnessACM Transactions on Information Systems, 2002
- The use of bigrams to enhance text categorizationInformation Processing & Management, 2002
- Comparing noun phrasing techniques for use with medical digital library toolsJournal of the American Society for Information Science, 2000
- The SWISS-PROT protein sequence database and its supplement TrEMBL in 2000Nucleic Acids Research, 2000
- Identifying and tracking changing interestsInternational Journal on Digital Libraries, 1998
- Automated learning of decision rules for text categorizationACM Transactions on Information Systems, 1994
- The String-to-String Correction ProblemJournal of the ACM, 1974