MeSH Up: effective MeSH text classification for improved document retrieval
Open Access
- 17 April 2009
- journal article
- research article
- Published by Oxford University Press (OUP) in Bioinformatics
- Vol. 25 (11) , 1412-1418
Abstract
Motivation: Controlled vocabularies such as the Medical Subject Headings (MeSH) thesaurus and the Gene Ontology (GO) provide an efficient way of accessing and organizing biomedical information by reducing the ambiguity inherent to free-text data. Different methods of automating the assignment of MeSH concepts have been proposed to replace manual annotation, but they are either limited to a small subset of MeSH or have only been compared with a limited number of other systems. Results: We compare the performance of six MeSH classification systems [MetaMap, EAGL, a language and a vector space model-based approach, a K-Nearest Neighbor (KNN) approach and MTI] in terms of reproducing and complementing manual MeSH annotations. A KNN system clearly outperforms the other published approaches and scales well with large amounts of text using the full MeSH thesaurus. Our measurements demonstrate to what extent manual MeSH annotations can be reproduced and how they can be complemented by automatic annotations. We also show that a statistically significant improvement can be obtained in information retrieval (IR) when the text of a user's query is automatically annotated with MeSH concepts, compared to using the original textual query alone. Conclusions: The annotation of biomedical texts using controlled vocabularies such as MeSH can be automated to improve text-only IR. Furthermore, the automatic MeSH annotation system we propose is highly scalable and it generates improvements in IR comparable with those observed for manual annotations. Contact:trieschn@ewi.utwente.nl Supplementary information: Supplementary data are available at Bioinformatics online.Keywords
This publication has 20 references indexed in Scilit:
- ArrayExpress update--from an archive of functional genomics experiments to the atlas of gene expressionNucleic Acids Research, 2009
- Comparison of vocabularies, representations and ranking algorithms for gene prioritization by text miningBioinformatics, 2008
- A probabilistic generative model for GO enrichment analysisNucleic Acids Research, 2008
- Optimal Training Sets for Bayesian Prediction of MeSH(R) AssignmentJournal of the American Medical Informatics Association, 2008
- Combining Evidence, Specificity, and Proximity towards the Normalization of Gene Ontology Terms in TextEURASIP Journal on Bioinformatics and Systems Biology, 2008
- PubMed related articles: a probabilistic topic-based model for content similarityBMC Bioinformatics, 2007
- Automatic assignment of biomedical categories: toward a generic approachBioinformatics, 2005
- Automatic text categorization and its application to text retrievalIEEE Transactions on Knowledge and Data Engineering, 1999
- Naive (Bayes) at forty: The independence assumption in information retrieval1998
- Retrieval Feedback in MEDLINEJournal of the American Medical Informatics Association, 1996