Performance evaluation of three semantic expansions to query PubMed
- 1 June 2021
- journal article
- research article
- Published by Wiley in Health Information and Libraries Journal
- Vol. 38 (2) , 113-124
Abstract
Background PubMed is one of the most important basic tools to access medical literature. Semantic query expansion using synonyms can improve retrieval efficacy. Objective The objective was to evaluate the performance of three semantic query expansion strategies. Methods Queries were built for forty MeSH descriptors using three semantic expansion strategies (MeSH synonyms, UMLS mappings, and mappings created by the CISMeF team), then sent to PubMed. To evaluate expansion performances for each query, the first twenty citations were selected, and their relevance were judged by three independent evaluators based on the title and Results Queries built with the UMLS expansion provided new citations with a slightly higher mean precision (74.19%) than with the CISMeF expansion (70.28%), although the difference was not significant. Inter-rater agreement was 0.28. Results varied greatly depending on the descriptor selected. Discussion The number of citations retrieved by the three strategies and their precision varied greatly according to the descriptor. This heterogeneity could be explained by the quality of the synonyms. Optimal use of these different expansions would be through various combinations of UMLS and CISMeF intersections or unions. Conclusion Information retrieval tools should propose different semantic expansions depending on the descriptor and the search objectives.Keywords
This publication has 16 references indexed in Scilit:
- Behavior and attitudes of residents and general practitioners in searching for health information: From intention to practiceInternational Journal of Medical Informatics, 2016
- Strategy of health information seeking among physicians, medical residents, and students after introducing digital library and information technology in teaching hospitals of IranJournal of Evidence-Based Medicine, 2015
- Information–Seeking Among Chronic Disease Prevention Staff in State Health Departments: Use of Academic JournalsPreventing Chronic Disease, 2014
- Lost in PubMed. Factors influencing the success of medical information retrievalExpert Systems with Applications, 2013
- Performance evaluation of unified medical language system®'s synonyms expansion to query PubMedBMC Medical Informatics and Decision Making, 2012
- A Survey of Automatic Query Expansion in Information RetrievalACM Computing Surveys, 2012
- Analysis of queries sent to PubMed at the point of care: Observation of search behaviour in a medical teaching hospitalBMC Medical Informatics and Decision Making, 2008
- A Day in the Life of PubMed: Analysis of a Typical Day's Query LogJournal of the American Medical Informatics Association, 2007
- OHSUMED: An Interactive Retrieval Evaluation and New Large Test Collection for Research1994
- Integration and generalization of kappas for multiple raters.Psychological Bulletin, 1980