Combining relevance assignment with quality of the evidence to support guideline development.
Authors:
- 1 January 2010
- journal article
- Vol. 160 (Pt 1) , 709-13
Abstract
Clinical practice guidelines are used to disseminate best practice to clinicians. Successful guidelines depend on literature that is both relevant to the questions posed and based on high quality research in accordance with evidence-based medicine. Meeting these standards requires extensive manual review. We describe a system that combines symbolic semantic processing with a statistical method for selecting both relevant and high quality studies. We focused on a cardiovascular risk factor guideline, and the overall performance of the system was 56% recall, 91% precision (F0.5-score 0.81). If quality of the evidence is not taken into account, performance drops to 62% recall, 79% precision (F0.5-score 0.75). We suggest that this system can potentially improve the efficiency of the literature review process in guideline development.Keywords
This publication has 15 references indexed in Scilit:
- Towards Automatic Recognition of Scientifically Rigorous Clinical Research EvidenceJournal of the American Medical Informatics Association, 2009
- Semantic processing to support clinical guideline development.2008
- Utilization of the PICO framework to improve searching PubMed for clinical questionsBMC Medical Informatics and Decision Making, 2007
- Using outcome polarity in sentence extraction for medical question-answering.2006
- Text Categorization Models for High-Quality Article Retrieval in Internal MedicineJournal of the American Medical Informatics Association, 2004
- Developing optimal search strategies for detecting clinically relevant qualitative studies in MEDLINE.2004
- The Unified Medical Language System (UMLS): integrating biomedical terminologyNucleic Acids Research, 2004
- The interaction of domain knowledge and linguistic structure in natural language processing: interpreting hypernymic propositions in biomedical textJournal of Biomedical Informatics, 2003
- Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program.2001
- Developing Optimal Search Strategies for Detecting Clinically Sound Studies in MEDLINEJournal of the American Medical Informatics Association, 1994