Development of a heart failure filter for Medline: an objective approach using evidence-based clinical practice guidelines as an alternative to hand searching
Open Access
- 28 January 2011
- journal article
- research article
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 11 (1) , 1-10
Abstract
Background: Heart failure is a highly debilitating syndrome with a poor prognosis primarily affecting the elderly. Clinicians wanting timely access to heart failure evidence to provide optimal patient care can face many challenges in locating this evidence.This study developed and validated a search filter of high clinical utility for the retrieval of heart failure articles in OvidSP Medline.Methods: A Clinical Advisory Group was established to advise study investigators. The study set of 876 relevant articles from four heart failure clinical practice guidelines was divided into three datasets: a Term Identification Set, a Filter Development Set, and a Filter Validation Set. A further validation set (the Cochrane Validation Set) was formed using studies included in Cochrane heart failure systematic reviews. Candidate search terms were identified via word frequency analysis. The filter was developed by creating combinations of terms and recording their performance in retrieving items from the Filter Development Set. The filter's recall was then validated in both the Filter Validation Set and the Cochrane Validation Set. A precision estimate was obtained post-hoc by running the filter in Medline and screening the first 200 retrievals for relevance to heart failure.Results: The four-term filter achieved a recall of 96.9% in the Filter Development Set; 98.2% in the Filter Validation Set; and 97.8% in the Cochrane Validation Set. Of the first 200 references retrieved by the filter when run in Medline, 150 were deemed relevant and 50 irrelevant. The post-hoc precision estimate was therefore 75%.Conclusions: This study describes an objective method for developing a validated heart failure filter of high recall performance and then testing its precision post-hoc. Clinical practice guidelines were found to be a feasible alternative to hand searching in creating a gold standard for filter development. Guidelines may be especially appropriate given their clinical utility. A validated heart failure filter is now available to support health professionals seeking reliable and efficient access to the heart failure literature.Keywords
This publication has 35 references indexed in Scilit:
- HFSA 2010 Comprehensive Heart Failure Practice GuidelineJournal of Cardiac Failure, 2010
- Developing evidence-based clinical practice guidelines in hospitals in Australia, Indonesia, Malaysia, the Philippines and Thailand: values, requirements and barriersBMC Health Services Research, 2009
- Evaluation of PubMed filters used for evidence-based searching: validation using relative recallJournal of the Medical Library Association, 2009
- Heart Failure and Palliative Care: Implications in PracticeJournal of Palliative Medicine, 2009
- Locating sex-specific evidence on clinical questions in MEDLINE: a search filter for use on OvidSP™BMC Medical Research Methodology, 2009
- So many filters, so little time: the development of a search filter appraisal checklistJournal of the Medical Library Association, 2008
- ESC Guidelines for the diagnosis and treatment of acute and chronic heart failure 2008: The Task Force for the Diagnosis and Treatment of Acute and Chronic Heart Failure 2008 of the European Society of Cardiology. Developed in collaboration with the Heart Failure Association of the ESC (HFA) and endorsed by the European Society of Intensive Care Medicine (ESICM)European Heart Journal, 2008
- Improving end-of-life care for patients with chronic heart failure: “Let’s hope it’ll get better, when I know in my heart of hearts it won’t”Heart, 2007
- Evaluation of methodological search filters—a reviewHealth Information and Libraries Journal, 2004
- A statistical approach to designing search filters to find systematic reviews: objectivity enhances accuracyJournal of Information Science, 2001