A Tool to Assess the Trustworthiness of Evidence-Based Point-of-Care Information for Health Care Professionals (CAPOCI): Design and Validation Study
Authors:
- Gerlinde LenaertsGLGerlinde Lenaerts
- Geertruida E BekkeringGBGeertruida E Bekkering
- Martine GoossensMGMartine Goossens
- Leen De ConinckLCLeen De Coninck
- Nicolas DelvauxNicolas Delvaux
- Sam CordynSCSam Cordyn
- Jef AdriaenssensJAJef Adriaenssens
- Bert AertgeertsBABert Aertgeerts
- Patrik VankrunkelsvenPVPatrik Vankrunkelsven
Open Access
- 5 October 2021
- journal article
- research article
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 23 (10) , e27174
Abstract
Background: User-friendly information at the point of care for health care professionals should be well structured, rapidly accessible, comprehensive, and trustworthy. The reliability of information and the associated methodological process must be clear. There is no standard tool to evaluate the trustworthiness of such point-of-care (POC) information. Objective: We aim to develop and validate a new tool for assessment of trustworthiness of evidence-based POC resources to enhance the quality of POC resources and facilitate evidence-based practice. Methods: We designed the Critical Appraisal of Point-of-Care Information (CAPOCI) tool based on the criteria important for assessment of trustworthiness of POC information, reported in a previously published review. A group of health care professionals and methodologists (the authors of this paper) defined criteria for the CAPOCI tool in an iterative process of discussion and pilot testing until consensus was reached. In the next step, all criteria were subject to content validation with a Delphi study. We invited an international panel of 10 experts to rate their agreement with the relevance and wording of the criteria and to give feedback. Consensus was reached when 70% of the experts agreed. When no consensus was reached, we reformulated the criteria based on the experts’ comments for a next round of the Delphi study. This process was repeated until consensus was reached for each criterion. In a last step, the interrater reliability of the CAPOCI tool was calculated with a 2-tailed Kendall tau correlation coefficient to quantify the agreement between 2 users who piloted the CAPOCI tool on 5 POC resources. Two scoring systems were tested: a 3-point ordinal scale and a 7-point Likert scale. Results: After validation, the CAPOCI tool was designed with 11 criteria that focused on methodological quality and author-related information. The criteria assess authorship, literature search, use of preappraised evidence, critical appraisal of evidence, expert opinions, peer review, timeliness and updating, conflict of interest, and commercial support. Interrater agreement showed substantial agreement between 2 users for scoring with the 3-point ordinal scale (τ=.621, P<.01) and scoring with the 7-point Likert scale (τ=.677, P<.01). Conclusions: The CAPOCI tool may support validation teams in the assessment of trustworthiness of POC resources. It may also provide guidance for producers of POC resources.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- Readability of online health information: implications for health literacyInformatics for Health and Social Care, 2011
- Navigators for medicine: evolution of online point-of-care evidence-based servicesInternational Journal Of Clinical Practice, 2010
- AGREE II: Advancing guideline development, reporting, and evaluation in health carePreventive Medicine, 2010
- A Review of Online Evidence-based Practice Point-of-Care Information Summary ProvidersJournal of Medical Internet Research, 2010
- AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviewsJournal of Clinical Epidemiology, 2009
- Accessing pre-appraised evidence: fine-tuning the 5S model into a 6S modelEvidence-Based Nursing, 2009
- Review Of Internet Health Information Quality InitiativesJournal of Medical Internet Research, 2001
- e-Health Code of Ethics (May 24)Journal of Medical Internet Research, 2000
- Evidence-based medicineSeminars in Perinatology, 1997
- Evidence based medicine: what it is and what it isn'tBMJ, 1996