The Adapted Fresno Test of competence in evidence-based practice
Authors:
- 1 January 2009
- journal article
- research article
- Published by Wolters Kluwer Health in Journal of Continuing Education in the Health Professions
- Vol. 29 (2) , 119-126
Abstract
Introduction: Health educators who teach professionals about evidence‐based practice (EBP) need instruments to measure change in skills and knowledge. This study aimed to develop and evaluate the interrater reliability, internal consistency, and responsiveness of the Adapted Fresno Test (AFT) of competence in EBP. Methods: Reliability testing involved 2 raters. The AFT was completed by 114 occupational therapists before, and 106 therapists after a 2‐day workshop on EBP. A random sample of 20 completed tests (10 pre‐ and 10 postworkshop = Versions 1 and 2) were scored by 2 raters. Interrater reliability was calculated with the use of intraclass correlation coefficients (ICC, 1,2) for 7 summed subtest scores and the total AFT score. Internal consistency was calculated with the use of Cronbach's α. Responsiveness was calculated by comparing mean pre–post change scores, change in low scorers with high scorers. Results: Interrater reliability ranged from good to excellent for individual AFT subtests (Version 1: ICC, 0.80–0.96; Version 2: 0.68–0.94), and excellent for total AFT scores (Version 1: ICC, 0.96; Version 2: ICC, 0.91). Internal consistency was acceptable (Cronbach's α, 0.74). Overall mean change on the 156‐point test was 20.6 points (95% confidence interval [CI], 15.6–25.5), 26.8 points (95% CI, 21.6–1.9) for low scorers and −1.8 points (95% CI, −6.4 to 10.1) for high scorers. Discussion: The AFT has acceptable psychometric properties, and measures change in knowledge and skills of rehabilitation professionals following EBP training. The test is most useful for evaluating change in novice learners.Keywords
This publication has 7 references indexed in Scilit:
- Instruments for Evaluating Education in Evidence-Based PracticeJAMA, 2006
- Providing education on evidence-based practice improved knowledge but did not change behaviour: a before and after studyBMC Medical Education, 2005
- Perceptions of evidence‐based practice: A survey of Australian occupational therapistsAustralian Occupational Therapy Journal, 2003
- Occupational therapists report a low level of knowledge, skill and involvement in evidence‐based practiceAustralian Occupational Therapy Journal, 2003
- Validation of the Fresno test of competence in evidence based medicineBMJ, 2003
- Health Status Measures: Strategies and Analytic Methods for Assessing Change ScoresPhysical Therapy, 1996
- Measuring change over time: Assessing the usefulness of evaluative instrumentsJournal of Chronic Diseases, 1987