Reliability and Validity of National End of Rotation Examinations: An Update
- 1 June 2018
- journal article
- research article
- Published by Wolters Kluwer Health in The Journal of Physician Assistant Education
- Vol. 29 (2) , 86-88
Abstract
Purpose: This study sought to evaluate the reliability of the PAEA End of Rotation™ exam scores used as a combined scale. The study also investigated how closely the individual exam scores and the combined scale correlate with Physician Assistant National Certifying Exam (PANCE) performance to validate their use as tools for assessing physician assistant (PA) students during their clinical training. Methods: Deidentified PAEA End of Rotation examination and PANCE scores were used to calculate Pearson correlations, Cronbach's alpha, and value of Cronbach's alpha if individual exams were removed from the analysis. A linear regression model was generated to predict certification exam scores. Results: End of Rotation examinations are a reliable predictor of certification examination performance independent of PA program or test version, with Cronbach's alpha at 0.847. Conclusions: The mean of all 7 examinations may be used, but the mean of just 4 examinations (Emergency Medicine, Family Medicine, General Surgery, and Internal Medicine) is also a valid predictor of certification examination performance.Keywords
This publication has 6 references indexed in Scilit:
- Reliability and Validity of PAEA End of Rotation™ Examination Scores for Predicting Performance on the Physician Assistant National Certification ExaminationThe Journal of Physician Assistant Education, 2015
- Correlation of the Physician Assistant Education Association End of Rotation Examinations with the Physician Assistant National Certifying ExamThe Journal of Physician Assistant Education, 2015
- The Relationship Between Formative and Summative Examination and PANCE Results: A Multi-Program StudyThe Journal of Physician Assistant Education, 2013
- A Primer on the Validity of Assessment InstrumentsJournal of Graduate Medical Education, 2011
- Reliability: on the reproducibility of assessment dataMedical Education, 2004
- Evaluation of the Relationship between Student Performance on the PACKRAT And PANCE ExaminationsThe Journal of Physician Assistant Education, 2004