The Relationship Between Formative and Summative Examinations and PANCE Scores; Can the Past Predict the Future?

Authors:
  • HSHealth Sciences
    Health Sciences
Publisher website
Google Scholar
Abstract
Purpose: This paper describes how a systematic analysis of students at risk for failing the Physician Assistant National Certifying Examination (PANCE) may be used to identify which students may benefit from intervention prior to taking the PANCE and thus increase the likelihood of successful completion of the PANCE. The intervention developed and implemented uses various formative and summative examinations to predict students’ PANCE scores with a high degree of accuracy. Methods: Eight end-of-rotation exams (EOREs) based upon discipline-specific diseases and averaging 100 questions each, a 360-question PANCE simulation (SUMM I), the PACKRAT, and a 700-question summative cognitive examination based upon the NCCPA blueprint (SUMM II) were administered to all students enrolled in the program during the clinical year starting in January 2010 and concluding in December 2010. Results: When the PACKRAT, SUMM I, SUMM II, and the surgery, women's health, and pediatrics EOREs were combined in a regression model, an Rvalue of 0.87 and an R 2 of 0.75 were obtained. A predicted score was generated for the class of 2009. The predicted PANCE score based upon this model had a final correlation of 0.790 with the actual PANCE score. Conclusion: This pilot study demonstrated that valid predicted scores could be generated from formative and summative examinations to provide valuable feedback and to identify students at risk of failing the PANCE.