Exam prediction and the general Practice Registrar Competency Assessment Grid (GPR-CAG)
Open Access
- 2 November 2023
- journal article
- research article
- Published by Taylor & Francis in Education for Primary Care
- Vol. 34 (5-6) , 268-276
Abstract
In GP training, identifying early predictors of poor summative examination performance can be challenging. We aimed to establish whether external clinical teaching visit (ECTV) performance, measured using a validated instrument (GP Registrar Competency Assessment Grid, GPR-CAG) is predictive of Royal Australian College of General Practitioners (RACGP) Fellowship examination performance. A retrospective cohort study including GP registrars in New South Wales/Australian Capital Territory with ECTV data recorded during their first training term (GPT1), between 2014 and 2018, who attempted at least one Fellowship examination. Independent variables of interest included the four GPR-CAG factors assessed in GPT1 ('patient-centredness/caring', 'formulating hypotheses/management plans', 'professional responsibilities', 'physical examination skills'). Outcomes of interest included individual scores of the three summative examinations (Applied Knowledge Test (AKT); Key Feature Problem (KFP); and the Objective Structured Clinical Examination (OSCE)) and overall Pass/Fail status. Univariable and multivariable regression analyses were performed. Univariably, there were statistically significant associations (p < 0.01) between all four GPR-CAG factors and all four summative examination outcomes, except for 'formulating hypotheses/management plans' and OSCE score (p = 0.07). On multivariable analysis, each factor was significantly associated (p < 0.05) with at least one exam outcome, and 'physical examination skills' was significantly associated (p < 0.05) with all four exam outcomes. ECTV performance, via GPR-CAG scores, is predictive of RACGP Fellowship exam performance. The univariable findings highlight the pragmatic utility of ECTVs in flagging registrars who are at-risk of poor exam performance, facilitating early intervention. The multivariable associations of GPR-CAG scores and examination performance suggest that these scores provide predictive ability beyond that of other known predictors.Keywords
Funding Information
- Department of Health
This publication has 21 references indexed in Scilit:
- Do OSCE progress test scores predict performance in a national high‐stakes examination?Medical Education, 2016
- Evaluation of outcomes of a formative objective structured clinical examination for second-year UK medical studentsInternational Journal of Medical Education, 2015
- Learner Deficits and Academic Outcomes of Medical Students, Residents, Fellows, and Attending Physicians Referred to a Remediation Program, 2006–2012Academic Medicine, 2014
- Test‐enhanced learning and its effect on comprehension and diagnostic accuracyMedical Education, 2014
- Evaluations of situational judgement tests to assess non‐academic attributes in selectionMedical Education, 2012
- The importance of seeing the patient: test-enhanced learning with standardized patients and written tests improves clinical application of knowledgeAdvances in Health Sciences Education, 2012
- A remedial intervention linked to a formative assessment is effective in terms of improving student performance in subsequent degree examinationsMedical Teacher, 2010
- Assessment in Medical EducationNew England Journal of Medicine, 2007
- The assessment of clinical skills/competence/performanceAcademic Medicine, 1990
- Formative assessment and the design of instructional systemsInstructional Science, 1989